2024-09-10T10:41:14.604 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T10:41:14.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T10:41:14.728 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055 branch: wip-rishabh-testing-20240909.165402-squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: null first_in_suite: false job_id: '7899055' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4EfQgz/nswYm3ThHUbqoqKqeLeN+19HwCmqjEGGqCBYt9AAiM454pbv/EVEfAg96F6LuNxJqSv9spj8EwolFk= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1Q7JPBMENrMF2qOVj6kueUtikqhUDYPpKu4+CTkeYrOXjnzHrw2WuGutshm2cu6/P04MO6o7lsG5IESMX54h0= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCc/MP50r6itbig4ZeecTLg3Je2Yy6INqCTbj8ZYSiQrnE5zV8bhdFQXRJaiVnB2Wahr9T/ViYaz7gXo0a5b7is= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T10:41:14.728 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T10:41:14.728 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T10:41:14.729 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T10:41:14.730 INFO:teuthology.task.internal:Checking packages... 2024-09-10T10:41:14.751 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T10:41:14.751 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T10:41:14.751 INFO:teuthology.packaging:ref: None 2024-09-10T10:41:14.752 INFO:teuthology.packaging:tag: None 2024-09-10T10:41:14.752 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T10:41:14.752 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:41:14.752 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T10:41:14.897 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T10:41:14.899 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T10:41:14.905 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T10:41:14.905 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T10:41:14.923 INFO:teuthology.task.internal:Saving configuration 2024-09-10T10:41:14.944 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T10:41:14.951 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T10:41:14.974 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 10:36:05.392967', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4EfQgz/nswYm3ThHUbqoqKqeLeN+19HwCmqjEGGqCBYt9AAiM454pbv/EVEfAg96F6LuNxJqSv9spj8EwolFk='} 2024-09-10T10:41:14.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 10:36:05.395276', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1Q7JPBMENrMF2qOVj6kueUtikqhUDYPpKu4+CTkeYrOXjnzHrw2WuGutshm2cu6/P04MO6o7lsG5IESMX54h0='} 2024-09-10T10:41:15.012 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 10:36:05.394221', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCc/MP50r6itbig4ZeecTLg3Je2Yy6INqCTbj8ZYSiQrnE5zV8bhdFQXRJaiVnB2Wahr9T/ViYaz7gXo0a5b7is='} 2024-09-10T10:41:15.013 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T10:41:15.019 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T10:41:15.019 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T10:41:15.019 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T10:41:15.019 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T10:41:15.093 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f556d333be0>, signals=[15]) 2024-09-10T10:41:15.094 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T10:41:15.108 INFO:teuthology.task.internal:Opening connections... 2024-09-10T10:41:15.108 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T10:41:15.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:41:15.189 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-09-10T10:41:15.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:41:15.265 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-09-10T10:41:15.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:41:15.340 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T10:41:15.347 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-09-10T10:41:15.365 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-09-10T10:41:15.366 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-09-10T10:41:15.422 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-09-10T10:41:15.422 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-09-10T10:41:15.422 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-09-10T10:41:15.422 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T10:41:15.423 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T10:41:15.424 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-09-10T10:41:15.463 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-09-10T10:41:15.481 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-09-10T10:41:15.482 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-09-10T10:41:15.540 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-09-10T10:41:15.540 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T10:41:15.541 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T10:41:15.542 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T10:41:15.542 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-09-10T10:41:15.562 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-09-10T10:41:15.581 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-09-10T10:41:15.581 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-09-10T10:41:15.638 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-09-10T10:41:15.638 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-09-10T10:41:15.638 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T10:41:15.639 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T10:41:15.639 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-09-10T10:41:15.662 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T10:41:15.672 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T10:41:15.679 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T10:41:15.679 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-09-10T10:41:15.681 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-09-10T10:41:15.684 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-09-10T10:41:15.700 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T10:41:15.706 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T10:41:15.706 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-09-10T10:41:15.739 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-09-10T10:41:15.741 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-09-10T10:41:15.973 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T10:41:16.050 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T10:41:16.064 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T10:41:16.065 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T10:41:16.065 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T10:41:16.065 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T10:41:16.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:41:16.082 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-09-10T10:41:16.139 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-503.el9.x86_64 2024-09-10T10:41:16.139 INFO:teuthology.task.kernel:Running kernel on smithi059: 5.14.0-503.el9.x86_64 2024-09-10T10:41:16.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2024-09-10T10:41:20.350 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.2 MB 00:02 2024-09-10T10:41:24.417 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 20 MB 00:02 2024-09-10T10:41:29.701 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-10T10:41:31.102 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 119 kB/s | 19 kB 00:00 2024-09-10T10:41:32.014 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-10T10:41:37.620 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-10T10:41:39.702 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T10:41:39.702 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T10:41:39.799 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-10T10:41:39.807 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-10T10:41:39.808 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-10T10:41:39.809 INFO:teuthology.orchestra.run.smithi059.stdout:Install 4 Packages 2024-09-10T10:41:39.809 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:41:39.809 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 79 M 2024-09-10T10:41:39.809 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 126 M 2024-09-10T10:41:39.809 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-10T10:41:40.205 INFO:teuthology.orchestra.run.smithi059.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 82 kB/s | 23 kB 00:00 2024-09-10T10:41:43.122 INFO:teuthology.orchestra.run.smithi059.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-10T10:41:46.280 INFO:teuthology.orchestra.run.smithi059.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.7 MB/s | 29 MB 00:06 2024-09-10T10:41:46.513 INFO:teuthology.orchestra.run.smithi059.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.4 MB/s | 16 MB 00:06 2024-09-10T10:41:46.514 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:41:46.514 INFO:teuthology.orchestra.run.smithi059.stdout:Total 12 MB/s | 79 MB 00:06 2024-09-10T10:41:47.227 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-10T10:41:47.596 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-10T10:41:47.596 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-10T10:41:48.560 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-10T10:41:48.560 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-10T10:41:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-10T10:41:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T10:41:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T10:41:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T10:41:55.050 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T10:42:00.171 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T10:42:00.218 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:42:05.355 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:42:44.418 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:42:44.459 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:42:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:42:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T10:42:44.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T10:42:44.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T10:42:45.725 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:42:45.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:42:45.725 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-10T10:42:45.725 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T10:42:45.725 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T10:42:45.725 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T10:42:45.725 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T10:42:45.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:42:45.726 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-10T10:42:46.052 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T10:42:46.134 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T10:42:46.134 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T10:42:46.135 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T10:42:46.135 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T10:42:46.135 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T10:42:46.135 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T10:42:46.135 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T10:42:46.135 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T10:42:46.193 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T10:42:46.193 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T10:42:46.194 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2024-09-10T10:42:46.231 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.06 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 82.el9 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:Group : Unspecified 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 8274670 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T10:42:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : builder@centos.org 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : CentOS 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2024-09-10T10:42:46.233 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:42:46.234 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T10:42:46.234 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T10:42:46.235 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 5.14.0-505.el9.x86_64 2024-09-10T10:42:46.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T10:42:46.840 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-09-10T10:42:48.246 INFO:teuthology.orchestra.run.smithi059.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T10:42:48.270 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-09-10T10:42:48.272 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-09-10T10:42:48.287 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.WCrFBou021 2024-09-10T10:42:48.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WCrFBou021 2024-09-10T10:42:48.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.WCrFBou021 2024-09-10T10:42:48.500 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.WCrFBou021 is 6KB 2024-09-10T10:42:48.550 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.WCrFBou021 2024-09-10T10:42:48.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T10:42:48.635 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T10:42:48.635 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T10:42:48.635 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T10:42:48.635 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T10:42:48.636 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T10:42:48.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2024-09-10T10:43:18.788 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T10:43:18.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T10:43:18.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:43:37.149 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-09-10T10:43:46.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T10:43:46.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:44:46.154 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T10:44:58.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T10:44:58.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:44:58.428 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-09-10T10:44:58.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T10:44:58.763 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T10:44:58.763 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-09-10T10:44:58.780 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-505.el9.x86_64 2024-09-10T10:44:58.780 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T10:44:58.780 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T10:44:58.780 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T10:44:59.781 DEBUG:teuthology.parallel:result is None 2024-09-10T10:44:59.781 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T10:44:59.791 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T10:44:59.792 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T10:44:59.794 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T10:44:59.798 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T10:44:59.816 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T10:44:59.825 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T10:44:59.839 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T10:44:59.839 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T10:44:59.853 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T10:44:59.856 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T10:44:59.893 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T10:44:59.905 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T10:44:59.905 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T10:44:59.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:44:59.938 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T10:44:59.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:44:59.955 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T10:44:59.958 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T10:44:59.981 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T10:45:00.015 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:45:00.040 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:45:00.043 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:45:00.046 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:45:00.058 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:45:00.191 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:45:00.193 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T10:45:00.202 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T10:45:00.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T10:45:00.205 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T10:45:00.207 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T10:45:00.236 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T10:45:00.250 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T10:45:00.251 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T10:45:00.276 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T10:45:00.279 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T10:45:00.295 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:45:00.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:45:00.435 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:45:00.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:45:00.565 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:45:00.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T10:45:00.634 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:45:00.680 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:45:00.738 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:45:00.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:45:00.866 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:45:00.867 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T10:45:00.935 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:45:00.981 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:45:01.035 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:45:01.119 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:45:01.162 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:45:01.162 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T10:45:01.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-09-10T10:45:01.233 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-09-10T10:45:01.236 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-09-10T10:45:01.275 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:45:01.277 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:45:01.313 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:45:01.747 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T10:45:01.756 INFO:teuthology.task.internal:Starting timer... 2024-09-10T10:45:01.756 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T10:45:01.772 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T10:45:01.786 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T10:45:01.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2024-09-10T10:45:01.868 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2024-09-10T10:45:01.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-09-10T10:45:01.927 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-09-10T10:45:01.929 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-09-10T10:45:01.993 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-09-10T10:45:01.995 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T10:45:01.996 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2024-09-10T10:45:02.020 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2024-09-10T10:45:02.021 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-09-10T10:45:02.042 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-09-10T10:45:02.043 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-09-10T10:45:02.062 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-09-10T10:45:02.062 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-09-10T10:45:02.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:45:02.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:45:02.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:45:02.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:45:02.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:45:02.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:45:02.149 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T10:45:02.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2024-09-10T10:45:02.189 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-09-10T10:45:02.227 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-09-10T10:45:02.261 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T10:45:02.273 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T10:45:02.284 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T10:45:02.285 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi115.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T10:49:00.504 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-09-10T10:49:00.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T10:49:00.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:49:00.589 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-09-10T10:49:00.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T10:49:00.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-10T10:49:00.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:49:00.747 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-09-10T10:49:00.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-10T10:49:00.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-10T10:49:00.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:49:00.912 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-10T10:49:00.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-10T10:49:00.995 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T10:49:01.005 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T10:49:01.005 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T10:49:01.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:49:01.008 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T10:49:01.009 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:49:01.011 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T10:49:01.011 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:49:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T10:49:01.039 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T10:49:01.054 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T10:49:01.054 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T10:49:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T10:49:01.079 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-09-10T10:49:01.080 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T10:49:01.081 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2024-09-10T10:49:01.090 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-09-10T10:49:01.092 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2024-09-10T10:49:01.104 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T10:49:01.106 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-09-10T10:49:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T10:49:01.117 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-09-10T10:49:01.118 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T10:49:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T10:49:01.131 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T10:49:01.145 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T10:49:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:49:01.174 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:49:01.174 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-10T10:49:01.174 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.174 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.175 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.175 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.179 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:49:01.183 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:49:01.183 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-09-10T10:49:01.183 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.183 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.184 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.184 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.200 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:49:01.203 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:49:01.203 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-10T10:49:01.203 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.203 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.203 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.203 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:49:01.204 INFO:teuthology.run_tasks:Running task install... 2024-09-10T10:49:01.212 DEBUG:teuthology.task.install:project ceph 2024-09-10T10:49:01.212 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T10:49:01.213 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T10:49:01.213 INFO:teuthology.task.install:Using flavor: default 2024-09-10T10:49:01.217 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T10:49:01.218 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T10:49:01.218 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T10:49:01.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:49:01.220 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T10:49:01.221 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:49:01.222 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T10:49:01.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:49:01.371 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T10:49:01.371 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T10:49:01.377 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T10:49:01.377 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T10:49:01.380 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T10:49:01.380 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T10:49:01.485 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T10:49:01.485 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:49:01.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T10:49:01.490 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T10:49:01.490 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:49:01.490 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T10:49:01.496 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T10:49:01.497 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:49:01.497 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T10:49:01.513 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T10:49:01.513 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T10:49:01.516 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T10:49:01.516 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T10:49:01.522 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T10:49:01.522 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T10:49:01.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T10:49:01.581 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T10:49:01.589 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T10:49:01.656 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T10:49:01.657 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T10:49:01.664 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T10:49:01.720 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2024-09-10T10:49:01.721 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-09-10T10:49:01.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2024-09-10T10:49:01.723 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-09-10T10:49:01.728 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-09-10T10:49:01.729 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-09-10T10:49:01.948 INFO:teuthology.orchestra.run.smithi115.stdout:45 files removed 2024-09-10T10:49:01.953 INFO:teuthology.orchestra.run.smithi181.stdout:45 files removed 2024-09-10T10:49:01.973 INFO:teuthology.orchestra.run.smithi059.stdout:45 files removed 2024-09-10T10:49:01.975 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T10:49:01.980 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T10:49:02.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T10:49:02.514 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-10T10:49:02.558 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 276 kB/s | 84 kB 00:00 2024-09-10T10:49:02.573 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-10T10:49:02.798 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T10:49:02.842 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T10:49:02.866 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-10T10:49:03.065 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T10:49:03.118 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T10:49:03.141 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-10T10:49:04.091 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.2 MB 00:00 2024-09-10T10:49:06.276 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.2 MB 00:03 2024-09-10T10:49:06.632 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.2 MB 00:03 2024-09-10T10:49:06.776 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-10T10:49:08.600 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-10T10:49:09.369 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-10T10:49:12.527 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-10T10:49:13.996 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 19 kB 00:00 2024-09-10T10:49:14.275 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-10T10:49:14.792 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-10T10:49:15.669 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-10T10:49:15.775 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-10T10:49:16.629 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-10T10:49:17.161 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-10T10:49:18.082 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-10T10:49:20.448 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T10:49:22.010 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T10:49:22.895 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:49:22.896 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:49:22.910 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T10:49:22.911 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T10:49:22.912 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T10:49:22.913 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T10:49:22.915 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T10:49:22.918 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T10:49:22.919 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T10:49:22.988 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-10T10:49:23.010 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2024-09-10T10:49:23.010 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-10T10:49:23.010 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2024-09-10T10:49:23.010 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-10T10:49:23.010 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T10:49:23.010 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T10:49:23.010 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T10:49:23.010 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T10:49:23.010 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T10:49:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T10:49:23.012 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T10:49:23.013 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T10:49:23.014 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T10:49:23.015 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T10:49:23.016 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T10:49:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T10:49:23.018 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T10:49:23.019 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T10:49:23.020 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T10:49:23.021 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2024-09-10T10:49:23.022 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T10:49:23.023 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:49:23.023 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-10T10:49:23.023 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2024-09-10T10:49:23.023 INFO:teuthology.orchestra.run.smithi059.stdout:Install 148 Packages 2024-09-10T10:49:23.023 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 8 Packages 2024-09-10T10:49:23.023 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:49:23.023 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 226 M 2024-09-10T10:49:23.024 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-10T10:49:23.624 INFO:teuthology.orchestra.run.smithi059.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-10T10:49:23.754 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-10T10:49:23.866 INFO:teuthology.orchestra.run.smithi059.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 3.6 MB/s | 897 kB 00:00 2024-09-10T10:49:23.941 INFO:teuthology.orchestra.run.smithi059.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.9 MB/s | 145 kB 00:00 2024-09-10T10:49:24.017 INFO:teuthology.orchestra.run.smithi059.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-10T10:49:24.167 INFO:teuthology.orchestra.run.smithi059.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-10T10:49:24.217 INFO:teuthology.orchestra.run.smithi059.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 7.6 MB/s | 1.5 MB 00:00 2024-09-10T10:49:24.277 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:49:24.278 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:49:24.289 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T10:49:24.290 INFO:teuthology.orchestra.run.smithi115.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T10:49:24.291 INFO:teuthology.orchestra.run.smithi115.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T10:49:24.292 INFO:teuthology.orchestra.run.smithi115.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T10:49:24.293 INFO:teuthology.orchestra.run.smithi115.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T10:49:24.295 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T10:49:24.296 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T10:49:24.358 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T10:49:24.372 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T10:49:24.373 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T10:49:24.374 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T10:49:24.375 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T10:49:24.376 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T10:49:24.377 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T10:49:24.378 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T10:49:24.379 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T10:49:24.380 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T10:49:24.380 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T10:49:24.380 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T10:49:24.380 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T10:49:24.380 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T10:49:24.380 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T10:49:24.380 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T10:49:24.380 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T10:49:24.381 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T10:49:24.382 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T10:49:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T10:49:24.384 INFO:teuthology.orchestra.run.smithi115.stdout:Installing weak dependencies: 2024-09-10T10:49:24.385 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T10:49:24.385 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:49:24.385 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-10T10:49:24.385 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-10T10:49:24.385 INFO:teuthology.orchestra.run.smithi115.stdout:Install 148 Packages 2024-09-10T10:49:24.385 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 8 Packages 2024-09-10T10:49:24.385 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:49:24.385 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 226 M 2024-09-10T10:49:24.385 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-10T10:49:24.709 INFO:teuthology.orchestra.run.smithi059.stdout:(7/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 17 MB/s | 21 MB 00:01 2024-09-10T10:49:24.776 INFO:teuthology.orchestra.run.smithi059.stdout:(8/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 8.4 MB/s | 4.7 MB 00:00 2024-09-10T10:49:24.826 INFO:teuthology.orchestra.run.smithi059.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 505 kB/s | 25 kB 00:00 2024-09-10T10:49:25.027 INFO:teuthology.orchestra.run.smithi115.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 34 kB/s | 6.5 kB 00:00 2024-09-10T10:49:25.269 INFO:teuthology.orchestra.run.smithi115.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 3.6 MB/s | 897 kB 00:00 2024-09-10T10:49:25.276 INFO:teuthology.orchestra.run.smithi059.stdout:(10/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 16 MB/s | 17 MB 00:01 2024-09-10T10:49:25.336 INFO:teuthology.orchestra.run.smithi115.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 2.1 MB/s | 145 kB 00:00 2024-09-10T10:49:25.402 INFO:teuthology.orchestra.run.smithi059.stdout:(11/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 15 MB/s | 11 MB 00:00 2024-09-10T10:49:25.426 INFO:teuthology.orchestra.run.smithi059.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.5 MB/s | 228 kB 00:00 2024-09-10T10:49:25.445 INFO:teuthology.orchestra.run.smithi115.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 8.9 MB/s | 5.4 MB 00:00 2024-09-10T10:49:25.460 INFO:teuthology.orchestra.run.smithi059.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 464 kB/s | 27 kB 00:00 2024-09-10T10:49:25.477 INFO:teuthology.orchestra.run.smithi059.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 630 kB/s | 32 kB 00:00 2024-09-10T10:49:25.537 INFO:teuthology.orchestra.run.smithi115.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-10T10:49:25.569 INFO:teuthology.orchestra.run.smithi059.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-10T10:49:25.587 INFO:teuthology.orchestra.run.smithi115.stdout:(6/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 9.5 MB/s | 2.4 MB 00:00 2024-09-10T10:49:25.595 INFO:teuthology.orchestra.run.smithi059.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 1.4 MB/s | 164 kB 00:00 2024-09-10T10:49:25.637 INFO:teuthology.orchestra.run.smithi059.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 1.8 MB/s | 127 kB 00:00 2024-09-10T10:49:25.704 INFO:teuthology.orchestra.run.smithi059.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 4.6 MB/s | 506 kB 00:00 2024-09-10T10:49:25.796 INFO:teuthology.orchestra.run.smithi059.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 492 kB/s | 45 kB 00:00 2024-09-10T10:49:25.854 INFO:teuthology.orchestra.run.smithi115.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 15 MB/s | 4.7 MB 00:00 2024-09-10T10:49:25.862 INFO:teuthology.orchestra.run.smithi059.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.0 MB/s | 136 kB 00:00 2024-09-10T10:49:25.954 INFO:teuthology.orchestra.run.smithi059.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.7 MB/s | 161 kB 00:00 2024-09-10T10:49:26.014 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:49:26.015 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:49:26.026 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T10:49:26.027 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T10:49:26.028 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T10:49:26.029 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T10:49:26.032 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T10:49:26.033 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T10:49:26.033 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T10:49:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 3.4 MB/s | 320 kB 00:00 2024-09-10T10:49:26.095 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-10T10:49:26.112 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================== 2024-09-10T10:49:26.112 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================== 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T10:49:26.113 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T10:49:26.114 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-09-10T10:49:26.115 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T10:49:26.116 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T10:49:26.117 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T10:49:26.118 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T10:49:26.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T10:49:26.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T10:49:26.121 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T10:49:26.122 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T10:49:26.123 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-09-10T10:49:26.124 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T10:49:26.125 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:49:26.125 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-10T10:49:26.125 INFO:teuthology.orchestra.run.smithi181.stdout:====================================================================================== 2024-09-10T10:49:26.125 INFO:teuthology.orchestra.run.smithi181.stdout:Install 148 Packages 2024-09-10T10:49:26.125 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 8 Packages 2024-09-10T10:49:26.125 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:49:26.125 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 226 M 2024-09-10T10:49:26.125 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-10T10:49:26.138 INFO:teuthology.orchestra.run.smithi059.stdout:(23/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 3.2 MB/s | 301 kB 00:00 2024-09-10T10:49:26.230 INFO:teuthology.orchestra.run.smithi059.stdout:(24/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.1 MB/s | 99 kB 00:00 2024-09-10T10:49:26.364 INFO:teuthology.orchestra.run.smithi059.stdout:(25/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 7.4 MB/s | 5.3 MB 00:00 2024-09-10T10:49:26.397 INFO:teuthology.orchestra.run.smithi059.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 509 kB/s | 85 kB 00:00 2024-09-10T10:49:26.498 INFO:teuthology.orchestra.run.smithi059.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 1.7 MB/s | 170 kB 00:00 2024-09-10T10:49:26.557 INFO:teuthology.orchestra.run.smithi059.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 547 kB/s | 32 kB 00:00 2024-09-10T10:49:26.632 INFO:teuthology.orchestra.run.smithi059.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.9 MB/s | 146 kB 00:00 2024-09-10T10:49:26.682 INFO:teuthology.orchestra.run.smithi059.stdout:(30/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 9.8 MB/s | 3.1 MB 00:00 2024-09-10T10:49:26.696 INFO:teuthology.orchestra.run.smithi115.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 21 MB 00:01 2024-09-10T10:49:26.771 INFO:teuthology.orchestra.run.smithi115.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 336 kB/s | 25 kB 00:00 2024-09-10T10:49:26.814 INFO:teuthology.orchestra.run.smithi181.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 30 kB/s | 6.5 kB 00:00 2024-09-10T10:49:26.999 INFO:teuthology.orchestra.run.smithi059.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 9.7 MB/s | 3.6 MB 00:00 2024-09-10T10:49:27.107 INFO:teuthology.orchestra.run.smithi059.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.3 MB/s | 249 kB 00:00 2024-09-10T10:49:27.146 INFO:teuthology.orchestra.run.smithi115.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 8.2 MB/s | 11 MB 00:01 2024-09-10T10:49:27.182 INFO:teuthology.orchestra.run.smithi059.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 658 kB/s | 49 kB 00:00 2024-09-10T10:49:27.238 INFO:teuthology.orchestra.run.smithi115.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 2.4 MB/s | 228 kB 00:00 2024-09-10T10:49:27.258 INFO:teuthology.orchestra.run.smithi059.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 219 kB/s | 16 kB 00:00 2024-09-10T10:49:27.322 INFO:teuthology.orchestra.run.smithi115.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 324 kB/s | 27 kB 00:00 2024-09-10T10:49:27.350 INFO:teuthology.orchestra.run.smithi059.stdout:(35/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 3.0 MB/s | 285 kB 00:00 2024-09-10T10:49:27.475 INFO:teuthology.orchestra.run.smithi059.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 9.3 MB/s | 7.4 MB 00:00 2024-09-10T10:49:27.480 INFO:teuthology.orchestra.run.smithi115.stdout:(13/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 8.9 MB/s | 17 MB 00:01 2024-09-10T10:49:27.506 INFO:teuthology.orchestra.run.smithi115.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 172 kB/s | 32 kB 00:00 2024-09-10T10:49:27.506 INFO:teuthology.orchestra.run.smithi181.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.3 MB/s | 897 kB 00:00 2024-09-10T10:49:27.517 INFO:teuthology.orchestra.run.smithi059.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 4.5 MB/s | 766 kB 00:00 2024-09-10T10:49:27.534 INFO:teuthology.orchestra.run.smithi059.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 312 kB/s | 18 kB 00:00 2024-09-10T10:49:27.564 INFO:teuthology.orchestra.run.smithi115.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-10T10:49:27.581 INFO:teuthology.orchestra.run.smithi115.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.1 MB/s | 164 kB 00:00 2024-09-10T10:49:27.614 INFO:teuthology.orchestra.run.smithi181.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.3 MB/s | 145 kB 00:00 2024-09-10T10:49:27.642 INFO:teuthology.orchestra.run.smithi115.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 1.6 MB/s | 127 kB 00:00 2024-09-10T10:49:27.665 INFO:teuthology.orchestra.run.smithi115.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 5.9 MB/s | 506 kB 00:00 2024-09-10T10:49:27.668 INFO:teuthology.orchestra.run.smithi059.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-10T10:49:27.724 INFO:teuthology.orchestra.run.smithi115.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 771 kB/s | 45 kB 00:00 2024-09-10T10:49:27.752 INFO:teuthology.orchestra.run.smithi059.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-10T10:49:27.799 INFO:teuthology.orchestra.run.smithi115.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.8 MB/s | 136 kB 00:00 2024-09-10T10:49:27.802 INFO:teuthology.orchestra.run.smithi059.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-10T10:49:27.852 INFO:teuthology.orchestra.run.smithi059.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-10T10:49:27.866 INFO:teuthology.orchestra.run.smithi115.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.4 MB/s | 161 kB 00:00 2024-09-10T10:49:27.902 INFO:teuthology.orchestra.run.smithi059.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-10T10:49:27.950 INFO:teuthology.orchestra.run.smithi115.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 3.8 MB/s | 320 kB 00:00 2024-09-10T10:49:27.952 INFO:teuthology.orchestra.run.smithi059.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T10:49:28.003 INFO:teuthology.orchestra.run.smithi059.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T10:49:28.033 INFO:teuthology.orchestra.run.smithi115.stdout:(23/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 3.5 MB/s | 301 kB 00:00 2024-09-10T10:49:28.092 INFO:teuthology.orchestra.run.smithi115.stdout:(24/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T10:49:28.167 INFO:teuthology.orchestra.run.smithi115.stdout:(25/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-10T10:49:28.193 INFO:teuthology.orchestra.run.smithi115.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 848 kB/s | 85 kB 00:00 2024-09-10T10:49:28.251 INFO:teuthology.orchestra.run.smithi115.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-10T10:49:28.273 INFO:teuthology.orchestra.run.smithi181.stdout:(4/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 3.6 MB/s | 2.4 MB 00:00 2024-09-10T10:49:28.310 INFO:teuthology.orchestra.run.smithi115.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 545 kB/s | 32 kB 00:00 2024-09-10T10:49:28.348 INFO:teuthology.orchestra.run.smithi181.stdout:(5/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 3.1 MB/s | 5.4 MB 00:01 2024-09-10T10:49:28.369 INFO:teuthology.orchestra.run.smithi115.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.5 MB/s | 146 kB 00:00 2024-09-10T10:49:28.419 INFO:teuthology.orchestra.run.smithi115.stdout:(30/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-10T10:49:28.453 INFO:teuthology.orchestra.run.smithi059.stdout:(46/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 13 MB/s | 49 MB 00:03 2024-09-10T10:49:28.480 INFO:teuthology.orchestra.run.smithi059.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 451 kB/s | 215 kB 00:00 2024-09-10T10:49:28.512 INFO:teuthology.orchestra.run.smithi059.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 1.7 MB/s | 1.2 MB 00:00 2024-09-10T10:49:28.582 INFO:teuthology.orchestra.run.smithi181.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 4.9 MB/s | 1.5 MB 00:00 2024-09-10T10:49:28.671 INFO:teuthology.orchestra.run.smithi059.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 675 kB/s | 107 kB 00:00 2024-09-10T10:49:28.721 INFO:teuthology.orchestra.run.smithi059.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-10T10:49:28.744 INFO:teuthology.orchestra.run.smithi115.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 9.5 MB/s | 3.6 MB 00:00 2024-09-10T10:49:28.746 INFO:teuthology.orchestra.run.smithi059.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-10T10:49:28.780 INFO:teuthology.orchestra.run.smithi059.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-10T10:49:28.805 INFO:teuthology.orchestra.run.smithi059.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-10T10:49:28.828 INFO:teuthology.orchestra.run.smithi115.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.9 MB/s | 249 kB 00:00 2024-09-10T10:49:28.855 INFO:teuthology.orchestra.run.smithi059.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-10T10:49:28.905 INFO:teuthology.orchestra.run.smithi059.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 224 kB/s | 11 kB 00:00 2024-09-10T10:49:28.911 INFO:teuthology.orchestra.run.smithi115.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 594 kB/s | 49 kB 00:00 2024-09-10T10:49:28.931 INFO:teuthology.orchestra.run.smithi059.stdout:(56/156): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-09-10T10:49:28.957 INFO:teuthology.orchestra.run.smithi181.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 7.7 MB/s | 4.7 MB 00:00 2024-09-10T10:49:28.964 INFO:teuthology.orchestra.run.smithi059.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T10:49:28.970 INFO:teuthology.orchestra.run.smithi115.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 281 kB/s | 16 kB 00:00 2024-09-10T10:49:28.990 INFO:teuthology.orchestra.run.smithi059.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 772 kB/s | 45 kB 00:00 2024-09-10T10:49:29.099 INFO:teuthology.orchestra.run.smithi059.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-10T10:49:29.112 INFO:teuthology.orchestra.run.smithi115.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-10T10:49:29.137 INFO:teuthology.orchestra.run.smithi115.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 1.7 MB/s | 285 kB 00:00 2024-09-10T10:49:29.148 INFO:teuthology.orchestra.run.smithi059.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 491 kB/s | 24 kB 00:00 2024-09-10T10:49:29.199 INFO:teuthology.orchestra.run.smithi059.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-10T10:49:29.221 INFO:teuthology.orchestra.run.smithi115.stdout:(37/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 219 kB/s | 18 kB 00:00 2024-09-10T10:49:29.254 INFO:teuthology.orchestra.run.smithi115.stdout:(38/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 5.3 MB/s | 766 kB 00:00 2024-09-10T10:49:29.282 INFO:teuthology.orchestra.run.smithi059.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-10T10:49:29.308 INFO:teuthology.orchestra.run.smithi059.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-10T10:49:29.358 INFO:teuthology.orchestra.run.smithi059.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-10T10:49:29.417 INFO:teuthology.orchestra.run.smithi059.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-10T10:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.4 MB/s | 3.0 MB 00:00 2024-09-10T10:49:29.783 INFO:teuthology.orchestra.run.smithi181.stdout:(8/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9. 13 MB/s | 11 MB 00:00 2024-09-10T10:49:29.784 INFO:teuthology.orchestra.run.smithi059.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-10T10:49:29.921 INFO:teuthology.orchestra.run.smithi115.stdout:(39/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 15 MB/s | 49 MB 00:03 2024-09-10T10:49:29.984 INFO:teuthology.orchestra.run.smithi059.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-10T10:49:29.991 INFO:teuthology.orchestra.run.smithi181.stdout:(9/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 6.3 MB/s | 21 MB 00:03 2024-09-10T10:49:30.016 INFO:teuthology.orchestra.run.smithi181.stdout:(10/156): ceph-selinux-19.1.1-305.g1cf819b7.el9 108 kB/s | 25 kB 00:00 2024-09-10T10:49:30.051 INFO:teuthology.orchestra.run.smithi059.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-10T10:49:30.066 INFO:teuthology.orchestra.run.smithi181.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 4.5 MB/s | 228 kB 00:00 2024-09-10T10:49:30.225 INFO:teuthology.orchestra.run.smithi181.stdout:(12/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 10 MB/s | 17 MB 00:01 2024-09-10T10:49:30.226 INFO:teuthology.orchestra.run.smithi059.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.7 MB/s | 4.9 MB 00:00 2024-09-10T10:49:30.250 INFO:teuthology.orchestra.run.smithi181.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 147 kB/s | 27 kB 00:00 2024-09-10T10:49:30.263 INFO:teuthology.orchestra.run.smithi115.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 77 kB/s | 80 kB 00:01 2024-09-10T10:49:30.276 INFO:teuthology.orchestra.run.smithi181.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 633 kB/s | 32 kB 00:00 2024-09-10T10:49:30.309 INFO:teuthology.orchestra.run.smithi181.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 751 kB 00:00 2024-09-10T10:49:30.336 INFO:teuthology.orchestra.run.smithi181.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.7 MB/s | 164 kB 00:00 2024-09-10T10:49:30.359 INFO:teuthology.orchestra.run.smithi181.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T10:49:30.393 INFO:teuthology.orchestra.run.smithi059.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-09-10T10:49:30.393 INFO:teuthology.orchestra.run.smithi181.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 8.4 MB/s | 506 kB 00:00 2024-09-10T10:49:30.443 INFO:teuthology.orchestra.run.smithi059.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-10T10:49:30.452 INFO:teuthology.orchestra.run.smithi181.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 772 kB/s | 45 kB 00:00 2024-09-10T10:49:30.513 INFO:teuthology.orchestra.run.smithi115.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 636 kB/s | 801 kB 00:01 2024-09-10T10:49:30.527 INFO:teuthology.orchestra.run.smithi181.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.8 MB/s | 136 kB 00:00 2024-09-10T10:49:30.619 INFO:teuthology.orchestra.run.smithi181.stdout:(21/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 21 MB/s | 5.3 MB 00:00 2024-09-10T10:49:30.653 INFO:teuthology.orchestra.run.smithi181.stdout:(22/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.3 MB/s | 161 kB 00:00 2024-09-10T10:49:30.678 INFO:teuthology.orchestra.run.smithi181.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 5.4 MB/s | 320 kB 00:00 2024-09-10T10:49:30.704 INFO:teuthology.orchestra.run.smithi181.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.9 MB/s | 301 kB 00:00 2024-09-10T10:49:30.713 INFO:teuthology.orchestra.run.smithi115.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 242 kB/s | 191 kB 00:00 2024-09-10T10:49:30.754 INFO:teuthology.orchestra.run.smithi181.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.3 MB/s | 99 kB 00:00 2024-09-10T10:49:30.779 INFO:teuthology.orchestra.run.smithi181.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-10T10:49:30.785 INFO:teuthology.orchestra.run.smithi059.stdout:(73/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-09-10T10:49:30.827 INFO:teuthology.orchestra.run.smithi059.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-10T10:49:30.829 INFO:teuthology.orchestra.run.smithi181.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-10T10:49:30.905 INFO:teuthology.orchestra.run.smithi181.stdout:(28/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 21 MB/s | 3.1 MB 00:00 2024-09-10T10:49:30.910 INFO:teuthology.orchestra.run.smithi059.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-10T10:49:30.930 INFO:teuthology.orchestra.run.smithi181.stdout:(29/156): ceph-grafana-dashboards-19.1.1-305.g1 318 kB/s | 32 kB 00:00 2024-09-10T10:49:30.955 INFO:teuthology.orchestra.run.smithi181.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.9 MB/s | 146 kB 00:00 2024-09-10T10:49:31.011 INFO:teuthology.orchestra.run.smithi059.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-10T10:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout:(77/156): postgresql-server-13.16-1.el9.x86_64. 5.6 MB/s | 5.8 MB 00:01 2024-09-10T10:49:31.103 INFO:teuthology.orchestra.run.smithi059.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 279 kB/s | 26 kB 00:00 2024-09-10T10:49:31.122 INFO:teuthology.orchestra.run.smithi115.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 295 kB/s | 253 kB 00:00 2024-09-10T10:49:31.129 INFO:teuthology.orchestra.run.smithi059.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-10T10:49:31.171 INFO:teuthology.orchestra.run.smithi059.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 834 kB/s | 35 kB 00:00 2024-09-10T10:49:31.189 INFO:teuthology.orchestra.run.smithi181.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 14 MB/s | 3.6 MB 00:00 2024-09-10T10:49:31.196 INFO:teuthology.orchestra.run.smithi059.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-10T10:49:31.279 INFO:teuthology.orchestra.run.smithi059.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-10T10:49:31.281 INFO:teuthology.orchestra.run.smithi181.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.7 MB/s | 249 kB 00:00 2024-09-10T10:49:31.371 INFO:teuthology.orchestra.run.smithi059.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-10T10:49:31.372 INFO:teuthology.orchestra.run.smithi115.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-10T10:49:31.373 INFO:teuthology.orchestra.run.smithi181.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-10T10:49:31.398 INFO:teuthology.orchestra.run.smithi181.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 422 kB/s | 49 kB 00:00 2024-09-10T10:49:31.423 INFO:teuthology.orchestra.run.smithi181.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 328 kB/s | 16 kB 00:00 2024-09-10T10:49:31.430 INFO:teuthology.orchestra.run.smithi059.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T10:49:31.448 INFO:teuthology.orchestra.run.smithi115.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-10T10:49:31.448 INFO:teuthology.orchestra.run.smithi181.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 5.6 MB/s | 285 kB 00:00 2024-09-10T10:49:31.482 INFO:teuthology.orchestra.run.smithi181.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 13 MB/s | 766 kB 00:00 2024-09-10T10:49:31.505 INFO:teuthology.orchestra.run.smithi059.stdout:(85/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.6 MB/s | 6.0 MB 00:01 2024-09-10T10:49:31.507 INFO:teuthology.orchestra.run.smithi181.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 311 kB/s | 18 kB 00:00 2024-09-10T10:49:31.531 INFO:teuthology.orchestra.run.smithi059.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-09-10T10:49:31.589 INFO:teuthology.orchestra.run.smithi059.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-09-10T10:49:31.607 INFO:teuthology.orchestra.run.smithi181.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-09-10T10:49:31.614 INFO:teuthology.orchestra.run.smithi059.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-10T10:49:31.665 INFO:teuthology.orchestra.run.smithi059.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T10:49:31.666 INFO:teuthology.orchestra.run.smithi181.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T10:49:31.690 INFO:teuthology.orchestra.run.smithi059.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-10T10:49:31.708 INFO:teuthology.orchestra.run.smithi181.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-10T10:49:31.715 INFO:teuthology.orchestra.run.smithi059.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T10:49:31.750 INFO:teuthology.orchestra.run.smithi181.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-10T10:49:31.765 INFO:teuthology.orchestra.run.smithi059.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-10T10:49:31.792 INFO:teuthology.orchestra.run.smithi181.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-10T10:49:31.806 INFO:teuthology.orchestra.run.smithi115.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 198 kB/s | 135 kB 00:00 2024-09-10T10:49:31.824 INFO:teuthology.orchestra.run.smithi059.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 758 kB/s | 44 kB 00:00 2024-09-10T10:49:31.908 INFO:teuthology.orchestra.run.smithi059.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-10T10:49:31.958 INFO:teuthology.orchestra.run.smithi059.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-09-10T10:49:32.008 INFO:teuthology.orchestra.run.smithi059.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-09-10T10:49:32.065 INFO:teuthology.orchestra.run.smithi115.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-10T10:49:32.082 INFO:teuthology.orchestra.run.smithi115.stdout:(48/156): python3-requests-2.25.1-8.el9.noarch. 176 kB/s | 125 kB 00:00 2024-09-10T10:49:32.117 INFO:teuthology.orchestra.run.smithi059.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-10T10:49:32.184 INFO:teuthology.orchestra.run.smithi059.stdout:(98/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.0 MB/s | 5.1 MB 00:01 2024-09-10T10:49:32.207 INFO:teuthology.orchestra.run.smithi115.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 856 kB/s | 107 kB 00:00 2024-09-10T10:49:32.209 INFO:teuthology.orchestra.run.smithi059.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 629 kB/s | 58 kB 00:00 2024-09-10T10:49:32.234 INFO:teuthology.orchestra.run.smithi181.stdout:(44/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 22 MB/s | 49 MB 00:02 2024-09-10T10:49:32.234 INFO:teuthology.orchestra.run.smithi059.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T10:49:32.251 INFO:teuthology.orchestra.run.smithi181.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 295 kB/s | 135 kB 00:00 2024-09-10T10:49:32.257 INFO:teuthology.orchestra.run.smithi115.stdout:(50/156): python3-urllib3-1.26.5-6.el9.noarch.r 265 kB/s | 215 kB 00:00 2024-09-10T10:49:32.259 INFO:teuthology.orchestra.run.smithi059.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T10:49:32.282 INFO:teuthology.orchestra.run.smithi115.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 289 kB/s | 22 kB 00:00 2024-09-10T10:49:32.284 INFO:teuthology.orchestra.run.smithi181.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-09-10T10:49:32.285 INFO:teuthology.orchestra.run.smithi059.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-10T10:49:32.308 INFO:teuthology.orchestra.run.smithi115.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-10T10:49:32.326 INFO:teuthology.orchestra.run.smithi181.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-10T10:49:32.341 INFO:teuthology.orchestra.run.smithi115.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-10T10:49:32.343 INFO:teuthology.orchestra.run.smithi181.stdout:(48/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-10T10:49:32.344 INFO:teuthology.orchestra.run.smithi059.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-10T10:49:32.392 INFO:teuthology.orchestra.run.smithi115.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-10T10:49:32.402 INFO:teuthology.orchestra.run.smithi181.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-10T10:49:32.402 INFO:teuthology.orchestra.run.smithi059.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T10:49:32.427 INFO:teuthology.orchestra.run.smithi181.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 4.7 MB/s | 689 kB 00:00 2024-09-10T10:49:32.436 INFO:teuthology.orchestra.run.smithi059.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T10:49:32.442 INFO:teuthology.orchestra.run.smithi115.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T10:49:32.453 INFO:teuthology.orchestra.run.smithi181.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 430 kB/s | 22 kB 00:00 2024-09-10T10:49:32.461 INFO:teuthology.orchestra.run.smithi059.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 771 kB/s | 19 kB 00:00 2024-09-10T10:49:32.486 INFO:teuthology.orchestra.run.smithi181.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 984 kB/s | 33 kB 00:00 2024-09-10T10:49:32.500 INFO:teuthology.orchestra.run.smithi115.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T10:49:32.511 INFO:teuthology.orchestra.run.smithi059.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-10T10:49:32.526 INFO:teuthology.orchestra.run.smithi115.stdout:(57/156): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-10T10:49:32.528 INFO:teuthology.orchestra.run.smithi181.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-10T10:49:32.551 INFO:teuthology.orchestra.run.smithi115.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-10T10:49:32.553 INFO:teuthology.orchestra.run.smithi059.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 628 kB/s | 26 kB 00:00 2024-09-10T10:49:32.562 INFO:teuthology.orchestra.run.smithi181.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 550 kB/s | 18 kB 00:00 2024-09-10T10:49:32.579 INFO:teuthology.orchestra.run.smithi059.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T10:49:32.595 INFO:teuthology.orchestra.run.smithi181.stdout:(55/156): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-10T10:49:32.604 INFO:teuthology.orchestra.run.smithi059.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T10:49:32.612 INFO:teuthology.orchestra.run.smithi181.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T10:49:32.637 INFO:teuthology.orchestra.run.smithi181.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-10T10:49:32.646 INFO:teuthology.orchestra.run.smithi059.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-10T10:49:32.663 INFO:teuthology.orchestra.run.smithi181.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-10T10:49:32.693 INFO:teuthology.orchestra.run.smithi115.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-10T10:49:32.705 INFO:teuthology.orchestra.run.smithi181.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-10T10:49:32.718 INFO:teuthology.orchestra.run.smithi115.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-10T10:49:32.738 INFO:teuthology.orchestra.run.smithi059.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-10T10:49:32.752 INFO:teuthology.orchestra.run.smithi181.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 588 kB/s | 24 kB 00:00 2024-09-10T10:49:32.752 INFO:teuthology.orchestra.run.smithi115.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-10T10:49:32.769 INFO:teuthology.orchestra.run.smithi115.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-10T10:49:32.781 INFO:teuthology.orchestra.run.smithi059.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-10T10:49:32.789 INFO:teuthology.orchestra.run.smithi181.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-10T10:49:32.797 INFO:teuthology.orchestra.run.smithi059.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-10T10:49:32.814 INFO:teuthology.orchestra.run.smithi059.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T10:49:32.828 INFO:teuthology.orchestra.run.smithi115.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-10T10:49:32.831 INFO:teuthology.orchestra.run.smithi059.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 858 kB/s | 14 kB 00:00 2024-09-10T10:49:32.839 INFO:teuthology.orchestra.run.smithi181.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-10T10:49:32.853 INFO:teuthology.orchestra.run.smithi115.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-10T10:49:32.864 INFO:teuthology.orchestra.run.smithi059.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-10T10:49:32.881 INFO:teuthology.orchestra.run.smithi181.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-09-10T10:49:32.889 INFO:teuthology.orchestra.run.smithi059.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T10:49:32.903 INFO:teuthology.orchestra.run.smithi115.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.0 MB/s | 3.0 MB 00:00 2024-09-10T10:49:32.915 INFO:teuthology.orchestra.run.smithi059.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-10T10:49:32.920 INFO:teuthology.orchestra.run.smithi115.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-10T10:49:32.923 INFO:teuthology.orchestra.run.smithi181.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-10T10:49:32.940 INFO:teuthology.orchestra.run.smithi059.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-10T10:49:32.948 INFO:teuthology.orchestra.run.smithi181.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 576 kB/s | 38 kB 00:00 2024-09-10T10:49:32.968 INFO:teuthology.orchestra.run.smithi059.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T10:49:33.016 INFO:teuthology.orchestra.run.smithi059.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-10T10:49:33.033 INFO:teuthology.orchestra.run.smithi059.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 652 kB/s | 11 kB 00:00 2024-09-10T10:49:33.049 INFO:teuthology.orchestra.run.smithi059.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-10T10:49:33.066 INFO:teuthology.orchestra.run.smithi059.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-10T10:49:33.083 INFO:teuthology.orchestra.run.smithi059.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-10T10:49:33.100 INFO:teuthology.orchestra.run.smithi059.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-10T10:49:33.167 INFO:teuthology.orchestra.run.smithi059.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-10T10:49:33.184 INFO:teuthology.orchestra.run.smithi059.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-10T10:49:33.207 INFO:teuthology.orchestra.run.smithi181.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.2 MB/s | 3.0 MB 00:00 2024-09-10T10:49:33.212 INFO:teuthology.orchestra.run.smithi115.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-09-10T10:49:33.226 INFO:teuthology.orchestra.run.smithi059.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-10T10:49:33.251 INFO:teuthology.orchestra.run.smithi059.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-10T10:49:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-10T10:49:33.285 INFO:teuthology.orchestra.run.smithi059.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 990 kB/s | 16 kB 00:00 2024-09-10T10:49:33.310 INFO:teuthology.orchestra.run.smithi059.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T10:49:33.336 INFO:teuthology.orchestra.run.smithi059.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T10:49:33.361 INFO:teuthology.orchestra.run.smithi059.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 559 kB/s | 28 kB 00:00 2024-09-10T10:49:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-10T10:49:33.387 INFO:teuthology.orchestra.run.smithi059.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-09-10T10:49:33.412 INFO:teuthology.orchestra.run.smithi059.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T10:49:33.429 INFO:teuthology.orchestra.run.smithi115.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-10T10:49:33.437 INFO:teuthology.orchestra.run.smithi059.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T10:49:33.462 INFO:teuthology.orchestra.run.smithi059.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T10:49:33.488 INFO:teuthology.orchestra.run.smithi059.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T10:49:33.513 INFO:teuthology.orchestra.run.smithi059.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T10:49:33.538 INFO:teuthology.orchestra.run.smithi059.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T10:49:33.563 INFO:teuthology.orchestra.run.smithi059.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-09-10T10:49:33.605 INFO:teuthology.orchestra.run.smithi059.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-09-10T10:49:33.631 INFO:teuthology.orchestra.run.smithi059.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T10:49:33.640 INFO:teuthology.orchestra.run.smithi181.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-10T10:49:33.689 INFO:teuthology.orchestra.run.smithi059.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-10T10:49:33.890 INFO:teuthology.orchestra.run.smithi059.stdout:(148/156): librados2-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-10T10:49:33.904 INFO:teuthology.orchestra.run.smithi115.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.7 MB/s | 4.9 MB 00:01 2024-09-10T10:49:33.907 INFO:teuthology.orchestra.run.smithi181.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.3 MB/s | 910 kB 00:00 2024-09-10T10:49:33.965 INFO:teuthology.orchestra.run.smithi059.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-10T10:49:33.974 INFO:teuthology.orchestra.run.smithi181.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-10T10:49:34.133 INFO:teuthology.orchestra.run.smithi181.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-10T10:49:34.138 INFO:teuthology.orchestra.run.smithi115.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-09-10T10:49:34.171 INFO:teuthology.orchestra.run.smithi115.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.8 MB/s | 1.0 MB 00:00 2024-09-10T10:49:34.205 INFO:teuthology.orchestra.run.smithi115.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T10:49:34.263 INFO:teuthology.orchestra.run.smithi115.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-10T10:49:34.274 INFO:teuthology.orchestra.run.smithi181.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.7 MB/s | 4.9 MB 00:01 2024-09-10T10:49:34.341 INFO:teuthology.orchestra.run.smithi181.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-09-10T10:49:34.364 INFO:teuthology.orchestra.run.smithi115.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 6.2 MB/s | 5.8 MB 00:00 2024-09-10T10:49:34.368 INFO:teuthology.orchestra.run.smithi181.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 952 kB/s | 87 kB 00:00 2024-09-10T10:49:34.389 INFO:teuthology.orchestra.run.smithi115.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-10T10:49:34.409 INFO:teuthology.orchestra.run.smithi181.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-10T10:49:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-10T10:49:34.440 INFO:teuthology.orchestra.run.smithi059.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 3.8 MB/s | 1.8 MB 00:00 2024-09-10T10:49:34.465 INFO:teuthology.orchestra.run.smithi115.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-10T10:49:34.490 INFO:teuthology.orchestra.run.smithi115.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-10T10:49:34.491 INFO:teuthology.orchestra.run.smithi059.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 818 kB/s | 41 kB 00:00 2024-09-10T10:49:34.492 INFO:teuthology.orchestra.run.smithi181.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-10T10:49:34.523 INFO:teuthology.orchestra.run.smithi115.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T10:49:34.549 INFO:teuthology.orchestra.run.smithi115.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-10T10:49:34.584 INFO:teuthology.orchestra.run.smithi181.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-10T10:49:34.626 INFO:teuthology.orchestra.run.smithi181.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-10T10:49:34.632 INFO:teuthology.orchestra.run.smithi115.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-10T10:49:34.641 INFO:teuthology.orchestra.run.smithi059.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 1.6 MB/s | 249 kB 00:00 2024-09-10T10:49:34.668 INFO:teuthology.orchestra.run.smithi181.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-10T10:49:34.716 INFO:teuthology.orchestra.run.smithi115.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-10T10:49:34.766 INFO:teuthology.orchestra.run.smithi181.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-10T10:49:34.766 INFO:teuthology.orchestra.run.smithi115.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T10:49:34.817 INFO:teuthology.orchestra.run.smithi115.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-10T10:49:34.833 INFO:teuthology.orchestra.run.smithi059.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 2.5 MB/s | 2.3 MB 00:00 2024-09-10T10:49:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-10T10:49:34.927 INFO:teuthology.orchestra.run.smithi181.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 216 kB/s | 35 kB 00:00 2024-09-10T10:49:34.984 INFO:teuthology.orchestra.run.smithi115.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-10T10:49:35.067 INFO:teuthology.orchestra.run.smithi115.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-10T10:49:35.118 INFO:teuthology.orchestra.run.smithi115.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T10:49:35.168 INFO:teuthology.orchestra.run.smithi115.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T10:49:35.318 INFO:teuthology.orchestra.run.smithi115.stdout:(91/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-10T10:49:35.369 INFO:teuthology.orchestra.run.smithi115.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-10T10:49:35.374 INFO:teuthology.orchestra.run.smithi059.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 1.4 MB 00:00 2024-09-10T10:49:35.419 INFO:teuthology.orchestra.run.smithi115.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-10T10:49:35.511 INFO:teuthology.orchestra.run.smithi115.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.2 MB/s | 5.1 MB 00:00 2024-09-10T10:49:35.557 INFO:teuthology.orchestra.run.smithi115.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-10T10:49:35.586 INFO:teuthology.orchestra.run.smithi115.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-09-10T10:49:35.605 INFO:teuthology.orchestra.run.smithi115.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 985 kB/s | 47 kB 00:00 2024-09-10T10:49:35.647 INFO:teuthology.orchestra.run.smithi115.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-10T10:49:35.669 INFO:teuthology.orchestra.run.smithi181.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.4 MB/s | 5.8 MB 00:01 2024-09-10T10:49:35.672 INFO:teuthology.orchestra.run.smithi115.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.5 MB/s | 304 kB 00:00 2024-09-10T10:49:35.706 INFO:teuthology.orchestra.run.smithi115.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T10:49:35.725 INFO:teuthology.orchestra.run.smithi059.stdout:(155/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:04 2024-09-10T10:49:35.731 INFO:teuthology.orchestra.run.smithi115.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T10:49:35.757 INFO:teuthology.orchestra.run.smithi115.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-10T10:49:35.775 INFO:teuthology.orchestra.run.smithi059.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 2.4 MB 00:00 2024-09-10T10:49:35.778 INFO:teuthology.orchestra.run.smithi181.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-10T10:49:35.781 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:49:35.781 INFO:teuthology.orchestra.run.smithi059.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-10T10:49:35.886 INFO:teuthology.orchestra.run.smithi181.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-10T10:49:35.970 INFO:teuthology.orchestra.run.smithi181.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 927 kB/s | 77 kB 00:00 2024-09-10T10:49:35.999 INFO:teuthology.orchestra.run.smithi115.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-10T10:49:36.012 INFO:teuthology.orchestra.run.smithi181.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-10T10:49:36.049 INFO:teuthology.orchestra.run.smithi115.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-10T10:49:36.074 INFO:teuthology.orchestra.run.smithi115.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-10T10:49:36.091 INFO:teuthology.orchestra.run.smithi115.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-10T10:49:36.129 INFO:teuthology.orchestra.run.smithi181.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-10T10:49:36.204 INFO:teuthology.orchestra.run.smithi181.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-10T10:49:36.225 INFO:teuthology.orchestra.run.smithi115.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-10T10:49:36.242 INFO:teuthology.orchestra.run.smithi115.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-10T10:49:36.259 INFO:teuthology.orchestra.run.smithi115.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-10T10:49:36.284 INFO:teuthology.orchestra.run.smithi115.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-10T10:49:36.309 INFO:teuthology.orchestra.run.smithi115.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-10T10:49:36.338 INFO:teuthology.orchestra.run.smithi181.stdout:(88/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.0 MB/s | 6.0 MB 00:01 2024-09-10T10:49:36.359 INFO:teuthology.orchestra.run.smithi115.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T10:49:36.363 INFO:teuthology.orchestra.run.smithi181.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 279 kB 00:00 2024-09-10T10:49:36.388 INFO:teuthology.orchestra.run.smithi181.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T10:49:36.393 INFO:teuthology.orchestra.run.smithi115.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-10T10:49:36.413 INFO:teuthology.orchestra.run.smithi181.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T10:49:36.427 INFO:teuthology.orchestra.run.smithi115.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-10T10:49:36.452 INFO:teuthology.orchestra.run.smithi115.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T10:49:36.455 INFO:teuthology.orchestra.run.smithi181.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-10T10:49:36.477 INFO:teuthology.orchestra.run.smithi115.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-10T10:49:36.489 INFO:teuthology.orchestra.run.smithi181.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-10T10:49:36.502 INFO:teuthology.orchestra.run.smithi115.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-10T10:49:36.536 INFO:teuthology.orchestra.run.smithi115.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-10T10:49:36.570 INFO:teuthology.orchestra.run.smithi115.stdout:(119/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-10T10:49:36.589 INFO:teuthology.orchestra.run.smithi181.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-09-10T10:49:36.603 INFO:teuthology.orchestra.run.smithi115.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T10:49:36.631 INFO:teuthology.orchestra.run.smithi181.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-10T10:49:36.645 INFO:teuthology.orchestra.run.smithi115.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-10T10:49:36.648 INFO:teuthology.orchestra.run.smithi181.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-10T10:49:36.665 INFO:teuthology.orchestra.run.smithi181.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-10T10:49:36.699 INFO:teuthology.orchestra.run.smithi181.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-09-10T10:49:36.704 INFO:teuthology.orchestra.run.smithi115.stdout:(122/156): python3-grpcio-1.46.7-10.el9.x86_64. 21 MB/s | 2.0 MB 00:00 2024-09-10T10:49:36.729 INFO:teuthology.orchestra.run.smithi115.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-09-10T10:49:36.754 INFO:teuthology.orchestra.run.smithi115.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-10T10:49:36.757 INFO:teuthology.orchestra.run.smithi181.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-10T10:49:36.780 INFO:teuthology.orchestra.run.smithi115.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-10T10:49:36.782 INFO:teuthology.orchestra.run.smithi181.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-10T10:49:36.805 INFO:teuthology.orchestra.run.smithi115.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-10T10:49:36.816 INFO:teuthology.orchestra.run.smithi181.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T10:49:36.830 INFO:teuthology.orchestra.run.smithi115.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-10T10:49:36.833 INFO:teuthology.orchestra.run.smithi181.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-10T10:49:36.850 INFO:teuthology.orchestra.run.smithi181.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 667 kB/s | 22 kB 00:00 2024-09-10T10:49:36.856 INFO:teuthology.orchestra.run.smithi115.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-10T10:49:36.890 INFO:teuthology.orchestra.run.smithi115.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.3 MB/s | 46 kB 00:00 2024-09-10T10:49:36.900 INFO:teuthology.orchestra.run.smithi181.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-10T10:49:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T10:49:36.934 INFO:teuthology.orchestra.run.smithi181.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T10:49:36.940 INFO:teuthology.orchestra.run.smithi115.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T10:49:36.951 INFO:teuthology.orchestra.run.smithi181.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-10T10:49:36.974 INFO:teuthology.orchestra.run.smithi115.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-10T10:49:37.007 INFO:teuthology.orchestra.run.smithi115.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-10T10:49:37.033 INFO:teuthology.orchestra.run.smithi115.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-10T10:49:37.048 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-10T10:49:37.058 INFO:teuthology.orchestra.run.smithi115.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T10:49:37.083 INFO:teuthology.orchestra.run.smithi115.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-10T10:49:37.084 INFO:teuthology.orchestra.run.smithi181.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-10T10:49:37.108 INFO:teuthology.orchestra.run.smithi115.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-10T10:49:37.110 INFO:teuthology.orchestra.run.smithi181.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T10:49:37.134 INFO:teuthology.orchestra.run.smithi115.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T10:49:37.153 INFO:teuthology.orchestra.run.smithi181.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-10T10:49:37.159 INFO:teuthology.orchestra.run.smithi115.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T10:49:37.178 INFO:teuthology.orchestra.run.smithi181.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T10:49:37.184 INFO:teuthology.orchestra.run.smithi115.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-10T10:49:37.210 INFO:teuthology.orchestra.run.smithi115.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T10:49:37.212 INFO:teuthology.orchestra.run.smithi181.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-10T10:49:37.217 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-10T10:49:37.218 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-10T10:49:37.235 INFO:teuthology.orchestra.run.smithi115.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T10:49:37.246 INFO:teuthology.orchestra.run.smithi181.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-10T10:49:37.260 INFO:teuthology.orchestra.run.smithi115.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T10:49:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-10T10:49:37.279 INFO:teuthology.orchestra.run.smithi181.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 17 MB/s | 548 kB 00:00 2024-09-10T10:49:37.296 INFO:teuthology.orchestra.run.smithi181.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-10T10:49:37.302 INFO:teuthology.orchestra.run.smithi115.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-10T10:49:37.313 INFO:teuthology.orchestra.run.smithi181.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T10:49:37.328 INFO:teuthology.orchestra.run.smithi115.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-09-10T10:49:37.338 INFO:teuthology.orchestra.run.smithi181.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 571 kB/s | 14 kB 00:00 2024-09-10T10:49:37.363 INFO:teuthology.orchestra.run.smithi181.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-10T10:49:37.378 INFO:teuthology.orchestra.run.smithi115.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T10:49:37.389 INFO:teuthology.orchestra.run.smithi181.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T10:49:37.423 INFO:teuthology.orchestra.run.smithi181.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T10:49:37.448 INFO:teuthology.orchestra.run.smithi181.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-10T10:49:37.481 INFO:teuthology.orchestra.run.smithi181.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T10:49:37.515 INFO:teuthology.orchestra.run.smithi181.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T10:49:37.540 INFO:teuthology.orchestra.run.smithi181.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-10T10:49:37.565 INFO:teuthology.orchestra.run.smithi181.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-10T10:49:37.587 INFO:teuthology.orchestra.run.smithi115.stdout:(148/156): librados2-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-10T10:49:37.591 INFO:teuthology.orchestra.run.smithi181.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-10T10:49:37.616 INFO:teuthology.orchestra.run.smithi181.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-10T10:49:37.642 INFO:teuthology.orchestra.run.smithi181.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-10T10:49:37.683 INFO:teuthology.orchestra.run.smithi181.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-10T10:49:37.709 INFO:teuthology.orchestra.run.smithi181.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T10:49:37.734 INFO:teuthology.orchestra.run.smithi181.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T10:49:37.759 INFO:teuthology.orchestra.run.smithi181.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T10:49:37.793 INFO:teuthology.orchestra.run.smithi181.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-10T10:49:37.795 INFO:teuthology.orchestra.run.smithi115.stdout:(149/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-09-10T10:49:37.818 INFO:teuthology.orchestra.run.smithi181.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-10T10:49:37.843 INFO:teuthology.orchestra.run.smithi181.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T10:49:37.845 INFO:teuthology.orchestra.run.smithi115.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 6.8 MB/s | 3.2 MB 00:00 2024-09-10T10:49:37.869 INFO:teuthology.orchestra.run.smithi181.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-10T10:49:37.894 INFO:teuthology.orchestra.run.smithi181.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-10T10:49:37.919 INFO:teuthology.orchestra.run.smithi181.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-10T10:49:37.945 INFO:teuthology.orchestra.run.smithi181.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T10:49:37.970 INFO:teuthology.orchestra.run.smithi181.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T10:49:37.995 INFO:teuthology.orchestra.run.smithi181.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-10T10:49:38.021 INFO:teuthology.orchestra.run.smithi181.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T10:49:38.046 INFO:teuthology.orchestra.run.smithi181.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T10:49:38.071 INFO:teuthology.orchestra.run.smithi181.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T10:49:38.097 INFO:teuthology.orchestra.run.smithi181.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-09-10T10:49:38.130 INFO:teuthology.orchestra.run.smithi181.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-10T10:49:38.155 INFO:teuthology.orchestra.run.smithi181.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T10:49:38.206 INFO:teuthology.orchestra.run.smithi181.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T10:49:38.421 INFO:teuthology.orchestra.run.smithi115.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 71 kB/s | 41 kB 00:00 2024-09-10T10:49:38.431 INFO:teuthology.orchestra.run.smithi181.stdout:(148/156): librados2-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-10T10:49:38.498 INFO:teuthology.orchestra.run.smithi181.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-10T10:49:38.738 INFO:teuthology.orchestra.run.smithi115.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 2.0 MB/s | 2.3 MB 00:01 2024-09-10T10:49:38.863 INFO:teuthology.orchestra.run.smithi115.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-10T10:49:38.915 INFO:teuthology.orchestra.run.smithi181.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 4.3 MB/s | 1.8 MB 00:00 2024-09-10T10:49:38.949 INFO:teuthology.orchestra.run.smithi181.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-09-10T10:49:39.057 INFO:teuthology.orchestra.run.smithi181.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 3.7 MB/s | 2.3 MB 00:00 2024-09-10T10:49:39.082 INFO:teuthology.orchestra.run.smithi181.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.8 MB/s | 249 kB 00:00 2024-09-10T10:49:39.205 INFO:teuthology.orchestra.run.smithi115.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 317 kB/s | 249 kB 00:00 2024-09-10T10:49:39.449 INFO:teuthology.orchestra.run.smithi181.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-10T10:49:39.583 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-10T10:49:39.584 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-10T10:49:39.616 INFO:teuthology.orchestra.run.smithi181.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 2.4 MB 00:00 2024-09-10T10:49:39.671 INFO:teuthology.orchestra.run.smithi115.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.5 MB/s | 1.4 MB 00:00 2024-09-10T10:49:39.963 INFO:teuthology.orchestra.run.smithi115.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-10T10:49:39.970 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:49:39.970 INFO:teuthology.orchestra.run.smithi115.stdout:Total 15 MB/s | 226 MB 00:15 2024-09-10T10:49:41.218 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-10T10:49:41.369 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-10T10:49:41.369 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-10T10:49:41.491 INFO:teuthology.orchestra.run.smithi181.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-09-10T10:49:41.497 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:49:41.497 INFO:teuthology.orchestra.run.smithi181.stdout:Total 15 MB/s | 226 MB 00:15 2024-09-10T10:49:42.735 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-10T10:49:42.886 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-10T10:49:42.886 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-10T10:49:43.159 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-10T10:49:43.160 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-10T10:49:44.804 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-10T10:49:44.804 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-10T10:49:45.951 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-10T10:49:46.096 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T10:49:46.145 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T10:49:46.198 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T10:49:46.247 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T10:49:46.280 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T10:49:46.338 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T10:49:46.778 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T10:49:46.848 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:49:46.965 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:49:46.990 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:49:47.083 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:49:47.119 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:49:47.306 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T10:49:47.374 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T10:49:47.410 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:49:47.506 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:49:47.536 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:49:47.596 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:49:47.628 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:49:47.655 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:49:47.858 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:49:48.031 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:49:48.177 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T10:49:48.289 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:49:48.370 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:49:48.617 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:49:48.745 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T10:49:48.840 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T10:49:48.892 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T10:49:48.926 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T10:49:49.010 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T10:49:49.061 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T10:49:49.103 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T10:49:49.162 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T10:49:49.194 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T10:49:49.221 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T10:49:49.293 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T10:49:49.353 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T10:49:49.392 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T10:49:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-10T10:49:49.444 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T10:49:49.500 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T10:49:49.523 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T10:49:49.546 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T10:49:49.554 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T10:49:49.597 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T10:49:49.626 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T10:49:49.700 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T10:49:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T10:49:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T10:49:49.749 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T10:49:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T10:49:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T10:49:49.827 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T10:49:49.980 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T10:49:50.035 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T10:49:50.131 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T10:49:50.243 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:49:50.365 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:49:50.386 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:49:50.478 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:49:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:49:50.590 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T10:49:50.655 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T10:49:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T10:49:50.704 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T10:49:50.726 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T10:49:50.732 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:49:50.769 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T10:49:50.807 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T10:49:50.827 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:49:50.849 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T10:49:50.850 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:49:50.913 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:49:50.934 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:49:50.959 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:49:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T10:49:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T10:49:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T10:49:51.151 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:49:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T10:49:51.278 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:49:51.281 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-10T10:49:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T10:49:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T10:49:51.353 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T10:49:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T10:49:51.391 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T10:49:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T10:49:51.450 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T10:49:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T10:49:51.490 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:49:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T10:49:51.537 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T10:49:51.559 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:49:51.571 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T10:49:51.596 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T10:49:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T10:49:51.648 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T10:49:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T10:49:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T10:49:51.780 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:49:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T10:49:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T10:49:51.878 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T10:49:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T10:49:51.975 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T10:49:51.986 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T10:49:52.013 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T10:49:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T10:49:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:49:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T10:49:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T10:49:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T10:49:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T10:49:52.201 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:49:52.206 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T10:49:52.231 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:49:52.250 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T10:49:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T10:49:52.282 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T10:49:52.310 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T10:49:52.322 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:49:52.352 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:49:52.379 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T10:49:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T10:49:52.433 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T10:49:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T10:49:52.463 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T10:49:52.498 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T10:49:52.500 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T10:49:52.501 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T10:49:52.538 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T10:49:52.549 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T10:49:52.573 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T10:49:52.574 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T10:49:52.585 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:49:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T10:49:52.621 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T10:49:52.651 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T10:49:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T10:49:52.673 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:49:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T10:49:52.686 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T10:49:52.703 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:49:52.719 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T10:49:52.751 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T10:49:52.757 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:49:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T10:49:52.779 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:49:52.804 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T10:49:52.806 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:49:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T10:49:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T10:49:52.927 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T10:49:52.985 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T10:49:53.005 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:49:53.011 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T10:49:53.023 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T10:49:53.065 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T10:49:53.126 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T10:49:53.134 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:49:53.187 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T10:49:53.252 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T10:49:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:49:53.429 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:49:53.591 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T10:49:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:49:53.669 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T10:49:53.699 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T10:49:53.741 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T10:49:53.755 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T10:49:53.779 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T10:49:53.821 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T10:49:53.855 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T10:49:53.892 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T10:49:53.927 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T10:49:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T10:49:53.967 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T10:49:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T10:49:54.008 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T10:49:54.028 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T10:49:54.041 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T10:49:54.061 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T10:49:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T10:49:54.093 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T10:49:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T10:49:54.146 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T10:49:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T10:49:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T10:49:54.187 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T10:49:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T10:49:54.205 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T10:49:54.215 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T10:49:54.250 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T10:49:54.262 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T10:49:54.266 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T10:49:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T10:49:54.319 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T10:49:54.340 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T10:49:54.350 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T10:49:54.356 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T10:49:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T10:49:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T10:49:54.402 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T10:49:54.460 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T10:49:54.496 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T10:49:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T10:49:54.539 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T10:49:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T10:49:54.569 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T10:49:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T10:49:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T10:49:54.632 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T10:49:54.639 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T10:49:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T10:49:54.703 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T10:49:54.713 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T10:49:54.743 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T10:49:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T10:49:54.783 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T10:49:54.809 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T10:49:54.833 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T10:49:54.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T10:49:54.907 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T10:49:54.969 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T10:49:55.179 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T10:49:55.216 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T10:49:55.244 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T10:49:55.280 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T10:49:55.319 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T10:49:55.351 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T10:49:55.381 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T10:49:55.401 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T10:49:55.432 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T10:49:55.465 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T10:49:55.489 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T10:49:55.506 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T10:49:55.526 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T10:49:55.541 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T10:49:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T10:49:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T10:49:55.627 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T10:49:55.644 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T10:49:55.671 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T10:49:55.682 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T10:49:55.702 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T10:49:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T10:49:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T10:49:55.862 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T10:49:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T10:49:55.953 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T10:49:56.006 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T10:49:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T10:49:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T10:49:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T10:49:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T10:49:56.225 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T10:49:56.268 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T10:49:56.310 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T10:49:56.444 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T10:49:56.487 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T10:49:56.529 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T10:49:56.579 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T10:49:56.629 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T10:49:56.671 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T10:49:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T10:49:56.745 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T10:49:56.776 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T10:49:56.810 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T10:49:56.856 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T10:49:56.908 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T10:49:56.937 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T10:49:56.942 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T10:49:56.970 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T10:49:56.972 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T10:49:57.003 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T10:49:57.026 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T10:49:57.067 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T10:49:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T10:49:57.154 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T10:49:57.198 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T10:49:57.235 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T10:49:57.263 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T10:49:57.297 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T10:49:57.336 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T10:49:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T10:49:57.338 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T10:49:57.368 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T10:49:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T10:49:57.383 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:49:57.398 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T10:49:57.432 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T10:49:57.453 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T10:49:57.467 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T10:49:57.474 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:49:57.505 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T10:49:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T10:49:57.542 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T10:49:57.551 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T10:49:57.638 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T10:49:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T10:49:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T10:49:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T10:49:57.872 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T10:49:58.057 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T10:49:58.086 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:49:58.088 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T10:49:58.140 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:49:58.171 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T10:49:58.199 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T10:49:58.589 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T10:49:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T10:49:58.670 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T10:49:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T10:49:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T10:49:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T10:49:58.965 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T10:49:58.997 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T10:49:59.180 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T10:49:59.220 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T10:49:59.298 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T10:49:59.409 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T10:49:59.497 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T10:49:59.525 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T10:49:59.558 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T10:49:59.868 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T10:49:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:49:59.928 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T10:50:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:50:00.034 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T10:50:00.042 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T10:50:00.070 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T10:50:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:50:00.560 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T10:50:00.592 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:50:00.599 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:50:00.671 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:50:00.701 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T10:50:01.170 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:50:01.212 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:50:01.250 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T10:50:01.305 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:50:01.305 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T10:50:01.305 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T10:50:01.305 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T10:50:01.346 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:50:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T10:50:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T10:50:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T10:50:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:50:01.858 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:50:01.896 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T10:50:01.932 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T10:50:02.413 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T10:50:02.453 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:50:02.516 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:50:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T10:50:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:50:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:50:03.546 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:50:03.586 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:50:03.680 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:50:03.680 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T10:50:03.681 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T10:50:03.681 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:50:04.798 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:50:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:50:05.377 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:50:05.421 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:50:05.541 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:50:05.541 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T10:50:05.541 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T10:50:05.541 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:05.564 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:50:13.695 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:50:13.695 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2024-09-10T10:50:13.695 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2024-09-10T10:50:13.695 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2024-09-10T10:50:13.695 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2024-09-10T10:50:13.695 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2024-09-10T10:50:13.695 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2024-09-10T10:50:13.696 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2024-09-10T10:50:13.696 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:13.874 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:50:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:50:13.892 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:13.892 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T10:50:13.892 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:50:15.426 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-09-10T10:50:15.426 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-09-10T10:50:15.426 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-09-10T10:50:15.427 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-09-10T10:50:15.427 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-09-10T10:50:15.427 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /root 2024-09-10T10:50:15.427 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-09-10T10:50:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:15.427 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:50:15.456 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:50:15.456 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:15.456 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T10:50:15.456 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:50:15.456 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:50:15.456 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:15.597 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:50:15.613 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:50:15.613 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:15.613 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T10:50:15.613 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:15.694 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:50:15.720 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:50:15.720 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:15.720 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T10:50:15.720 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:50:15.720 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:50:15.720 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:16.178 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:50:16.204 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:50:16.204 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:16.204 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T10:50:16.204 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:50:16.205 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:50:16.205 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:16.309 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T10:50:16.366 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T10:50:16.431 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T10:50:16.625 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T10:50:16.680 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T10:50:16.761 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T10:50:16.858 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T10:50:17.029 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T10:50:17.080 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T10:50:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:50:17.103 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T10:50:17.111 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:17.130 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T10:50:17.335 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-09-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-09-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-09-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-09-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-09-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-09-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-09-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:50:17.536 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:50:17.542 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:50:17.542 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:17.542 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T10:50:17.542 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:17.562 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:50:17.594 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T10:50:17.659 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T10:50:17.685 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:50:17.811 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:50:17.835 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:50:17.835 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:17.835 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T10:50:17.835 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:50:17.835 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:50:17.835 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:17.941 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T10:50:17.998 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T10:50:18.053 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T10:50:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T10:50:18.295 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T10:50:18.382 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T10:50:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T10:50:18.609 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T10:50:18.670 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T10:50:18.702 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T10:50:18.730 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T10:50:18.787 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:50:18.820 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:50:19.020 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:50:19.047 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:50:19.047 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:19.048 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T10:50:19.048 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:50:19.048 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:50:19.048 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:19.084 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:50:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:50:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T10:50:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T10:50:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:50:19.271 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:50:19.294 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:50:19.295 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:19.730 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:50:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:50:19.753 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:19.754 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T10:50:19.754 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:50:19.754 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:50:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:19.836 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:50:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T10:50:19.862 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:50:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T10:50:19.971 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:50:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T10:50:20.140 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T10:50:20.154 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T10:50:20.164 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:50:20.189 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:50:20.189 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:20.190 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T10:50:20.190 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:50:20.190 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:50:20.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:20.205 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T10:50:20.240 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:50:20.252 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:50:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T10:50:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:50:20.328 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:50:20.353 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T10:50:20.362 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T10:50:20.410 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T10:50:20.502 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T10:50:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T10:50:20.588 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T10:50:20.615 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T10:50:21.061 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:50:21.089 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:50:21.129 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T10:50:21.191 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T10:50:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:50:21.287 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:50:21.320 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:50:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T10:50:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:50:21.423 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:50:21.434 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:50:21.434 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:21.434 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T10:50:21.434 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:50:21.434 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:50:21.435 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:21.476 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:50:21.500 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:50:21.500 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:21.501 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T10:50:21.501 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:50:21.576 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:50:21.577 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:21.577 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T10:50:21.577 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:50:21.577 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:50:21.577 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:21.590 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T10:50:21.622 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:50:21.646 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:50:21.647 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:21.647 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T10:50:21.647 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:50:21.647 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:50:21.647 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:21.698 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:50:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:50:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T10:50:21.862 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T10:50:21.894 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:50:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:50:21.919 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:21.919 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T10:50:21.919 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:50:21.919 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:50:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:22.266 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:50:22.314 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:50:22.787 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T10:50:22.817 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:50:22.841 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:50:22.841 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:22.841 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T10:50:22.841 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:50:22.841 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:50:22.841 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:22.884 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:50:22.908 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:50:22.908 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:22.908 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T10:50:22.908 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:50:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:50:22.983 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:22.983 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T10:50:22.983 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:50:22.984 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:50:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:23.275 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:50:23.285 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:50:23.309 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:50:23.309 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:23.309 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T10:50:23.310 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:50:23.310 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:50:23.310 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:23.314 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:50:23.416 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:50:23.586 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T10:50:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:50:23.641 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:50:23.641 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:23.641 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T10:50:23.641 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:50:23.641 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:50:23.641 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:23.692 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:50:23.704 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:50:23.801 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T10:50:23.848 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T10:50:24.781 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T10:50:24.811 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:50:24.835 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:50:24.835 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:24.835 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T10:50:24.835 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:50:24.836 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:50:24.836 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:24.878 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:50:24.902 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:50:24.902 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:24.902 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T10:50:24.903 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:24.954 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:50:24.978 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:50:24.978 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:24.978 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T10:50:24.978 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:50:24.978 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:50:24.978 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:25.280 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:50:25.303 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:50:25.303 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:50:25.304 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T10:50:25.304 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:50:25.304 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:50:25.304 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:26.898 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T10:50:26.940 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T10:50:26.981 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T10:50:27.012 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T10:50:27.039 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T10:50:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T10:50:27.411 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T10:50:27.440 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T10:50:27.470 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T10:50:27.525 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T10:50:27.856 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T10:50:27.897 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T10:50:27.938 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T10:50:27.970 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T10:50:27.997 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T10:50:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T10:50:28.180 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:50:28.219 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T10:50:28.222 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:50:28.241 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T10:50:28.244 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:50:28.271 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T10:50:28.309 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T10:50:28.929 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:50:28.973 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:50:28.994 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:50:29.148 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T10:50:29.235 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T10:50:29.282 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T10:50:29.371 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T10:50:29.404 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T10:50:29.430 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T10:50:29.456 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T10:50:29.456 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:50:29.548 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:50:29.548 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:50:29.642 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:50:29.657 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T10:50:29.663 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:50:29.663 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:50:29.833 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T10:50:29.834 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T10:50:29.851 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:50:29.851 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:50:29.875 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T10:50:29.915 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T10:50:29.920 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T10:50:29.935 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:50:29.948 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T10:50:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T10:50:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T10:50:30.012 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:50:30.043 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T10:50:30.073 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T10:50:30.098 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T10:50:30.125 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T10:50:30.125 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:50:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T10:50:30.189 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T10:50:30.219 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T10:50:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:50:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:50:30.248 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T10:50:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T10:50:30.318 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:50:30.343 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T10:50:30.348 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:50:30.348 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:50:30.519 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:50:30.519 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:50:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:50:30.675 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:50:30.920 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:50:30.959 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:50:30.980 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:50:31.805 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T10:50:31.889 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T10:50:31.929 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T10:50:32.009 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T10:50:32.058 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T10:50:32.084 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T10:50:32.109 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T10:50:32.110 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:50:32.194 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:50:32.194 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:50:32.270 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:50:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T10:50:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:50:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:50:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:50:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:50:32.564 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:50:32.628 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:50:35.838 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T10:50:35.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T10:50:35.840 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T10:50:35.841 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T10:50:35.842 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T10:50:35.843 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T10:50:35.844 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T10:50:35.845 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T10:50:35.846 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T10:50:35.847 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T10:50:35.848 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T10:50:35.849 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T10:50:35.850 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T10:50:35.851 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T10:50:35.851 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T10:50:35.851 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T10:50:35.851 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T10:50:36.369 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:50:36.369 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T10:50:36.369 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T10:50:36.369 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T10:50:36.370 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T10:50:36.371 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T10:50:36.372 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T10:50:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T10:50:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T10:50:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T10:50:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T10:50:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T10:50:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T10:50:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T10:50:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T10:50:36.384 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T10:50:36.385 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T10:50:36.386 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T10:50:36.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T10:50:36.388 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T10:50:36.389 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T10:50:36.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T10:50:36.391 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T10:50:36.392 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T10:50:36.393 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T10:50:36.394 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T10:50:36.394 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T10:50:36.394 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T10:50:36.394 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T10:50:36.394 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T10:50:36.394 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T10:50:36.394 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T10:50:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:50:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:38.412 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-09-10T10:50:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T10:50:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T10:50:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T10:50:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T10:50:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T10:50:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T10:50:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T10:50:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T10:50:38.423 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T10:50:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T10:50:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T10:50:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:50:38.425 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-10T10:50:38.465 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:50:38.465 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T10:50:38.465 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T10:50:38.465 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T10:50:38.466 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T10:50:38.467 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T10:50:38.468 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T10:50:38.479 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T10:50:38.479 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T10:50:38.479 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T10:50:38.480 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T10:50:38.481 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T10:50:38.482 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T10:50:38.483 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T10:50:38.484 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T10:50:38.485 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T10:50:38.486 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T10:50:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T10:50:38.488 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T10:50:38.489 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T10:50:38.929 DEBUG:teuthology.parallel:result is None 2024-09-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.256 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T10:50:39.257 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T10:50:39.258 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T10:50:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T10:50:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T10:50:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T10:50:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T10:50:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T10:50:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T10:50:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:50:39.265 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-10T10:50:39.666 DEBUG:teuthology.parallel:result is None 2024-09-10T10:50:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:50:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:40.794 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-09-10T10:50:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T10:50:40.795 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.796 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T10:50:40.797 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T10:50:40.798 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T10:50:40.799 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T10:50:40.800 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T10:50:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T10:50:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T10:50:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T10:50:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:50:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T10:50:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T10:50:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T10:50:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T10:50:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T10:50:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T10:50:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T10:50:40.806 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:50:40.806 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-10T10:50:41.218 DEBUG:teuthology.parallel:result is None 2024-09-10T10:50:41.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:50:41.369 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T10:50:41.397 INFO:teuthology.orchestra.run.smithi059.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T10:50:41.400 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T10:50:41.400 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T10:50:41.402 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:50:41.546 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T10:50:41.572 INFO:teuthology.orchestra.run.smithi115.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T10:50:41.572 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T10:50:41.572 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T10:50:41.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:50:41.714 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T10:50:41.738 INFO:teuthology.orchestra.run.smithi181.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T10:50:41.738 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T10:50:41.738 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T10:50:41.740 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T10:50:41.740 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:50:41.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T10:50:41.775 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:50:41.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T10:50:41.807 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:50:41.808 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T10:50:41.836 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T10:50:41.837 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:50:41.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T10:50:41.867 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T10:50:41.937 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:50:41.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T10:50:41.967 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T10:50:42.034 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:50:42.034 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T10:50:42.061 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T10:50:42.126 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T10:50:42.127 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:50:42.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T10:50:42.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T10:50:42.226 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:50:42.226 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T10:50:42.254 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T10:50:42.322 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:50:42.322 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T10:50:42.347 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T10:50:42.413 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T10:50:42.413 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:50:42.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T10:50:42.444 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T10:50:42.515 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:50:42.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T10:50:42.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T10:50:42.612 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:50:42.612 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T10:50:42.637 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T10:50:42.703 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T10:50:42.791 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'subvols': {'create': 2}} 2024-09-10T10:50:42.792 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:50:42.792 INFO:tasks.cephadm:Cluster fsid is 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:50:42.792 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T10:50:42.793 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.59', 'mon.b': '172.21.15.115', 'mon.c': '172.21.15.181'} 2024-09-10T10:50:42.793 INFO:tasks.cephadm:First mon is mon.a on smithi059 2024-09-10T10:50:42.793 INFO:tasks.cephadm:First mgr is x 2024-09-10T10:50:42.793 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T10:50:42.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname $(hostname -s) 2024-09-10T10:50:42.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname $(hostname -s) 2024-09-10T10:50:42.853 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname $(hostname -s) 2024-09-10T10:50:42.878 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T10:50:42.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:50:43.038 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82914/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:14:38.445020', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82912/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:05:03.996701', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-10T10:50:43.179 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240909.165402-squid, sha1 1cf819b7212a6048e92fc78c4eff963344f6d56b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:50:43.180 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T10:50:43.181 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T10:50:43.181 DEBUG:teuthology.orchestra.run.smithi059:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T10:50:43.602 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 10:50 /home/ubuntu/cephtest/cephadm 2024-09-10T10:50:43.602 DEBUG:teuthology.orchestra.run.smithi115:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T10:50:43.976 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 10:50 /home/ubuntu/cephtest/cephadm 2024-09-10T10:50:43.976 DEBUG:teuthology.orchestra.run.smithi181:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T10:50:44.344 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 10:50 /home/ubuntu/cephtest/cephadm 2024-09-10T10:50:44.344 DEBUG:teuthology.orchestra.run.smithi059:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T10:50:44.364 DEBUG:teuthology.orchestra.run.smithi115:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T10:50:44.384 DEBUG:teuthology.orchestra.run.smithi181:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T10:50:44.418 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b on all hosts... 2024-09-10T10:50:44.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T10:50:44.421 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T10:50:44.427 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T10:50:46.086 INFO:teuthology.orchestra.run.smithi181.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:50:46.101 INFO:teuthology.orchestra.run.smithi115.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:50:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:51:13.415 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T10:51:13.415 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T10:51:13.416 INFO:teuthology.orchestra.run.smithi059.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T10:51:13.416 INFO:teuthology.orchestra.run.smithi059.stdout: "repo_digests": [ 2024-09-10T10:51:13.416 INFO:teuthology.orchestra.run.smithi059.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T10:51:13.416 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T10:51:13.416 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T10:51:38.155 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-10T10:51:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T10:51:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T10:51:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "repo_digests": [ 2024-09-10T10:51:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T10:51:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-09-10T10:51:38.156 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-10T10:51:39.292 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-10T10:51:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T10:51:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T10:51:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "repo_digests": [ 2024-09-10T10:51:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T10:51:39.292 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-10T10:51:39.292 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-10T10:51:39.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph 2024-09-10T10:51:39.353 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph 2024-09-10T10:51:39.387 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph 2024-09-10T10:51:39.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /etc/ceph 2024-09-10T10:51:39.444 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /etc/ceph 2024-09-10T10:51:39.473 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /etc/ceph 2024-09-10T10:51:39.498 INFO:tasks.cephadm:Writing seed config... 2024-09-10T10:51:39.499 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-10T10:51:39.499 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-10T10:51:39.499 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-10T10:51:39.499 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-10T10:51:39.499 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-10T10:51:39.499 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T10:51:39.499 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-10T10:51:39.499 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-10T10:51:39.499 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-10T10:51:39.500 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T10:51:39.501 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T10:51:39.502 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T10:51:39.503 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-10T10:51:39.503 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T10:51:39.503 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T10:51:39.503 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:51:39.503 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T10:51:39.521 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 86a09b02-6f62-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-10T10:51:39.522 DEBUG:teuthology.orchestra.run.smithi059:mon.a> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T10:51:39.564 DEBUG:teuthology.orchestra.run.smithi059:mgr.x> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T10:51:39.606 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T10:51:39.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b -v bootstrap --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.59 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:51:39.822 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:51:39.822 INFO:teuthology.orchestra.run.smithi059.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b', '-v', 'bootstrap', '--fsid', '86a09b02-6f62-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.59', '--skip-admin-label'] 2024-09-10T10:51:39.822 INFO:teuthology.orchestra.run.smithi059.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T10:51:39.822 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying podman|docker is present... 2024-09-10T10:51:39.847 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 5.2.2 2024-09-10T10:51:39.847 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying lvm2 is present... 2024-09-10T10:51:39.848 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying time synchronization is in place... 2024-09-10T10:51:39.856 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T10:51:39.856 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T10:51:39.863 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T10:51:39.863 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T10:51:39.870 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout enabled 2024-09-10T10:51:39.878 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout active 2024-09-10T10:51:39.878 INFO:teuthology.orchestra.run.smithi059.stdout:Unit chronyd.service is enabled and running 2024-09-10T10:51:39.878 INFO:teuthology.orchestra.run.smithi059.stdout:Repeating the final host check... 2024-09-10T10:51:39.901 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 5.2.2 2024-09-10T10:51:39.902 INFO:teuthology.orchestra.run.smithi059.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T10:51:39.902 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl is present 2024-09-10T10:51:39.902 INFO:teuthology.orchestra.run.smithi059.stdout:lvcreate is present 2024-09-10T10:51:39.909 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T10:51:39.909 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T10:51:39.916 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T10:51:39.916 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T10:51:39.924 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout enabled 2024-09-10T10:51:39.931 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout active 2024-09-10T10:51:39.931 INFO:teuthology.orchestra.run.smithi059.stdout:Unit chronyd.service is enabled and running 2024-09-10T10:51:39.931 INFO:teuthology.orchestra.run.smithi059.stdout:Host looks OK 2024-09-10T10:51:39.931 INFO:teuthology.orchestra.run.smithi059.stdout:Cluster fsid: 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:51:39.931 INFO:teuthology.orchestra.run.smithi059.stdout:Acquiring lock 139782659986432 on /run/cephadm/86a09b02-6f62-11ef-bcea-c7b262605968.lock 2024-09-10T10:51:39.931 INFO:teuthology.orchestra.run.smithi059.stdout:Lock 139782659986432 acquired on /run/cephadm/86a09b02-6f62-11ef-bcea-c7b262605968.lock 2024-09-10T10:51:39.932 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying IP 172.21.15.59 port 3300 ... 2024-09-10T10:51:39.932 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying IP 172.21.15.59 port 6789 ... 2024-09-10T10:51:39.932 INFO:teuthology.orchestra.run.smithi059.stdout:Base mon IP(s) is [172.21.15.59:3300, 172.21.15.59:6789], mon addrv is [v2:172.21.15.59:3300,v1:172.21.15.59:6789] 2024-09-10T10:51:39.936 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.59 metric 100 2024-09-10T10:51:39.936 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.59 metric 100 2024-09-10T10:51:39.939 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T10:51:39.939 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T10:51:39.939 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1774sec hoplimit 64 pref medium 2024-09-10T10:51:39.941 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T10:51:39.941 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T10:51:39.941 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T10:51:39.941 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T10:51:39.942 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-09-10T10:51:39.942 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T10:51:39.942 INFO:teuthology.orchestra.run.smithi059.stdout:Mon IP `172.21.15.59` is in CIDR network `172.21.0.0/20` 2024-09-10T10:51:39.942 INFO:teuthology.orchestra.run.smithi059.stdout:Mon IP `172.21.15.59` is in CIDR network `172.21.0.0/20` 2024-09-10T10:51:39.942 INFO:teuthology.orchestra.run.smithi059.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T10:51:39.943 INFO:teuthology.orchestra.run.smithi059.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T10:51:39.944 INFO:teuthology.orchestra.run.smithi059.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:51:40.779 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T10:51:40.779 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:51:40.779 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T10:51:40.779 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Copying blob sha256:3965ca83761b6e221cd35b61f2ebac0e3b1f9d68a1ce39c1ada69153a1d73116 2024-09-10T10:51:40.779 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T10:51:40.779 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Copying config sha256:41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T10:51:40.779 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T10:51:46.128 INFO:teuthology.orchestra.run.smithi059.stdout:ceph: stdout ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T10:51:46.128 INFO:teuthology.orchestra.run.smithi059.stdout:Ceph version: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T10:51:46.128 INFO:teuthology.orchestra.run.smithi059.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T10:51:47.075 INFO:teuthology.orchestra.run.smithi059.stdout:stat: stdout 167 167 2024-09-10T10:51:47.075 INFO:teuthology.orchestra.run.smithi059.stdout:Creating initial keys... 2024-09-10T10:51:48.005 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-authtool: stdout AQDDJOBmdfVeGhAA5Wh6cObhO3zPg2j3Y17n3Q== 2024-09-10T10:51:48.919 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-authtool: stdout AQDEJOBmUQS/FBAABrYPWzkM4MMaxUs7sbps4g== 2024-09-10T10:51:49.924 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-authtool: stdout AQDFJOBmhy2XDRAAEi1iw8WNQxu9pYrWIPpQLA== 2024-09-10T10:51:49.925 INFO:teuthology.orchestra.run.smithi059.stdout:Creating initial monmap... 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool for a [v2:172.21.15.59:3300,v1:172.21.15.59:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = quincy 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: set fsid to 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:51:50.856 INFO:teuthology.orchestra.run.smithi059.stdout:Creating mon... 2024-09-10T10:51:52.237 INFO:teuthology.orchestra.run.smithi059.stdout:create mon.a on 2024-09-10T10:51:52.464 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T10:51:52.616 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T10:51:52.798 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-86a09b02-6f62-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-86a09b02-6f62-11ef-bcea-c7b262605968.target. 2024-09-10T10:51:52.798 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-86a09b02-6f62-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-86a09b02-6f62-11ef-bcea-c7b262605968.target. 2024-09-10T10:51:53.067 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.a 2024-09-10T10:51:53.067 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to reset failed state of unit ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T10:51:53.254 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-86a09b02-6f62-11ef-bcea-c7b262605968.target.wants/ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-86a09b02-6f62-11ef-bcea-c7b262605968@.service. 2024-09-10T10:51:53.789 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:51:53.789 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2024-09-10T10:51:53.798 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:51:53.798 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T10:51:53.798 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2024-09-10T10:51:53.798 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T10:51:53.799 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mon to start... 2024-09-10T10:51:53.799 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mon... 2024-09-10T10:51:53.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:53 smithi059 systemd[1]: Started Ceph mon.a for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:51:54.879 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T10:51:54.879 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: monmap epoch 1 2024-09-10T10:51:54.879 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:51:54.879 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: last_changed 2024-09-10T10:51:50.263729+0000 2024-09-10T10:51:54.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:51:54.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: min_mon_release 19 (squid) 2024-09-10T10:51:54.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: election_strategy: 1 2024-09-10T10:51:54.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:51:54.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: fsmap 2024-09-10T10:51:54.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T10:51:54.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: mgrmap e1: no daemons active 2024-09-10T10:51:54.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:54 smithi059 ceph-mon[30608]: from='client.? 172.21.15.59:0/3612825144' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T10:51:54.887 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T10:51:54.887 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout id: 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:51:54.887 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T10:51:54.887 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:51:54.887 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout services: 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.56315s) 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout data: 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.220+0000 7f575293d640 1 Processor -- start 2024-09-10T10:51:54.888 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.221+0000 7f575293d640 1 -- start start 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.221+0000 7f575293d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c07bcc0 0x7f574c10a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.221+0000 7f575293d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f574c10a870 con 0x7f574c07bcc0 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.221+0000 7f574bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c07bcc0 0x7f574c10a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.221+0000 7f574bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c07bcc0 0x7f574c10a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45266/0 (socket says 172.21.15.59:45266) 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.221+0000 7f574bfff640 1 -- 172.21.15.59:0/3413884786 learned_addr learned my addr 172.21.15.59:0/3413884786 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.221+0000 7f574bfff640 1 -- 172.21.15.59:0/3413884786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c10a9f0 con 0x7f574c07bcc0 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.223+0000 7f574bfff640 1 --2- 172.21.15.59:0/3413884786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c07bcc0 0x7f574c10a2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f573c009820 tx=0x7f573c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd71824d9881082f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f574affd640 1 -- 172.21.15.59:0/3413884786 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573c037070 con 0x7f574c07bcc0 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f574affd640 1 -- 172.21.15.59:0/3413884786 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573c032440 con 0x7f574c07bcc0 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f574affd640 1 -- 172.21.15.59:0/3413884786 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573c032740 con 0x7f574c07bcc0 2024-09-10T10:51:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f575293d640 1 -- 172.21.15.59:0/3413884786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c07bcc0 msgr2=0x7f574c10a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f575293d640 1 --2- 172.21.15.59:0/3413884786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c07bcc0 0x7f574c10a2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f573c009820 tx=0x7f573c02a270 comp rx=0 tx=0).stop 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f575293d640 1 -- 172.21.15.59:0/3413884786 shutdown_connections 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f575293d640 1 --2- 172.21.15.59:0/3413884786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c07bcc0 0x7f574c10a2a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f575293d640 1 -- 172.21.15.59:0/3413884786 >> 172.21.15.59:0/3413884786 conn(0x7f574c101db0 msgr2=0x7f574c104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f575293d640 1 -- 172.21.15.59:0/3413884786 shutdown_connections 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.224+0000 7f575293d640 1 -- 172.21.15.59:0/3413884786 wait complete. 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.225+0000 7f575293d640 1 Processor -- start 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.225+0000 7f575293d640 1 -- start start 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.225+0000 7f575293d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c107ad0 0x7f574c106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.225+0000 7f575293d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f574c10af90 con 0x7f574c107ad0 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f574bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c107ad0 0x7f574c106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f574bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c107ad0 0x7f574c106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45276/0 (socket says 172.21.15.59:45276) 2024-09-10T10:51:54.890 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f574bfff640 1 -- 172.21.15.59:0/3612825144 learned_addr learned my addr 172.21.15.59:0/3612825144 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f574bfff640 1 -- 172.21.15.59:0/3612825144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c107ef0 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f574bfff640 1 --2- 172.21.15.59:0/3612825144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c107ad0 0x7f574c106240 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f573c0090b0 tx=0x7f573c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f57497fa640 1 -- 172.21.15.59:0/3612825144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573c041070 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f57497fa640 1 -- 172.21.15.59:0/3612825144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573c03c7a0 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f575293d640 1 -- 172.21.15.59:0/3612825144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574c106780 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f57497fa640 1 -- 172.21.15.59:0/3612825144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573c037040 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.226+0000 7f575293d640 1 -- 172.21.15.59:0/3612825144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574c106c60 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.227+0000 7f57497fa640 1 -- 172.21.15.59:0/3612825144 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f573c044070 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.227+0000 7f57497fa640 1 -- 172.21.15.59:0/3612825144 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f573c03d730 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.227+0000 7f575293d640 1 -- 172.21.15.59:0/3612825144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f574c1080c0 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.230+0000 7f57497fa640 1 -- 172.21.15.59:0/3612825144 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f573c03cbe0 con 0x7f574c107ad0 2024-09-10T10:51:54.891 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.292+0000 7f575293d640 1 -- 172.21.15.59:0/3612825144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f574c107040 con 0x7f574c107ad0 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.292+0000 7f57497fa640 1 -- 172.21.15.59:0/3612825144 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f573c03cdc0 con 0x7f574c107ad0 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.293+0000 7f575293d640 1 -- 172.21.15.59:0/3612825144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c107ad0 msgr2=0x7f574c106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.293+0000 7f575293d640 1 --2- 172.21.15.59:0/3612825144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c107ad0 0x7f574c106240 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f573c0090b0 tx=0x7f573c0046c0 comp rx=0 tx=0).stop 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.293+0000 7f575293d640 1 -- 172.21.15.59:0/3612825144 shutdown_connections 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.293+0000 7f575293d640 1 --2- 172.21.15.59:0/3612825144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f574c107ad0 0x7f574c106240 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.293+0000 7f575293d640 1 -- 172.21.15.59:0/3612825144 >> 172.21.15.59:0/3612825144 conn(0x7f574c101db0 msgr2=0x7f574c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.293+0000 7f575293d640 1 -- 172.21.15.59:0/3612825144 shutdown_connections 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:54.293+0000 7f575293d640 1 -- 172.21.15.59:0/3612825144 wait complete. 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:mon is available 2024-09-10T10:51:54.892 INFO:teuthology.orchestra.run.smithi059.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T10:51:55.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:55 smithi059 ceph-mon[30608]: from='client.? 172.21.15.59:0/143102795' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T10:51:55.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:55 smithi059 ceph-mon[30608]: from='client.? 172.21.15.59:0/143102795' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout fsid = 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:51:55.852 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.59:3300,v1:172.21.15.59:6789] 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T10:51:55.853 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.276+0000 7f231a831640 1 Processor -- start 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.276+0000 7f231a831640 1 -- start start 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.277+0000 7f231a831640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231410a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.277+0000 7f231a831640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f231407bd70 con 0x7f2314108270 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.277+0000 7f2313fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231410a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.277+0000 7f2313fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231410a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45290/0 (socket says 172.21.15.59:45290) 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.277+0000 7f2313fff640 1 -- 172.21.15.59:0/4252899881 learned_addr learned my addr 172.21.15.59:0/4252899881 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.277+0000 7f2313fff640 1 -- 172.21.15.59:0/4252899881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231410aba0 con 0x7f2314108270 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.278+0000 7f2313fff640 1 --2- 172.21.15.59:0/4252899881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231410a660 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2304009820 tx=0x7f230402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654a2c343c11132c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.278+0000 7f2312ffd640 1 -- 172.21.15.59:0/4252899881 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2304037070 con 0x7f2314108270 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.278+0000 7f2312ffd640 1 -- 172.21.15.59:0/4252899881 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2304032440 con 0x7f2314108270 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.278+0000 7f2312ffd640 1 -- 172.21.15.59:0/4252899881 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2304032740 con 0x7f2314108270 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.279+0000 7f231a831640 1 -- 172.21.15.59:0/4252899881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 msgr2=0x7f231410a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.279+0000 7f231a831640 1 --2- 172.21.15.59:0/4252899881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231410a660 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2304009820 tx=0x7f230402a270 comp rx=0 tx=0).stop 2024-09-10T10:51:55.854 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.279+0000 7f231a831640 1 -- 172.21.15.59:0/4252899881 shutdown_connections 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.279+0000 7f231a831640 1 --2- 172.21.15.59:0/4252899881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231410a660 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.279+0000 7f231a831640 1 -- 172.21.15.59:0/4252899881 >> 172.21.15.59:0/4252899881 conn(0x7f2314101db0 msgr2=0x7f2314104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.279+0000 7f231a831640 1 -- 172.21.15.59:0/4252899881 shutdown_connections 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.279+0000 7f231a831640 1 -- 172.21.15.59:0/4252899881 wait complete. 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.279+0000 7f231a831640 1 Processor -- start 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.279+0000 7f231a831640 1 -- start start 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f231a831640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f231a831640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f231410afb0 con 0x7f2314108270 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f2313fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f2313fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231419aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45294/0 (socket says 172.21.15.59:45294) 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f2313fff640 1 -- 172.21.15.59:0/143102795 learned_addr learned my addr 172.21.15.59:0/143102795 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f2313fff640 1 -- 172.21.15.59:0/143102795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231419b430 con 0x7f2314108270 2024-09-10T10:51:55.855 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f2313fff640 1 --2- 172.21.15.59:0/143102795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231419aef0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f23040090b0 tx=0x7f23040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f23117fa640 1 -- 172.21.15.59:0/143102795 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2304041070 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f23117fa640 1 -- 172.21.15.59:0/143102795 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230403c7a0 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f231a831640 1 -- 172.21.15.59:0/143102795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231419b6c0 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.280+0000 7f23117fa640 1 -- 172.21.15.59:0/143102795 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2304037040 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.281+0000 7f231a831640 1 -- 172.21.15.59:0/143102795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231419e3b0 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.281+0000 7f23117fa640 1 -- 172.21.15.59:0/143102795 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2304044070 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.281+0000 7f23117fa640 1 -- 172.21.15.59:0/143102795 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f230403d3f0 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.282+0000 7f231a831640 1 -- 172.21.15.59:0/143102795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23141086d0 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.284+0000 7f23117fa640 1 -- 172.21.15.59:0/143102795 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2304046450 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.344+0000 7f231a831640 1 -- 172.21.15.59:0/143102795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f231402d940 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.347+0000 7f23117fa640 1 -- 172.21.15.59:0/143102795 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f2304046630 con 0x7f2314108270 2024-09-10T10:51:55.856 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.348+0000 7f23117fa640 1 -- 172.21.15.59:0/143102795 <== mon.0 v2:172.21.15.59:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2304056070 con 0x7f2314108270 2024-09-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.349+0000 7f231a831640 1 -- 172.21.15.59:0/143102795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 msgr2=0x7f231419aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.349+0000 7f231a831640 1 --2- 172.21.15.59:0/143102795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231419aef0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f23040090b0 tx=0x7f23040046c0 comp rx=0 tx=0).stop 2024-09-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.349+0000 7f231a831640 1 -- 172.21.15.59:0/143102795 shutdown_connections 2024-09-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.349+0000 7f231a831640 1 --2- 172.21.15.59:0/143102795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2314108270 0x7f231419aef0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.349+0000 7f231a831640 1 -- 172.21.15.59:0/143102795 >> 172.21.15.59:0/143102795 conn(0x7f2314101db0 msgr2=0x7f2314102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.349+0000 7f231a831640 1 -- 172.21.15.59:0/143102795 shutdown_connections 2024-09-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:55.349+0000 7f231a831640 1 -- 172.21.15.59:0/143102795 wait complete. 2024-09-10T10:51:55.857 INFO:teuthology.orchestra.run.smithi059.stdout:Generating new minimal ceph.conf... 2024-09-10T10:51:56.900 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:56 smithi059 ceph-mon[30608]: from='client.? 172.21.15.59:0/4010201314' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:51:56.907 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.216+0000 7f3953745640 1 Processor -- start 2024-09-10T10:51:56.907 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.216+0000 7f3953745640 1 -- start start 2024-09-10T10:51:56.907 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.216+0000 7f3953745640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.216+0000 7f3953745640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f394c108170 con 0x7f394c1077a0 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.216+0000 7f39514e1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.216+0000 7f39514e1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45310/0 (socket says 172.21.15.59:45310) 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.216+0000 7f39514e1640 1 -- 172.21.15.59:0/400256107 learned_addr learned my addr 172.21.15.59:0/400256107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.217+0000 7f39514e1640 1 -- 172.21.15.59:0/400256107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c108950 con 0x7f394c1077a0 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.217+0000 7f39514e1640 1 --2- 172.21.15.59:0/400256107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c107ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3948009820 tx=0x7f394802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404f040685e7c5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3943fff640 1 -- 172.21.15.59:0/400256107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3948037070 con 0x7f394c1077a0 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3943fff640 1 -- 172.21.15.59:0/400256107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3948032900 con 0x7f394c1077a0 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3943fff640 1 -- 172.21.15.59:0/400256107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3948030850 con 0x7f394c1077a0 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3953745640 1 -- 172.21.15.59:0/400256107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 msgr2=0x7f394c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3953745640 1 --2- 172.21.15.59:0/400256107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c107ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3948009820 tx=0x7f394802a270 comp rx=0 tx=0).stop 2024-09-10T10:51:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3953745640 1 -- 172.21.15.59:0/400256107 shutdown_connections 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3953745640 1 --2- 172.21.15.59:0/400256107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c107ba0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3953745640 1 -- 172.21.15.59:0/400256107 >> 172.21.15.59:0/400256107 conn(0x7f394c102fd0 msgr2=0x7f394c1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3953745640 1 -- 172.21.15.59:0/400256107 shutdown_connections 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.218+0000 7f3953745640 1 -- 172.21.15.59:0/400256107 wait complete. 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.219+0000 7f3953745640 1 Processor -- start 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.219+0000 7f3953745640 1 -- start start 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.219+0000 7f3953745640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c19b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.219+0000 7f3953745640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f394c10bd00 con 0x7f394c1077a0 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.219+0000 7f39514e1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c19b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.219+0000 7f39514e1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c19b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45314/0 (socket says 172.21.15.59:45314) 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.219+0000 7f39514e1640 1 -- 172.21.15.59:0/4010201314 learned_addr learned my addr 172.21.15.59:0/4010201314 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:51:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.219+0000 7f39514e1640 1 -- 172.21.15.59:0/4010201314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c19bc80 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.220+0000 7f39514e1640 1 --2- 172.21.15.59:0/4010201314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c19b740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3948009940 tx=0x7f3948032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.220+0000 7f39427fc640 1 -- 172.21.15.59:0/4010201314 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3948042070 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.220+0000 7f39427fc640 1 -- 172.21.15.59:0/4010201314 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39480308c0 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.220+0000 7f3953745640 1 -- 172.21.15.59:0/4010201314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f394c19bf10 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.220+0000 7f39427fc640 1 -- 172.21.15.59:0/4010201314 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3948037040 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.220+0000 7f3953745640 1 -- 172.21.15.59:0/4010201314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f394c19ec00 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.220+0000 7f39427fc640 1 -- 172.21.15.59:0/4010201314 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3948045070 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.220+0000 7f39427fc640 1 -- 172.21.15.59:0/4010201314 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3948047bc0 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.221+0000 7f3953745640 1 -- 172.21.15.59:0/4010201314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394c10be80 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.223+0000 7f39427fc640 1 -- 172.21.15.59:0/4010201314 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f39480327b0 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.283+0000 7f3953745640 1 -- 172.21.15.59:0/4010201314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f394c107c20 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.283+0000 7f39427fc640 1 -- 172.21.15.59:0/4010201314 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f394c107c20 con 0x7f394c1077a0 2024-09-10T10:51:56.910 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.284+0000 7f3953745640 1 -- 172.21.15.59:0/4010201314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 msgr2=0x7f394c19b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:56.911 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.284+0000 7f3953745640 1 --2- 172.21.15.59:0/4010201314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c19b740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3948009940 tx=0x7f3948032ce0 comp rx=0 tx=0).stop 2024-09-10T10:51:56.911 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.284+0000 7f3953745640 1 -- 172.21.15.59:0/4010201314 shutdown_connections 2024-09-10T10:51:56.911 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.284+0000 7f3953745640 1 --2- 172.21.15.59:0/4010201314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394c1077a0 0x7f394c19b740 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:56.911 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.284+0000 7f3953745640 1 -- 172.21.15.59:0/4010201314 >> 172.21.15.59:0/4010201314 conn(0x7f394c102fd0 msgr2=0x7f394c103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:56.911 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.284+0000 7f3953745640 1 -- 172.21.15.59:0/4010201314 shutdown_connections 2024-09-10T10:51:56.911 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:56.284+0000 7f3953745640 1 -- 172.21.15.59:0/4010201314 wait complete. 2024-09-10T10:51:56.911 INFO:teuthology.orchestra.run.smithi059.stdout:Restarting the monitor... 2024-09-10T10:51:57.154 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:56 smithi059 systemd[1]: Stopping Ceph mon.a for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:51:57.528 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:57 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a[30604]: 2024-09-10T10:51:57.151+0000 7fb6b2f27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:51:57.528 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:57 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a[30604]: 2024-09-10T10:51:57.152+0000 7fb6b2f27640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T10:51:57.528 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:57 smithi059 podman[30856]: 2024-09-10 10:51:57.255738998 +0000 UTC m=+0.182953628 container died 948c2e92b8c2ce8867795b1e233f9bcf27fed508959344a17160f850aa58539e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:51:57.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:57 smithi059 podman[30856]: 2024-09-10 10:51:57.618927201 +0000 UTC m=+0.546141899 container cleanup 948c2e92b8c2ce8867795b1e233f9bcf27fed508959344a17160f850aa58539e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:51:57.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:57 smithi059 bash[30856]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a 2024-09-10T10:51:58.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:57 smithi059 podman[30868]: 2024-09-10 10:51:57.898753778 +0000 UTC m=+0.637463289 container remove 948c2e92b8c2ce8867795b1e233f9bcf27fed508959344a17160f850aa58539e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T10:51:58.238 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 systemd[1]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T10:51:58.238 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 systemd[1]: Stopped Ceph mon.a for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:51:58.238 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 systemd[1]: Starting Ceph mon.a for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:51:58.486 INFO:teuthology.orchestra.run.smithi059.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T10:51:58.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 podman[30959]: 2024-09-10 10:51:58.237212355 +0000 UTC m=+0.110127288 container create f6b2538fa8e404c76071951b812d2de576d9ea022877aedb62c8ac2d35ce9e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T10:51:58.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 podman[30959]: 2024-09-10 10:51:58.143058333 +0000 UTC m=+0.015973285 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:51:58.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 podman[30959]: 2024-09-10 10:51:58.422807323 +0000 UTC m=+0.295722264 container init f6b2538fa8e404c76071951b812d2de576d9ea022877aedb62c8ac2d35ce9e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_CLEAN=True) 2024-09-10T10:51:58.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 podman[30959]: 2024-09-10 10:51:58.425980676 +0000 UTC m=+0.298895614 container start f6b2538fa8e404c76071951b812d2de576d9ea022877aedb62c8ac2d35ce9e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T10:51:58.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T10:51:58.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T10:51:58.517 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: pidfile_write: ignore empty --pid-file 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: load: jerasure load: lrc 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: RocksDB version: 7.9.2 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Git sha 0 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: DB SUMMARY 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: DB Session ID: JU2WRDLSMLZ7W9KG9TI0 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: CURRENT file: CURRENT 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T10:51:58.518 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106386 ; 2024-09-10T10:51:58.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.error_if_exists: 0 2024-09-10T10:51:58.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.create_if_missing: 0 2024-09-10T10:51:58.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.paranoid_checks: 1 2024-09-10T10:51:58.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T10:51:58.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T10:51:58.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T10:51:58.519 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.env: 0x564aa5206940 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.info_log: 0x564aa64fb6e0 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.statistics: (nil) 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.use_fsync: 0 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_log_file_size: 0 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.allow_fallocate: 1 2024-09-10T10:51:58.520 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.use_direct_reads: 0 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.db_log_dir: 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.wal_dir: 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T10:51:58.521 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.write_buffer_manager: 0x564aa650adc0 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.unordered_write: 0 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T10:51:58.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.row_cache: None 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.wal_filter: None 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.two_write_queues: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.wal_compression: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.atomic_flush: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.log_readahead_size: 0 2024-09-10T10:51:58.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_background_jobs: 2 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_background_compactions: -1 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_subcompactions: 1 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T10:51:58.524 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_open_files: -1 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_background_flushes: -1 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Compression algorithms supported: 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: kZSTD supported: 0 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: kXpressCompression supported: 0 2024-09-10T10:51:58.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: kBZip2Compression supported: 0 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: kLZ4Compression supported: 1 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: kZlibCompression supported: 1 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: kSnappyCompression supported: 1 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.merge_operator: 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_filter: None 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T10:51:58.526 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564aa64fb320) 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: cache_index_and_filter_blocks: 1 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: pin_top_level_index_and_filter: 1 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: index_type: 0 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: data_block_index_type: 0 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: index_shortening: 1 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: checksum: 4 2024-09-10T10:51:58.527 INFO:journalctl@ceph.mon.a.smithi059.stdout: no_block_cache: 0 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache: 0x564aa64ef1f0 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache_name: BinnedLRUCache 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache_options: 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: capacity : 536870912 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: num_shard_bits : 4 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: strict_capacity_limit : 0 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: high_pri_pool_ratio: 0.000 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache_compressed: (nil) 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: persistent_cache: (nil) 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_size: 4096 2024-09-10T10:51:58.528 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_size_deviation: 10 2024-09-10T10:51:58.529 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_restart_interval: 16 2024-09-10T10:51:58.529 INFO:journalctl@ceph.mon.a.smithi059.stdout: index_block_restart_interval: 1 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: metadata_block_size: 4096 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: partition_filters: 0 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: use_delta_encoding: 1 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: filter_policy: bloomfilter 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: whole_key_filtering: 1 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: verify_compression: 0 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: read_amp_bytes_per_bit: 0 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: format_version: 5 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: enable_index_compression: 1 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_align: 0 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: max_auto_readahead_size: 262144 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: prepopulate_block_cache: 0 2024-09-10T10:51:58.530 INFO:journalctl@ceph.mon.a.smithi059.stdout: initial_auto_readahead_size: 8192 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression: NoCompression 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.num_levels: 7 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T10:51:58.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T10:51:58.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T10:51:58.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T10:51:58.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.inplace_update_support: 0 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T10:51:58.535 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.bloom_locality: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.max_successive_merges: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.ttl: 2592000 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T10:51:58.536 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.enable_blob_files: false 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.min_blob_size: 0 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b46afbd1-ff47-4be2-b5cc-3c4c74321d0a 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725965518452795, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T10:51:58.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725965518453933, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101406, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 99282, "index_size": 316, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14564, "raw_average_key_size": 50, "raw_value_size": 91357, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 291, "num_filter_entries": 291, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725965518, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b46afbd1-ff47-4be2-b5cc-3c4c74321d0a", "db_session_id": "JU2WRDLSMLZ7W9KG9TI0", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725965518454033, "job": 1, "event": "recovery_finished"} 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564aa651ce00 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: DB pointer 0x564aa6618000 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** DB Stats ** 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:51:58.538 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** Compaction Stats [default] ** 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: L0 2/0 100.89 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: Sum 2/0 100.89 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T10:51:58.539 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** Compaction Stats [default] ** 2024-09-10T10:51:58.540 INFO:journalctl@ceph.mon.a.smithi059.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:51:58.540 INFO:journalctl@ceph.mon.a.smithi059.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 134.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative compaction: 0.00 GB write, 28.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval compaction: 0.00 GB write, 28.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:51:58.541 INFO:journalctl@ceph.mon.a.smithi059.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout: Block cache BinnedLRUCache@0x564aa64ef1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: starting mon.a rank 0 at public addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] at bind addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mon.a@-1(???) e1 preinit fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mon.a@-1(???).mds e1 new map 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mon.a@-1(???).mds e1 print_map 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout: e1 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout: btime 2024-09-10T10:51:53:731417+0000 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:51:58.542 INFO:journalctl@ceph.mon.a.smithi059.stdout: legacy client fscid: -1 2024-09-10T10:51:58.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T10:51:58.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: No filesystems configured 2024-09-10T10:51:58.543 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T10:51:58.543 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:51:58.543 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 bash[30959]: f6b2538fa8e404c76071951b812d2de576d9ea022877aedb62c8ac2d35ce9e5d 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 systemd[1]: Started Ceph mon.a for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: monmap epoch 1 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: last_changed 2024-09-10T10:51:50.263729+0000 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: min_mon_release 19 (squid) 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: election_strategy: 1 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:51:58.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: fsmap 2024-09-10T10:51:58.545 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T10:51:58.545 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:58 smithi059 ceph-mon[30978]: mgrmap e1: no daemons active 2024-09-10T10:51:59.503 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.917+0000 7f691a627640 1 Processor -- start 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.917+0000 7f691a627640 1 -- start start 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.917+0000 7f691a627640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f6914108050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.917+0000 7f691a627640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6914108620 con 0x7f6914107c50 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.918+0000 7f6913fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f6914108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.918+0000 7f6913fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f6914108050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48356/0 (socket says 172.21.15.59:48356) 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.918+0000 7f6913fff640 1 -- 172.21.15.59:0/183143867 learned_addr learned my addr 172.21.15.59:0/183143867 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.918+0000 7f6913fff640 1 -- 172.21.15.59:0/183143867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69141068b0 con 0x7f6914107c50 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.920+0000 7f6913fff640 1 --2- 172.21.15.59:0/183143867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f6914108050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6904009820 tx=0x7f690402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c347099dcc77b8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.920+0000 7f69137fe640 1 -- 172.21.15.59:0/183143867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6904037070 con 0x7f6914107c50 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.920+0000 7f69137fe640 1 -- 172.21.15.59:0/183143867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6904032900 con 0x7f6914107c50 2024-09-10T10:51:59.504 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.920+0000 7f69137fe640 1 -- 172.21.15.59:0/183143867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6904030850 con 0x7f6914107c50 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.921+0000 7f691a627640 1 -- 172.21.15.59:0/183143867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 msgr2=0x7f6914108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.921+0000 7f691a627640 1 --2- 172.21.15.59:0/183143867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f6914108050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6904009820 tx=0x7f690402a270 comp rx=0 tx=0).stop 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.921+0000 7f691a627640 1 -- 172.21.15.59:0/183143867 shutdown_connections 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.921+0000 7f691a627640 1 --2- 172.21.15.59:0/183143867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f6914108050 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.921+0000 7f691a627640 1 -- 172.21.15.59:0/183143867 >> 172.21.15.59:0/183143867 conn(0x7f69141015f0 msgr2=0x7f6914103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.921+0000 7f691a627640 1 -- 172.21.15.59:0/183143867 shutdown_connections 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.921+0000 7f691a627640 1 -- 172.21.15.59:0/183143867 wait complete. 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.922+0000 7f691a627640 1 Processor -- start 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.922+0000 7f691a627640 1 -- start start 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.922+0000 7f691a627640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f691419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.922+0000 7f691a627640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f691410ac70 con 0x7f6914107c50 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.922+0000 7f6913fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f691419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.922+0000 7f6913fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f691419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48368/0 (socket says 172.21.15.59:48368) 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.922+0000 7f6913fff640 1 -- 172.21.15.59:0/212487882 learned_addr learned my addr 172.21.15.59:0/212487882 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.922+0000 7f6913fff640 1 -- 172.21.15.59:0/212487882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691419bce0 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.922+0000 7f6913fff640 1 --2- 172.21.15.59:0/212487882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f691419b7a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6904009940 tx=0x7f6904032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.923+0000 7f6911ffb640 1 -- 172.21.15.59:0/212487882 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6904042070 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.923+0000 7f6911ffb640 1 -- 172.21.15.59:0/212487882 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69040308c0 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.923+0000 7f6911ffb640 1 -- 172.21.15.59:0/212487882 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6904037040 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.923+0000 7f691a627640 1 -- 172.21.15.59:0/212487882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691419bf70 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.923+0000 7f691a627640 1 -- 172.21.15.59:0/212487882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691419ec60 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.923+0000 7f6911ffb640 1 -- 172.21.15.59:0/212487882 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6904045070 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.923+0000 7f6911ffb640 1 -- 172.21.15.59:0/212487882 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6904047b70 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.924+0000 7f691a627640 1 -- 172.21.15.59:0/212487882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69141080d0 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.926+0000 7f6911ffb640 1 -- 172.21.15.59:0/212487882 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f69040327b0 con 0x7f6914107c50 2024-09-10T10:51:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.985+0000 7f691a627640 1 -- 172.21.15.59:0/212487882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f6914195760 con 0x7f6914107c50 2024-09-10T10:51:59.507 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.989+0000 7f6911ffb640 1 -- 172.21.15.59:0/212487882 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f690403c760 con 0x7f6914107c50 2024-09-10T10:51:59.507 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.990+0000 7f691a627640 1 -- 172.21.15.59:0/212487882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 msgr2=0x7f691419b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:59.507 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.990+0000 7f691a627640 1 --2- 172.21.15.59:0/212487882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f691419b7a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6904009940 tx=0x7f6904032ce0 comp rx=0 tx=0).stop 2024-09-10T10:51:59.507 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.990+0000 7f691a627640 1 -- 172.21.15.59:0/212487882 shutdown_connections 2024-09-10T10:51:59.507 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.990+0000 7f691a627640 1 --2- 172.21.15.59:0/212487882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6914107c50 0x7f691419b7a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:59.507 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.990+0000 7f691a627640 1 -- 172.21.15.59:0/212487882 >> 172.21.15.59:0/212487882 conn(0x7f69141015f0 msgr2=0x7f6914102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:59.507 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.990+0000 7f691a627640 1 -- 172.21.15.59:0/212487882 shutdown_connections 2024-09-10T10:51:59.507 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:51:58.991+0000 7f691a627640 1 -- 172.21.15.59:0/212487882 wait complete. 2024-09-10T10:51:59.507 INFO:teuthology.orchestra.run.smithi059.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T10:51:59.521 INFO:teuthology.orchestra.run.smithi059.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:51:59.521 INFO:teuthology.orchestra.run.smithi059.stdout:Creating mgr... 2024-09-10T10:51:59.521 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T10:51:59.522 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T10:51:59.785 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.x 2024-09-10T10:51:59.786 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to reset failed state of unit ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T10:51:59.948 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-86a09b02-6f62-11ef-bcea-c7b262605968.target.wants/ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-86a09b02-6f62-11ef-bcea-c7b262605968@.service. 2024-09-10T10:52:00.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:51:59 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/212487882' entity='client.admin' 2024-09-10T10:52:00.478 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:00 smithi059 podman[31188]: 2024-09-10 10:52:00.353215149 +0000 UTC m=+0.278586905 container start 25d8ecb57e9b020270388d75e642682d16e74be7f7768c92f8afe5dbda4dbc58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T10:52:00.498 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:52:00.498 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2024-09-10T10:52:00.506 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:52:00.506 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T10:52:00.506 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2024-09-10T10:52:00.506 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T10:52:00.515 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:52:00.515 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2024-09-10T10:52:00.523 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:52:00.523 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T10:52:00.523 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2024-09-10T10:52:00.523 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T10:52:00.523 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr to start... 2024-09-10T10:52:00.523 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr... 2024-09-10T10:52:00.731 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:00.475+0000 7fa9ecbc2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:52:00.731 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:00 smithi059 bash[31188]: 25d8ecb57e9b020270388d75e642682d16e74be7f7768c92f8afe5dbda4dbc58 2024-09-10T10:52:00.731 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:00 smithi059 systemd[1]: Started Ceph mgr.x for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:52:00.731 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:00.538+0000 7fa9ecbc2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:52:00.731 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:00.697+0000 7fa9ecbc2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:52:01.081 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:00 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/402871241' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T10:52:01.082 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:00.769+0000 7fa9ecbc2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:52:01.082 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:00.929+0000 7fa9ecbc2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:52:01.082 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:01.080+0000 7fa9ecbc2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:52:01.585 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:52:01.588 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:52:01.588 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsid": "86a09b02-6f62-11ef-bcea-c7b262605968", 2024-09-10T10:52:01.588 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T10:52:01.588 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 0 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T10:52:01.590 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T10:52:01.590 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:01.590 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T10:52:01.590 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:01.590 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T10:52:01.590 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T10:52:01.590 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T10:52:01.597 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T10:52:01.597 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T10:52:01.597 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:01.598 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T10:51:53:731417+0000", 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:52:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T10:51:53.732304+0000", 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.900+0000 7fa9352de640 1 Processor -- start 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.900+0000 7fa9352de640 1 -- start start 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.900+0000 7fa9352de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa930107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.900+0000 7fa9352de640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa930108170 con 0x7fa9301077a0 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.900+0000 7fa92effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa930107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.900+0000 7fa92effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa930107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48388/0 (socket says 172.21.15.59:48388) 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.900+0000 7fa92effd640 1 -- 172.21.15.59:0/3699033264 learned_addr learned my addr 172.21.15.59:0/3699033264 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.901+0000 7fa92effd640 1 -- 172.21.15.59:0/3699033264 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa930108950 con 0x7fa9301077a0 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.901+0000 7fa92effd640 1 --2- 172.21.15.59:0/3699033264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa930107ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa920009820 tx=0x7fa92002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e37a90af7aaf9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.902+0000 7fa92e7fc640 1 -- 172.21.15.59:0/3699033264 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa920037070 con 0x7fa9301077a0 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.902+0000 7fa92e7fc640 1 -- 172.21.15.59:0/3699033264 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa920032900 con 0x7fa9301077a0 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.902+0000 7fa92e7fc640 1 -- 172.21.15.59:0/3699033264 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa920030850 con 0x7fa9301077a0 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.902+0000 7fa9352de640 1 -- 172.21.15.59:0/3699033264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 msgr2=0x7fa930107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.902+0000 7fa9352de640 1 --2- 172.21.15.59:0/3699033264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa930107ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa920009820 tx=0x7fa92002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.902+0000 7fa9352de640 1 -- 172.21.15.59:0/3699033264 shutdown_connections 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.902+0000 7fa9352de640 1 --2- 172.21.15.59:0/3699033264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa930107ba0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.902+0000 7fa9352de640 1 -- 172.21.15.59:0/3699033264 >> 172.21.15.59:0/3699033264 conn(0x7fa930102fd0 msgr2=0x7fa9301053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.903+0000 7fa9352de640 1 -- 172.21.15.59:0/3699033264 shutdown_connections 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.903+0000 7fa9352de640 1 -- 172.21.15.59:0/3699033264 wait complete. 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.903+0000 7fa9352de640 1 Processor -- start 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.903+0000 7fa9352de640 1 -- start start 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.903+0000 7fa9352de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa93019d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.903+0000 7fa9352de640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa93010bd00 con 0x7fa9301077a0 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa92effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa93019d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa92effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa93019d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48398/0 (socket says 172.21.15.59:48398) 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa92effd640 1 -- 172.21.15.59:0/402871241 learned_addr learned my addr 172.21.15.59:0/402871241 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa92effd640 1 -- 172.21.15.59:0/402871241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93019deb0 con 0x7fa9301077a0 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa92effd640 1 --2- 172.21.15.59:0/402871241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa93019d970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9200097f0 tx=0x7fa920030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa92cff9640 1 -- 172.21.15.59:0/402871241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa920037040 con 0x7fa9301077a0 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa9352de640 1 -- 172.21.15.59:0/402871241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa93019e140 con 0x7fa9301077a0 2024-09-10T10:52:01.602 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa92cff9640 1 -- 172.21.15.59:0/402871241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa920040070 con 0x7fa9301077a0 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa92cff9640 1 -- 172.21.15.59:0/402871241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa92003a390 con 0x7fa9301077a0 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.904+0000 7fa9352de640 1 -- 172.21.15.59:0/402871241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9301a0e30 con 0x7fa9301077a0 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.905+0000 7fa92cff9640 1 -- 172.21.15.59:0/402871241 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa92003a630 con 0x7fa9301077a0 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.905+0000 7fa92cff9640 1 -- 172.21.15.59:0/402871241 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa920045da0 con 0x7fa9301077a0 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.905+0000 7fa9352de640 1 -- 172.21.15.59:0/402871241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa93010be80 con 0x7fa9301077a0 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.908+0000 7fa92cff9640 1 -- 172.21.15.59:0/402871241 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa92003b430 con 0x7fa9301077a0 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.970+0000 7fa9352de640 1 -- 172.21.15.59:0/402871241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa9301a1000 con 0x7fa9301077a0 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.971+0000 7fa92cff9640 1 -- 172.21.15.59:0/402871241 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fa92003b7c0 con 0x7fa9301077a0 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.972+0000 7fa9352de640 1 -- 172.21.15.59:0/402871241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 msgr2=0x7fa93019d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.972+0000 7fa9352de640 1 --2- 172.21.15.59:0/402871241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa93019d970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9200097f0 tx=0x7fa920030d80 comp rx=0 tx=0).stop 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.972+0000 7fa9352de640 1 -- 172.21.15.59:0/402871241 shutdown_connections 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.972+0000 7fa9352de640 1 --2- 172.21.15.59:0/402871241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9301077a0 0x7fa93019d970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.972+0000 7fa9352de640 1 -- 172.21.15.59:0/402871241 >> 172.21.15.59:0/402871241 conn(0x7fa930102fd0 msgr2=0x7fa930103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:01.603 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.972+0000 7fa9352de640 1 -- 172.21.15.59:0/402871241 shutdown_connections 2024-09-10T10:52:01.604 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:00.972+0000 7fa9352de640 1 -- 172.21.15.59:0/402871241 wait complete. 2024-09-10T10:52:01.604 INFO:teuthology.orchestra.run.smithi059.stdout:mgr not available, waiting (1/15)... 2024-09-10T10:52:01.678 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:01.417+0000 7fa9ecbc2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:52:01.678 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:01.481+0000 7fa9ecbc2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:52:01.678 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:01.676+0000 7fa9ecbc2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:52:02.887 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:02 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:02.603+0000 7fa9ecbc2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:52:02.888 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:02 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:02.674+0000 7fa9ecbc2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:52:03.700 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:03.431+0000 7fa9ecbc2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:52:03.700 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:03.552+0000 7fa9ecbc2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:52:03.998 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:03.705+0000 7fa9ecbc2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:52:03.999 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:03.769+0000 7fa9ecbc2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:52:03.999 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:03.932+0000 7fa9ecbc2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:52:04.249 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:04 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2939721028' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T10:52:04.250 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:04.007+0000 7fa9ecbc2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:52:04.250 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:04.071+0000 7fa9ecbc2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:52:04.250 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:04.247+0000 7fa9ecbc2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:52:04.542 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:04.317+0000 7fa9ecbc2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:52:04.543 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:04.386+0000 7fa9ecbc2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:52:04.543 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:04.477+0000 7fa9ecbc2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:52:04.543 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:04.540+0000 7fa9ecbc2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:52:04.694 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:52:04.694 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:52:04.694 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsid": "86a09b02-6f62-11ef-bcea-c7b262605968", 2024-09-10T10:52:04.694 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T10:52:04.694 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T10:52:04.694 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T10:52:04.694 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 0 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T10:52:04.695 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:04.696 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T10:52:04.696 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:04.696 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T10:52:04.696 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T10:52:04.696 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T10:52:04.704 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T10:52:04.704 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T10:52:04.704 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T10:52:04.704 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:04.704 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T10:52:04.704 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T10:52:04.704 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T10:51:53:731417+0000", 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T10:52:04.705 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:04.706 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T10:51:53.732304+0000", 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.996+0000 7f13c5f96640 1 Processor -- start 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.996+0000 7f13c5f96640 1 -- start start 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.997+0000 7f13c5f96640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c0107b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.997+0000 7f13c5f96640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f13c0108160 con 0x7f13c0107790 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.997+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c0107b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.997+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c0107b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48410/0 (socket says 172.21.15.59:48410) 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.997+0000 7f13bf7fe640 1 -- 172.21.15.59:0/838122192 learned_addr learned my addr 172.21.15.59:0/838122192 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:04.707 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.997+0000 7f13bf7fe640 1 -- 172.21.15.59:0/838122192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c0108940 con 0x7f13c0107790 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.998+0000 7f13bf7fe640 1 --2- 172.21.15.59:0/838122192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c0107b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009820 tx=0x7f13b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c067418174614822 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.998+0000 7f13be7fc640 1 -- 172.21.15.59:0/838122192 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b0037070 con 0x7f13c0107790 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.998+0000 7f13be7fc640 1 -- 172.21.15.59:0/838122192 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13b0032900 con 0x7f13c0107790 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.998+0000 7f13be7fc640 1 -- 172.21.15.59:0/838122192 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b0030850 con 0x7f13c0107790 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.999+0000 7f13c5f96640 1 -- 172.21.15.59:0/838122192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 msgr2=0x7f13c0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.999+0000 7f13c5f96640 1 --2- 172.21.15.59:0/838122192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c0107b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009820 tx=0x7f13b002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.999+0000 7f13c5f96640 1 -- 172.21.15.59:0/838122192 shutdown_connections 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.999+0000 7f13c5f96640 1 --2- 172.21.15.59:0/838122192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c0107b90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.999+0000 7f13c5f96640 1 -- 172.21.15.59:0/838122192 >> 172.21.15.59:0/838122192 conn(0x7f13c0102f60 msgr2=0x7f13c0105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.999+0000 7f13c5f96640 1 -- 172.21.15.59:0/838122192 shutdown_connections 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:03.999+0000 7f13c5f96640 1 -- 172.21.15.59:0/838122192 wait complete. 2024-09-10T10:52:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.000+0000 7f13c5f96640 1 Processor -- start 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.000+0000 7f13c5f96640 1 -- start start 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.000+0000 7f13c5f96640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.000+0000 7f13c5f96640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f13c010bcf0 con 0x7f13c0107790 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.000+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.000+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c019b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48422/0 (socket says 172.21.15.59:48422) 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.000+0000 7f13bf7fe640 1 -- 172.21.15.59:0/2939721028 learned_addr learned my addr 172.21.15.59:0/2939721028 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.001+0000 7f13bf7fe640 1 -- 172.21.15.59:0/2939721028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c019bca0 con 0x7f13c0107790 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.001+0000 7f13bf7fe640 1 --2- 172.21.15.59:0/2939721028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c019b760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13b00097f0 tx=0x7f13b0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.001+0000 7f13bcff9640 1 -- 172.21.15.59:0/2939721028 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b0037040 con 0x7f13c0107790 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.001+0000 7f13bcff9640 1 -- 172.21.15.59:0/2939721028 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13b0040070 con 0x7f13c0107790 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.001+0000 7f13c5f96640 1 -- 172.21.15.59:0/2939721028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c019bf30 con 0x7f13c0107790 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.001+0000 7f13bcff9640 1 -- 172.21.15.59:0/2939721028 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b003a390 con 0x7f13c0107790 2024-09-10T10:52:04.709 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.001+0000 7f13c5f96640 1 -- 172.21.15.59:0/2939721028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c019ec20 con 0x7f13c0107790 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.001+0000 7f13bcff9640 1 -- 172.21.15.59:0/2939721028 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f13b003a5e0 con 0x7f13c0107790 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.002+0000 7f13bcff9640 1 -- 172.21.15.59:0/2939721028 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f13b0045950 con 0x7f13c0107790 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.002+0000 7f13c5f96640 1 -- 172.21.15.59:0/2939721028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c010be70 con 0x7f13c0107790 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.004+0000 7f13bcff9640 1 -- 172.21.15.59:0/2939721028 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f13b0045460 con 0x7f13c0107790 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.067+0000 7f13c5f96640 1 -- 172.21.15.59:0/2939721028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f13c019edf0 con 0x7f13c0107790 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.067+0000 7f13bcff9640 1 -- 172.21.15.59:0/2939721028 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f13b003b430 con 0x7f13c0107790 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.068+0000 7f13c5f96640 1 -- 172.21.15.59:0/2939721028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 msgr2=0x7f13c019b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.068+0000 7f13c5f96640 1 --2- 172.21.15.59:0/2939721028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c019b760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13b00097f0 tx=0x7f13b0030d80 comp rx=0 tx=0).stop 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.068+0000 7f13c5f96640 1 -- 172.21.15.59:0/2939721028 shutdown_connections 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.068+0000 7f13c5f96640 1 --2- 172.21.15.59:0/2939721028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13c0107790 0x7f13c019b760 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.068+0000 7f13c5f96640 1 -- 172.21.15.59:0/2939721028 >> 172.21.15.59:0/2939721028 conn(0x7f13c0102f60 msgr2=0x7f13c0103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.068+0000 7f13c5f96640 1 -- 172.21.15.59:0/2939721028 shutdown_connections 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:04.068+0000 7f13c5f96640 1 -- 172.21.15.59:0/2939721028 wait complete. 2024-09-10T10:52:04.710 INFO:teuthology.orchestra.run.smithi059.stdout:mgr not available, waiting (2/15)... 2024-09-10T10:52:04.887 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:04.602+0000 7fa9ecbc2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:52:05.888 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:05.436+0000 7fa9ecbc2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:52:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: Activating manager daemon x 2024-09-10T10:52:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: mgrmap e2: x(active, starting, since 0.00291713s) 2024-09-10T10:52:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:52:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:52:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:52:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:52:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:52:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: Manager daemon x is now available 2024-09-10T10:52:05.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:52:05.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:52:05.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' 2024-09-10T10:52:05.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' 2024-09-10T10:52:05.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:05 smithi059 ceph-mon[30978]: from='mgr.14100 172.21.15.59:0/4176676159' entity='mgr.x' 2024-09-10T10:52:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:07 smithi059 ceph-mon[30978]: mgrmap e3: x(active, since 1.00741s) 2024-09-10T10:52:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:07 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/113975711' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T10:52:08.067 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:52:08.067 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:52:08.067 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsid": "86a09b02-6f62-11ef-bcea-c7b262605968", 2024-09-10T10:52:08.067 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T10:52:08.067 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T10:52:08.067 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T10:52:08.067 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 0 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:08.068 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:08.069 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T10:52:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T10:51:53:731417+0000", 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:52:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T10:51:53.732304+0000", 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.083+0000 7fc59fd1f640 1 Processor -- start 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.083+0000 7fc59fd1f640 1 -- start start 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.084+0000 7fc59fd1f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59810a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.084+0000 7fc59fd1f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc59807bdf0 con 0x7fc5981081f0 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.084+0000 7fc59dabb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59810a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.084+0000 7fc59dabb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59810a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57742/0 (socket says 172.21.15.59:57742) 2024-09-10T10:52:08.072 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.084+0000 7fc59dabb640 1 -- 172.21.15.59:0/1790019474 learned_addr learned my addr 172.21.15.59:0/1790019474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.084+0000 7fc59dabb640 1 -- 172.21.15.59:0/1790019474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59810ab20 con 0x7fc5981081f0 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.085+0000 7fc59dabb640 1 --2- 172.21.15.59:0/1790019474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59810a5e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc588009e80 tx=0x7fc58802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca0ed91e0182a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.085+0000 7fc59cab9640 1 -- 172.21.15.59:0/1790019474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc588036070 con 0x7fc5981081f0 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.085+0000 7fc59cab9640 1 -- 172.21.15.59:0/1790019474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc5880318c0 con 0x7fc5981081f0 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.085+0000 7fc59cab9640 1 -- 172.21.15.59:0/1790019474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc588007ab0 con 0x7fc5981081f0 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.086+0000 7fc59fd1f640 1 -- 172.21.15.59:0/1790019474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 msgr2=0x7fc59810a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.086+0000 7fc59fd1f640 1 --2- 172.21.15.59:0/1790019474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59810a5e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc588009e80 tx=0x7fc58802a7a0 comp rx=0 tx=0).stop 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.086+0000 7fc59fd1f640 1 -- 172.21.15.59:0/1790019474 shutdown_connections 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.086+0000 7fc59fd1f640 1 --2- 172.21.15.59:0/1790019474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59810a5e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.086+0000 7fc59fd1f640 1 -- 172.21.15.59:0/1790019474 >> 172.21.15.59:0/1790019474 conn(0x7fc598101db0 msgr2=0x7fc598104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.086+0000 7fc59fd1f640 1 -- 172.21.15.59:0/1790019474 shutdown_connections 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.086+0000 7fc59fd1f640 1 -- 172.21.15.59:0/1790019474 wait complete. 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.086+0000 7fc59fd1f640 1 Processor -- start 2024-09-10T10:52:08.073 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.087+0000 7fc59fd1f640 1 -- start start 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.087+0000 7fc59fd1f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.087+0000 7fc59fd1f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc59810bb00 con 0x7fc5981081f0 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.087+0000 7fc59dabb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.087+0000 7fc59dabb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59819b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57752/0 (socket says 172.21.15.59:57752) 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.087+0000 7fc59dabb640 1 -- 172.21.15.59:0/113975711 learned_addr learned my addr 172.21.15.59:0/113975711 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.087+0000 7fc59dabb640 1 -- 172.21.15.59:0/113975711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59819bcb0 con 0x7fc5981081f0 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.087+0000 7fc59dabb640 1 --2- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59819b770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc58802acc0 tx=0x7fc588031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.088+0000 7fc596ffd640 1 -- 172.21.15.59:0/113975711 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc588036050 con 0x7fc5981081f0 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.088+0000 7fc596ffd640 1 -- 172.21.15.59:0/113975711 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc588037040 con 0x7fc5981081f0 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.088+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc59819bf40 con 0x7fc5981081f0 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.088+0000 7fc596ffd640 1 -- 172.21.15.59:0/113975711 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58803d920 con 0x7fc5981081f0 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.088+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc59819ec30 con 0x7fc5981081f0 2024-09-10T10:52:08.074 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.088+0000 7fc596ffd640 1 -- 172.21.15.59:0/113975711 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7fc588044020 con 0x7fc5981081f0 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.089+0000 7fc596ffd640 1 --2- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fc580038e60 0x7fc58003b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.089+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc598108650 con 0x7fc5981081f0 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.089+0000 7fc596ffd640 1 -- 172.21.15.59:0/113975711 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc588042020 con 0x7fc5981081f0 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.089+0000 7fc59d2ba640 1 --2- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fc580038e60 0x7fc58003b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.089+0000 7fc59d2ba640 1 --2- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fc580038e60 0x7fc58003b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0098c0 tx=0x7fc58c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.094+0000 7fc596ffd640 1 -- 172.21.15.59:0/113975711 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc58804b020 con 0x7fc5981081f0 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.340+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc59819f280 con 0x7fc5981081f0 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.340+0000 7fc596ffd640 1 -- 172.21.15.59:0/113975711 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fc58805b220 con 0x7fc5981081f0 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fc580038e60 msgr2=0x7fc58003b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 --2- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fc580038e60 0x7fc58003b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0098c0 tx=0x7fc58c006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 msgr2=0x7fc59819b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 --2- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59819b770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc58802acc0 tx=0x7fc588031ca0 comp rx=0 tx=0).stop 2024-09-10T10:52:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 shutdown_connections 2024-09-10T10:52:08.076 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 --2- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fc580038e60 0x7fc58003b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:08.076 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 --2- 172.21.15.59:0/113975711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5981081f0 0x7fc59819b770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:08.076 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 >> 172.21.15.59:0/113975711 conn(0x7fc598101db0 msgr2=0x7fc598102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:08.076 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 shutdown_connections 2024-09-10T10:52:08.076 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:07.343+0000 7fc59fd1f640 1 -- 172.21.15.59:0/113975711 wait complete. 2024-09-10T10:52:08.076 INFO:teuthology.orchestra.run.smithi059.stdout:mgr is available 2024-09-10T10:52:08.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:08 smithi059 ceph-mon[30978]: mgrmap e4: x(active, since 2s) 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout fsid = 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.59:3300,v1:172.21.15.59:6789] 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.482+0000 7fe7486de640 1 Processor -- start 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.483+0000 7fe7486de640 1 -- start start 2024-09-10T10:52:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.483+0000 7fe7486de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe740107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.483+0000 7fe7486de640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe740108170 con 0x7fe7401077a0 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.483+0000 7fe74647a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe740107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.483+0000 7fe74647a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe740107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57760/0 (socket says 172.21.15.59:57760) 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.483+0000 7fe74647a640 1 -- 172.21.15.59:0/1004604928 learned_addr learned my addr 172.21.15.59:0/1004604928 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.483+0000 7fe74647a640 1 -- 172.21.15.59:0/1004604928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe740108950 con 0x7fe7401077a0 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.484+0000 7fe74647a640 1 --2- 172.21.15.59:0/1004604928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe740107ba0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009820 tx=0x7fe73c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea64aab7c479021b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.484+0000 7fe745478640 1 -- 172.21.15.59:0/1004604928 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe73c037070 con 0x7fe7401077a0 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.484+0000 7fe745478640 1 -- 172.21.15.59:0/1004604928 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe73c032900 con 0x7fe7401077a0 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.484+0000 7fe745478640 1 -- 172.21.15.59:0/1004604928 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe73c030850 con 0x7fe7401077a0 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.485+0000 7fe7486de640 1 -- 172.21.15.59:0/1004604928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 msgr2=0x7fe740107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.485+0000 7fe7486de640 1 --2- 172.21.15.59:0/1004604928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe740107ba0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009820 tx=0x7fe73c02a270 comp rx=0 tx=0).stop 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.485+0000 7fe7486de640 1 -- 172.21.15.59:0/1004604928 shutdown_connections 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.485+0000 7fe7486de640 1 --2- 172.21.15.59:0/1004604928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe740107ba0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.485+0000 7fe7486de640 1 -- 172.21.15.59:0/1004604928 >> 172.21.15.59:0/1004604928 conn(0x7fe740102fd0 msgr2=0x7fe7401053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.485+0000 7fe7486de640 1 -- 172.21.15.59:0/1004604928 shutdown_connections 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.485+0000 7fe7486de640 1 -- 172.21.15.59:0/1004604928 wait complete. 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.486+0000 7fe7486de640 1 Processor -- start 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.486+0000 7fe7486de640 1 -- start start 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.486+0000 7fe7486de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe74019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.486+0000 7fe7486de640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe74010bd00 con 0x7fe7401077a0 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.486+0000 7fe74647a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe74019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.486+0000 7fe74647a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe74019b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57764/0 (socket says 172.21.15.59:57764) 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.486+0000 7fe74647a640 1 -- 172.21.15.59:0/71601810 learned_addr learned my addr 172.21.15.59:0/71601810 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.487+0000 7fe74647a640 1 -- 172.21.15.59:0/71601810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74019bc80 con 0x7fe7401077a0 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.487+0000 7fe74647a640 1 --2- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe74019b740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0097f0 tx=0x7fe73c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.487+0000 7fe7377fe640 1 -- 172.21.15.59:0/71601810 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe73c037040 con 0x7fe7401077a0 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.487+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74019bf10 con 0x7fe7401077a0 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.487+0000 7fe7377fe640 1 -- 172.21.15.59:0/71601810 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe73c040070 con 0x7fe7401077a0 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.487+0000 7fe7377fe640 1 -- 172.21.15.59:0/71601810 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe73c03a390 con 0x7fe7401077a0 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.487+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74019ec00 con 0x7fe7401077a0 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.488+0000 7fe7377fe640 1 -- 172.21.15.59:0/71601810 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fe73c032900 con 0x7fe7401077a0 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.488+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74010be80 con 0x7fe7401077a0 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.488+0000 7fe7377fe640 1 --2- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe72c038f20 0x7fe72c03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.488+0000 7fe7377fe640 1 -- 172.21.15.59:0/71601810 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe73c06c0f0 con 0x7fe7401077a0 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.488+0000 7fe745c79640 1 --2- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe72c038f20 0x7fe72c03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.489+0000 7fe745c79640 1 --2- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe72c038f20 0x7fe72c03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7300098c0 tx=0x7fe730006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.493+0000 7fe7377fe640 1 -- 172.21.15.59:0/71601810 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe73c06be50 con 0x7fe7401077a0 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.669+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe740107c20 con 0x7fe7401077a0 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.670+0000 7fe7377fe640 1 -- 172.21.15.59:0/71601810 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fe73c06e210 con 0x7fe7401077a0 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe72c038f20 msgr2=0x7fe72c03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 --2- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe72c038f20 0x7fe72c03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7300098c0 tx=0x7fe730006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 msgr2=0x7fe74019b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 --2- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe74019b740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0097f0 tx=0x7fe73c030d80 comp rx=0 tx=0).stop 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 shutdown_connections 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 --2- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe72c038f20 0x7fe72c03b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 --2- 172.21.15.59:0/71601810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7401077a0 0x7fe74019b740 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.224 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 >> 172.21.15.59:0/71601810 conn(0x7fe740102fd0 msgr2=0x7fe740103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:09.225 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 shutdown_connections 2024-09-10T10:52:09.225 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:08.672+0000 7fe7486de640 1 -- 172.21.15.59:0/71601810 wait complete. 2024-09-10T10:52:09.225 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling cephadm module... 2024-09-10T10:52:09.620 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:09 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/71601810' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T10:52:10.725 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:10 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2431761397' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T10:52:10.725 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:10.725 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:10.725 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:10.605+0000 7ffb1ff8b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:52:10.725 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:10.666+0000 7ffb1ff8b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:52:11.016 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:10.829+0000 7ffb1ff8b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:52:11.016 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:10.902+0000 7ffb1ff8b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.627+0000 7fe5575f8640 1 Processor -- start 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.627+0000 7fe5575f8640 1 -- start start 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.627+0000 7fe5575f8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe550107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.627+0000 7fe5575f8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe550108170 con 0x7fe5501077a0 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.627+0000 7fe555394640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe550107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.627+0000 7fe555394640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe550107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57776/0 (socket says 172.21.15.59:57776) 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.627+0000 7fe555394640 1 -- 172.21.15.59:0/3789009826 learned_addr learned my addr 172.21.15.59:0/3789009826 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.628+0000 7fe555394640 1 -- 172.21.15.59:0/3789009826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe550108950 con 0x7fe5501077a0 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.628+0000 7fe555394640 1 --2- 172.21.15.59:0/3789009826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe550107ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009820 tx=0x7fe54c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1377e533faf232a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:11.024 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe547fff640 1 -- 172.21.15.59:0/3789009826 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54c037070 con 0x7fe5501077a0 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe547fff640 1 -- 172.21.15.59:0/3789009826 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe54c032900 con 0x7fe5501077a0 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe547fff640 1 -- 172.21.15.59:0/3789009826 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54c030850 con 0x7fe5501077a0 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe5575f8640 1 -- 172.21.15.59:0/3789009826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 msgr2=0x7fe550107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe5575f8640 1 --2- 172.21.15.59:0/3789009826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe550107ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009820 tx=0x7fe54c02a270 comp rx=0 tx=0).stop 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe5575f8640 1 -- 172.21.15.59:0/3789009826 shutdown_connections 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe5575f8640 1 --2- 172.21.15.59:0/3789009826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe550107ba0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe5575f8640 1 -- 172.21.15.59:0/3789009826 >> 172.21.15.59:0/3789009826 conn(0x7fe550102fd0 msgr2=0x7fe5501053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe5575f8640 1 -- 172.21.15.59:0/3789009826 shutdown_connections 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.629+0000 7fe5575f8640 1 -- 172.21.15.59:0/3789009826 wait complete. 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.630+0000 7fe5575f8640 1 Processor -- start 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.630+0000 7fe5575f8640 1 -- start start 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.630+0000 7fe5575f8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe55019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.630+0000 7fe5575f8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe55010bd00 con 0x7fe5501077a0 2024-09-10T10:52:11.025 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.630+0000 7fe555394640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe55019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.630+0000 7fe555394640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe55019b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57778/0 (socket says 172.21.15.59:57778) 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.630+0000 7fe555394640 1 -- 172.21.15.59:0/2431761397 learned_addr learned my addr 172.21.15.59:0/2431761397 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.631+0000 7fe555394640 1 -- 172.21.15.59:0/2431761397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55019bc80 con 0x7fe5501077a0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.631+0000 7fe555394640 1 --2- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe55019b740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0097f0 tx=0x7fe54c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.631+0000 7fe5467fc640 1 -- 172.21.15.59:0/2431761397 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54c037040 con 0x7fe5501077a0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.631+0000 7fe5467fc640 1 -- 172.21.15.59:0/2431761397 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe54c040070 con 0x7fe5501077a0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.631+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55019bf10 con 0x7fe5501077a0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.631+0000 7fe5467fc640 1 -- 172.21.15.59:0/2431761397 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54c03a390 con 0x7fe5501077a0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.631+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55019ec00 con 0x7fe5501077a0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.632+0000 7fe5467fc640 1 -- 172.21.15.59:0/2431761397 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fe54c032900 con 0x7fe5501077a0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.632+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55010be80 con 0x7fe5501077a0 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.633+0000 7fe5467fc640 1 --2- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe53c038f70 0x7fe53c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:11.026 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.633+0000 7fe5467fc640 1 -- 172.21.15.59:0/2431761397 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe54c06c070 con 0x7fe5501077a0 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.633+0000 7fe554b93640 1 --2- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe53c038f70 0x7fe53c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.633+0000 7fe554b93640 1 --2- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe53c038f70 0x7fe53c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe5400098c0 tx=0x7fe540006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.638+0000 7fe5467fc640 1 -- 172.21.15.59:0/2431761397 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe54c06bdd0 con 0x7fe5501077a0 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:09.860+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fe55019edd0 con 0x7fe5501077a0 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.448+0000 7fe5467fc640 1 -- 172.21.15.59:0/2431761397 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fe54c03a5e0 con 0x7fe5501077a0 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.450+0000 7fe5467fc640 1 -- 172.21.15.59:0/2431761397 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fe54c032bf0 con 0x7fe5501077a0 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.452+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe53c038f70 msgr2=0x7fe53c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.452+0000 7fe5575f8640 1 --2- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe53c038f70 0x7fe53c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe5400098c0 tx=0x7fe540006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.452+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 msgr2=0x7fe55019b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.452+0000 7fe5575f8640 1 --2- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe55019b740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0097f0 tx=0x7fe54c030d80 comp rx=0 tx=0).stop 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.452+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 shutdown_connections 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.452+0000 7fe5575f8640 1 --2- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7fe53c038f70 0x7fe53c03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:11.027 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.452+0000 7fe5575f8640 1 --2- 172.21.15.59:0/2431761397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5501077a0 0x7fe55019b740 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:11.028 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.452+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 >> 172.21.15.59:0/2431761397 conn(0x7fe550102fd0 msgr2=0x7fe550103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:11.028 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.453+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 shutdown_connections 2024-09-10T10:52:11.028 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:10.453+0000 7fe5575f8640 1 -- 172.21.15.59:0/2431761397 wait complete. 2024-09-10T10:52:11.276 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:11.066+0000 7ffb1ff8b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:52:11.276 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:11.216+0000 7ffb1ff8b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:52:11.559 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:11 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2431761397' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T10:52:11.559 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:11 smithi059 ceph-mon[30978]: mgrmap e5: x(active, since 5s) 2024-09-10T10:52:11.825 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:11.557+0000 7ffb1ff8b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:52:11.825 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:11.622+0000 7ffb1ff8b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:52:11.825 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:11.822+0000 7ffb1ff8b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.448+0000 7f7775eaf640 1 Processor -- start 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.448+0000 7f7775eaf640 1 -- start start 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.449+0000 7f7775eaf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f7770107b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.449+0000 7f7775eaf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7770108100 con 0x7f7770107730 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.449+0000 7f776f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f7770107b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.449+0000 7f776f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f7770107b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57814/0 (socket says 172.21.15.59:57814) 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.449+0000 7f776f7fe640 1 -- 172.21.15.59:0/3487504185 learned_addr learned my addr 172.21.15.59:0/3487504185 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.449+0000 7f776f7fe640 1 -- 172.21.15.59:0/3487504185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7770108930 con 0x7f7770107730 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.450+0000 7f776f7fe640 1 --2- 172.21.15.59:0/3487504185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f7770107b30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7760009820 tx=0x7f776002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76d4330eefb4f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.451+0000 7f776e7fc640 1 -- 172.21.15.59:0/3487504185 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7760037070 con 0x7f7770107730 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.452+0000 7f776e7fc640 1 -- 172.21.15.59:0/3487504185 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7760032900 con 0x7f7770107730 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.452+0000 7f776e7fc640 1 -- 172.21.15.59:0/3487504185 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7760030850 con 0x7f7770107730 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.452+0000 7f7775eaf640 1 -- 172.21.15.59:0/3487504185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 msgr2=0x7f7770107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.452+0000 7f7775eaf640 1 --2- 172.21.15.59:0/3487504185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f7770107b30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7760009820 tx=0x7f776002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.453+0000 7f7775eaf640 1 -- 172.21.15.59:0/3487504185 shutdown_connections 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.453+0000 7f7775eaf640 1 --2- 172.21.15.59:0/3487504185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f7770107b30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.453+0000 7f7775eaf640 1 -- 172.21.15.59:0/3487504185 >> 172.21.15.59:0/3487504185 conn(0x7f7770102ec0 msgr2=0x7f7770105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.453+0000 7f7775eaf640 1 -- 172.21.15.59:0/3487504185 shutdown_connections 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.453+0000 7f7775eaf640 1 -- 172.21.15.59:0/3487504185 wait complete. 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.453+0000 7f7775eaf640 1 Processor -- start 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.454+0000 7f7775eaf640 1 -- start start 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.454+0000 7f7775eaf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f777019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.454+0000 7f7775eaf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f777010bce0 con 0x7f7770107730 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.454+0000 7f776f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f777019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.454+0000 7f776f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f777019b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57816/0 (socket says 172.21.15.59:57816) 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.454+0000 7f776f7fe640 1 -- 172.21.15.59:0/2783542333 learned_addr learned my addr 172.21.15.59:0/2783542333 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.454+0000 7f776f7fe640 1 -- 172.21.15.59:0/2783542333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777019bca0 con 0x7f7770107730 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.455+0000 7f776f7fe640 1 --2- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f777019b760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f77600097f0 tx=0x7f7760030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.455+0000 7f776cff9640 1 -- 172.21.15.59:0/2783542333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7760037040 con 0x7f7770107730 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.455+0000 7f776cff9640 1 -- 172.21.15.59:0/2783542333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7760040070 con 0x7f7770107730 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.455+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777019bf30 con 0x7f7770107730 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.455+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777019ec20 con 0x7f7770107730 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.455+0000 7f776cff9640 1 -- 172.21.15.59:0/2783542333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f776003a390 con 0x7f7770107730 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.456+0000 7f776cff9640 1 -- 172.21.15.59:0/2783542333 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f776003a5e0 con 0x7f7770107730 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.456+0000 7f776cff9640 1 --2- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f7758038fc0 0x7f775803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.456+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770107bb0 con 0x7f7770107730 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.456+0000 7f776effd640 1 -- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f7758038fc0 msgr2=0x7f775803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3094540037 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.456+0000 7f776cff9640 1 -- 172.21.15.59:0/2783542333 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f776006c110 con 0x7f7770107730 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.456+0000 7f776effd640 1 --2- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f7758038fc0 0x7f775803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.465+0000 7f776cff9640 1 -- 172.21.15.59:0/2783542333 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f776003ede0 con 0x7f7770107730 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.657+0000 7f776effd640 1 -- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f7758038fc0 msgr2=0x7f775803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3094540037 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.657+0000 7f776effd640 1 --2- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f7758038fc0 0x7f775803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.688+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f777019f2f0 con 0x7f7770107730 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.689+0000 7f776cff9640 1 -- 172.21.15.59:0/2783542333 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f776006be70 con 0x7f7770107730 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f7758038fc0 msgr2=0x7f775803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 --2- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f7758038fc0 0x7f775803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 msgr2=0x7f777019b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 --2- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f777019b760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f77600097f0 tx=0x7f7760030d80 comp rx=0 tx=0).stop 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 shutdown_connections 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 --2- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f7758038fc0 0x7f775803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 --2- 172.21.15.59:0/2783542333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7770107730 0x7f777019b760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 >> 172.21.15.59:0/2783542333 conn(0x7f7770102ec0 msgr2=0x7f7770103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 shutdown_connections 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:11.691+0000 7f7775eaf640 1 -- 172.21.15.59:0/2783542333 wait complete. 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for the mgr to restart... 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr epoch 5... 2024-09-10T10:52:12.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:12 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2783542333' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T10:52:12.945 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:12.762+0000 7ffb1ff8b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:52:12.945 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:12.833+0000 7ffb1ff8b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:52:13.638 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:13.583+0000 7ffb1ff8b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:52:14.075 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:13.704+0000 7ffb1ff8b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:52:14.075 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:13.853+0000 7ffb1ff8b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:52:14.076 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:13.917+0000 7ffb1ff8b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:52:14.076 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:14.073+0000 7ffb1ff8b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:52:14.375 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:14.144+0000 7ffb1ff8b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:52:14.375 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:14.208+0000 7ffb1ff8b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:52:14.376 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:14.373+0000 7ffb1ff8b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:52:14.638 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:14.441+0000 7ffb1ff8b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:52:14.638 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:14.511+0000 7ffb1ff8b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:52:14.638 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:14.598+0000 7ffb1ff8b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:52:15.138 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:14.660+0000 7ffb1ff8b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:52:15.138 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:14.722+0000 7ffb1ff8b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:52:15.887 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:15.551+0000 7ffb1ff8b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:52:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: Active manager daemon x restarted 2024-09-10T10:52:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: Activating manager daemon x 2024-09-10T10:52:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T10:52:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: mgrmap e6: x(active, starting, since 0.00331752s) 2024-09-10T10:52:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:52:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:52:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:52:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:52:15.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:52:15.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: Manager daemon x is now available 2024-09-10T10:52:15.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:15.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:15.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:52:15.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:52:15.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:52:15.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:15 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:52:16.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:16 smithi059 ceph-mon[30978]: Found migration_current of "None". Setting to last migration. 2024-09-10T10:52:16.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:16 smithi059 ceph-mon[30978]: mgrmap e7: x(active, since 1.00572s) 2024-09-10T10:52:17.130 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.737+0000 7f514b981640 1 Processor -- start 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.737+0000 7f514b981640 1 -- start start 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.737+0000 7f514b981640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514410a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.737+0000 7f514b981640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f514407bdb0 con 0x7f5144108230 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.737+0000 7f514971d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514410a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.737+0000 7f514971d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514410a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57828/0 (socket says 172.21.15.59:57828) 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.737+0000 7f514971d640 1 -- 172.21.15.59:0/3595902550 learned_addr learned my addr 172.21.15.59:0/3595902550 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:17.131 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.738+0000 7f514971d640 1 -- 172.21.15.59:0/3595902550 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514410ab60 con 0x7f5144108230 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.738+0000 7f514971d640 1 --2- 172.21.15.59:0/3595902550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514410a620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5140009820 tx=0x7f514002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ca74bf744410bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.738+0000 7f513bfff640 1 -- 172.21.15.59:0/3595902550 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5140037070 con 0x7f5144108230 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.739+0000 7f513bfff640 1 -- 172.21.15.59:0/3595902550 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5140032900 con 0x7f5144108230 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.739+0000 7f513bfff640 1 -- 172.21.15.59:0/3595902550 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5140030850 con 0x7f5144108230 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.739+0000 7f514b981640 1 -- 172.21.15.59:0/3595902550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 msgr2=0x7f514410a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.739+0000 7f514b981640 1 --2- 172.21.15.59:0/3595902550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514410a620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5140009820 tx=0x7f514002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.739+0000 7f514b981640 1 -- 172.21.15.59:0/3595902550 shutdown_connections 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.739+0000 7f514b981640 1 --2- 172.21.15.59:0/3595902550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514410a620 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.739+0000 7f514b981640 1 -- 172.21.15.59:0/3595902550 >> 172.21.15.59:0/3595902550 conn(0x7f5144101db0 msgr2=0x7f5144104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.739+0000 7f514b981640 1 -- 172.21.15.59:0/3595902550 shutdown_connections 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.739+0000 7f514b981640 1 -- 172.21.15.59:0/3595902550 wait complete. 2024-09-10T10:52:17.132 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.740+0000 7f514b981640 1 Processor -- start 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.740+0000 7f514b981640 1 -- start start 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.740+0000 7f514b981640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514419b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.740+0000 7f514b981640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f514410bae0 con 0x7f5144108230 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.740+0000 7f514971d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514419b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.740+0000 7f514971d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514419b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57840/0 (socket says 172.21.15.59:57840) 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.740+0000 7f514971d640 1 -- 172.21.15.59:0/1685788468 learned_addr learned my addr 172.21.15.59:0/1685788468 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.741+0000 7f514971d640 1 -- 172.21.15.59:0/1685788468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514419bca0 con 0x7f5144108230 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.741+0000 7f514971d640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514419b760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f51400097f0 tx=0x7f5140030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.741+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5140042070 con 0x7f5144108230 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.741+0000 7f514b981640 1 -- 172.21.15.59:0/1685788468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514419bf30 con 0x7f5144108230 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.741+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5140032ca0 con 0x7f5144108230 2024-09-10T10:52:17.133 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.741+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5140037040 con 0x7f5144108230 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.741+0000 7f514b981640 1 -- 172.21.15.59:0/1685788468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514419ec20 con 0x7f5144108230 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.742+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f5140045070 con 0x7f5144108230 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.742+0000 7f513a7fc640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 0x7f513003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.742+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 --> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f513003bb90 con 0x7f5130038fc0 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.742+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f514006bef0 con 0x7f5144108230 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.742+0000 7f5148f1c640 1 -- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 msgr2=0x7f513003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3094540037 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.742+0000 7f5148f1c640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 0x7f513003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.943+0000 7f5148f1c640 1 -- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 msgr2=0x7f513003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3094540037 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:12.943+0000 7f5148f1c640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 0x7f513003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:13.344+0000 7f5148f1c640 1 -- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 msgr2=0x7f513003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3094540037 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:13.344+0000 7f5148f1c640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 0x7f513003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:14.145+0000 7f5148f1c640 1 -- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 msgr2=0x7f513003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3094540037 2024-09-10T10:52:17.134 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:14.145+0000 7f5148f1c640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 0x7f513003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:15.555+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f514006a9b0 con 0x7f5144108230 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:15.555+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 msgr2=0x7f513003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:15.555+0000 7f513a7fc640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 0x7f513003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.556+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f51400313a0 con 0x7f5144108230 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.556+0000 7f513a7fc640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f513003c8f0 0x7f513003ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.556+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5140040e50 con 0x7f513003c8f0 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.556+0000 7f5148f1c640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f513003c8f0 0x7f513003ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.557+0000 7f5148f1c640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f513003c8f0 0x7f513003ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5134003980 tx=0x7f51340092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.558+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 <== mgr.14118 v2:172.21.15.59:6800/3293737690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f5140040e50 con 0x7f513003c8f0 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.565+0000 7f514b981640 1 -- 172.21.15.59:0/1685788468 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f5144108690 con 0x7f513003c8f0 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.565+0000 7f513a7fc640 1 -- 172.21.15.59:0/1685788468 <== mgr.14118 v2:172.21.15.59:6800/3293737690 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f5144108690 con 0x7f513003c8f0 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 -- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f513003c8f0 msgr2=0x7f513003ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:17.135 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f513003c8f0 0x7f513003ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5134003980 tx=0x7f51340092b0 comp rx=0 tx=0).stop 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 -- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 msgr2=0x7f514419b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514419b760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f51400097f0 tx=0x7f5140030ec0 comp rx=0 tx=0).stop 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 -- 172.21.15.59:0/1685788468 shutdown_connections 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f513003c8f0 0x7f513003ece0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:6800/3094540037,v1:172.21.15.59:6801/3094540037] conn(0x7f5130038fc0 0x7f513003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 --2- 172.21.15.59:0/1685788468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5144108230 0x7f514419b760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 -- 172.21.15.59:0/1685788468 >> 172.21.15.59:0/1685788468 conn(0x7f5144101db0 msgr2=0x7f5144102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 -- 172.21.15.59:0/1685788468 shutdown_connections 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:16.566+0000 7f514b981640 1 -- 172.21.15.59:0/1685788468 wait complete. 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:mgr epoch 5 is available 2024-09-10T10:52:17.136 INFO:teuthology.orchestra.run.smithi059.stdout:Setting orchestrator backend to cephadm... 2024-09-10T10:52:18.249 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.509+0000 7f0ff39dd640 1 Processor -- start 2024-09-10T10:52:18.249 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.509+0000 7f0ff39dd640 1 -- start start 2024-09-10T10:52:18.249 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.509+0000 7f0ff39dd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec10a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:18.249 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.509+0000 7f0ff39dd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec07be80 con 0x7f0fec108170 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.509+0000 7f0ff1779640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec10a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.509+0000 7f0ff1779640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec10a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49848/0 (socket says 172.21.15.59:49848) 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.509+0000 7f0ff1779640 1 -- 172.21.15.59:0/3210388862 learned_addr learned my addr 172.21.15.59:0/3210388862 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.510+0000 7f0ff1779640 1 -- 172.21.15.59:0/3210388862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fec10aaa0 con 0x7f0fec108170 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.510+0000 7f0ff1779640 1 --2- 172.21.15.59:0/3210388862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec10a560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009820 tx=0x7f0fe802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e310051cdbcce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.510+0000 7f0fe3fff640 1 -- 172.21.15.59:0/3210388862 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8037070 con 0x7f0fec108170 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.510+0000 7f0fe3fff640 1 -- 172.21.15.59:0/3210388862 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fe8032900 con 0x7f0fec108170 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.510+0000 7f0fe3fff640 1 -- 172.21.15.59:0/3210388862 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8030850 con 0x7f0fec108170 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.511+0000 7f0ff39dd640 1 -- 172.21.15.59:0/3210388862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 msgr2=0x7f0fec10a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.511+0000 7f0ff39dd640 1 --2- 172.21.15.59:0/3210388862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec10a560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009820 tx=0x7f0fe802a270 comp rx=0 tx=0).stop 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.511+0000 7f0ff39dd640 1 -- 172.21.15.59:0/3210388862 shutdown_connections 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.511+0000 7f0ff39dd640 1 --2- 172.21.15.59:0/3210388862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec10a560 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:18.250 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.511+0000 7f0ff39dd640 1 -- 172.21.15.59:0/3210388862 >> 172.21.15.59:0/3210388862 conn(0x7f0fec101db0 msgr2=0x7f0fec1041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.511+0000 7f0ff39dd640 1 -- 172.21.15.59:0/3210388862 shutdown_connections 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.511+0000 7f0ff39dd640 1 -- 172.21.15.59:0/3210388862 wait complete. 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.512+0000 7f0ff39dd640 1 Processor -- start 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.512+0000 7f0ff39dd640 1 -- start start 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.512+0000 7f0ff39dd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec1079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.512+0000 7f0ff39dd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec10bb40 con 0x7f0fec108170 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.512+0000 7f0ff1779640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec1079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.512+0000 7f0ff1779640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec1079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49852/0 (socket says 172.21.15.59:49852) 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.512+0000 7f0ff1779640 1 -- 172.21.15.59:0/233595179 learned_addr learned my addr 172.21.15.59:0/233595179 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.513+0000 7f0ff1779640 1 -- 172.21.15.59:0/233595179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fec107f30 con 0x7f0fec108170 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.513+0000 7f0ff1779640 1 --2- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec1079f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80097f0 tx=0x7f0fe8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.513+0000 7f0fe27fc640 1 -- 172.21.15.59:0/233595179 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8042070 con 0x7f0fec108170 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.513+0000 7f0fe27fc640 1 -- 172.21.15.59:0/233595179 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fe8032ca0 con 0x7f0fec108170 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.513+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fec106120 con 0x7f0fec108170 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.513+0000 7f0fe27fc640 1 -- 172.21.15.59:0/233595179 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8037040 con 0x7f0fec108170 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.513+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fec106660 con 0x7f0fec108170 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.514+0000 7f0fe27fc640 1 -- 172.21.15.59:0/233595179 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f0fe8045070 con 0x7f0fec108170 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.514+0000 7f0fe27fc640 1 --2- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0fd8038e60 0x7f0fd803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.514+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fec1085d0 con 0x7f0fec108170 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.514+0000 7f0fe27fc640 1 -- 172.21.15.59:0/233595179 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0fe806bee0 con 0x7f0fec108170 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.514+0000 7f0ff0f78640 1 --2- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0fd8038e60 0x7f0fd803b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.515+0000 7f0ff0f78640 1 --2- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0fd8038e60 0x7f0fd803b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0098c0 tx=0x7f0fdc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.519+0000 7f0fe27fc640 1 -- 172.21.15.59:0/233595179 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fe8045520 con 0x7f0fec108170 2024-09-10T10:52:18.252 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.710+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f0fec106fb0 con 0x7f0fd8038e60 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.715+0000 7f0fe27fc640 1 -- 172.21.15.59:0/233595179 <== mgr.14118 v2:172.21.15.59:6800/3293737690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0fec106fb0 con 0x7f0fd8038e60 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0fd8038e60 msgr2=0x7f0fd803b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 --2- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0fd8038e60 0x7f0fd803b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0098c0 tx=0x7f0fdc006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 msgr2=0x7f0fec1079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 --2- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec1079f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80097f0 tx=0x7f0fe8030ec0 comp rx=0 tx=0).stop 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 shutdown_connections 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 --2- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0fd8038e60 0x7f0fd803b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 --2- 172.21.15.59:0/233595179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fec108170 0x7f0fec1079f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 >> 172.21.15.59:0/233595179 conn(0x7f0fec101db0 msgr2=0x7f0fec102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 shutdown_connections 2024-09-10T10:52:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:17.718+0000 7f0ff39dd640 1 -- 172.21.15.59:0/233595179 wait complete. 2024-09-10T10:52:18.351 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-mon[30978]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T10:52:18.351 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-mon[30978]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T10:52:18.351 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:18.351 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:18.351 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:18.351 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:52:18.612 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:18.436+0000 7ffa872a5640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:10:52:18] ENGINE Error in HTTPServer.serve 2024-09-10T10:52:18.612 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: Traceback (most recent call last): 2024-09-10T10:52:18.612 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:52:18.612 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self._connections.run(self.expiration_interval) 2024-09-10T10:52:18.612 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:52:18.612 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self._run(expiration_interval) 2024-09-10T10:52:18.612 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:52:18.612 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: s = self.context.wrap_socket( 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: return self.sslsocket_class._create( 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self.do_handshake() 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self._sslobj.do_handshake() 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:52:18.613 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:19.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:19 smithi059 ceph-mon[30978]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:19.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:19 smithi059 ceph-mon[30978]: mgrmap e8: x(active, since 2s) 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:19 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:18] ENGINE Bus STARTING 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:19 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:18] ENGINE Serving on http://172.21.15.59:8765 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:19 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:18] ENGINE Serving on https://172.21.15.59:7150 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:19 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:18] ENGINE Bus STARTED 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:19 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:19 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:18] ENGINE Error in HTTPServer.serve 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout: Traceback (most recent call last): 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:52:19.389 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._run(expiration_interval) 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: s = self.context.wrap_socket( 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: return self.sslsocket_class._create( 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: self.do_handshake() 2024-09-10T10:52:19.390 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:52:19.391 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._sslobj.do_handshake() 2024-09-10T10:52:19.391 INFO:journalctl@ceph.mon.a.smithi059.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.614+0000 7fa09b121640 1 Processor -- start 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.614+0000 7fa09b121640 1 -- start start 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.614+0000 7fa09b121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa094107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.614+0000 7fa09b121640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa094108170 con 0x7fa0941077a0 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.614+0000 7fa098ebd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa094107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.615+0000 7fa098ebd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa094107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49856/0 (socket says 172.21.15.59:49856) 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.615+0000 7fa098ebd640 1 -- 172.21.15.59:0/2137022163 learned_addr learned my addr 172.21.15.59:0/2137022163 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.615+0000 7fa098ebd640 1 -- 172.21.15.59:0/2137022163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa094108950 con 0x7fa0941077a0 2024-09-10T10:52:19.416 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.615+0000 7fa098ebd640 1 --2- 172.21.15.59:0/2137022163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa094107ba0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa084009820 tx=0x7fa08402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cf5e1053166e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa0937fe640 1 -- 172.21.15.59:0/2137022163 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa084037070 con 0x7fa0941077a0 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa0937fe640 1 -- 172.21.15.59:0/2137022163 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa084032900 con 0x7fa0941077a0 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa0937fe640 1 -- 172.21.15.59:0/2137022163 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa084030850 con 0x7fa0941077a0 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa09b121640 1 -- 172.21.15.59:0/2137022163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 msgr2=0x7fa094107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa09b121640 1 --2- 172.21.15.59:0/2137022163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa094107ba0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa084009820 tx=0x7fa08402a270 comp rx=0 tx=0).stop 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa09b121640 1 -- 172.21.15.59:0/2137022163 shutdown_connections 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa09b121640 1 --2- 172.21.15.59:0/2137022163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa094107ba0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa09b121640 1 -- 172.21.15.59:0/2137022163 >> 172.21.15.59:0/2137022163 conn(0x7fa094102fd0 msgr2=0x7fa0941053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa09b121640 1 -- 172.21.15.59:0/2137022163 shutdown_connections 2024-09-10T10:52:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.616+0000 7fa09b121640 1 -- 172.21.15.59:0/2137022163 wait complete. 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.617+0000 7fa09b121640 1 Processor -- start 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.617+0000 7fa09b121640 1 -- start start 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.617+0000 7fa09b121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa09407e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.617+0000 7fa09b121640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa09410bd00 con 0x7fa0941077a0 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.617+0000 7fa098ebd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa09407e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.617+0000 7fa098ebd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa09407e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49860/0 (socket says 172.21.15.59:49860) 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.617+0000 7fa098ebd640 1 -- 172.21.15.59:0/450217330 learned_addr learned my addr 172.21.15.59:0/450217330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.617+0000 7fa098ebd640 1 -- 172.21.15.59:0/450217330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09407e910 con 0x7fa0941077a0 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.618+0000 7fa098ebd640 1 --2- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa09407e3d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0840097f0 tx=0x7fa084030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.618+0000 7fa091ffb640 1 -- 172.21.15.59:0/450217330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa084037040 con 0x7fa0941077a0 2024-09-10T10:52:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.618+0000 7fa091ffb640 1 -- 172.21.15.59:0/450217330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa084040070 con 0x7fa0941077a0 2024-09-10T10:52:19.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.618+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09407cb00 con 0x7fa0941077a0 2024-09-10T10:52:19.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.618+0000 7fa091ffb640 1 -- 172.21.15.59:0/450217330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08403a390 con 0x7fa0941077a0 2024-09-10T10:52:19.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.618+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09407cfe0 con 0x7fa0941077a0 2024-09-10T10:52:19.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.619+0000 7fa091ffb640 1 -- 172.21.15.59:0/450217330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa08403a630 con 0x7fa0941077a0 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.619+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09410be80 con 0x7fa0941077a0 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.619+0000 7fa091ffb640 1 --2- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa080038f70 0x7fa08003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.619+0000 7fa091ffb640 1 -- 172.21.15.59:0/450217330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa08406c600 con 0x7fa0941077a0 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.619+0000 7fa093fff640 1 --2- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa080038f70 0x7fa08003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.620+0000 7fa093fff640 1 --2- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa080038f70 0x7fa08003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00ad30 tx=0x7fa07c0093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.624+0000 7fa091ffb640 1 -- 172.21.15.59:0/450217330 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa084045460 con 0x7fa0941077a0 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.803+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fa09407d890 con 0x7fa080038f70 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.803+0000 7fa091ffb640 1 -- 172.21.15.59:0/450217330 <== mgr.14118 v2:172.21.15.59:6800/3293737690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fa09407d890 con 0x7fa080038f70 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa080038f70 msgr2=0x7fa08003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 --2- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa080038f70 0x7fa08003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00ad30 tx=0x7fa07c0093f0 comp rx=0 tx=0).stop 2024-09-10T10:52:19.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 msgr2=0x7fa09407e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:19.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 --2- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa09407e3d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0840097f0 tx=0x7fa084030d80 comp rx=0 tx=0).stop 2024-09-10T10:52:19.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 shutdown_connections 2024-09-10T10:52:19.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 --2- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa080038f70 0x7fa08003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:19.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 --2- 172.21.15.59:0/450217330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0941077a0 0x7fa09407e3d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:19.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 >> 172.21.15.59:0/450217330 conn(0x7fa094102fd0 msgr2=0x7fa094103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:19.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 shutdown_connections 2024-09-10T10:52:19.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:18.806+0000 7fa09b121640 1 -- 172.21.15.59:0/450217330 wait complete. 2024-09-10T10:52:19.421 INFO:teuthology.orchestra.run.smithi059.stdout:Generating ssh key... 2024-09-10T10:52:20.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-mon[30978]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:20.388 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: Generating public/private rsa key pair. 2024-09-10T10:52:20.389 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: Your identification has been saved in /tmp/tmp5woa_42a/key 2024-09-10T10:52:20.389 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: Your public key has been saved in /tmp/tmp5woa_42a/key.pub 2024-09-10T10:52:20.389 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: The key fingerprint is: 2024-09-10T10:52:20.389 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: SHA256:YGAXluWLGgFTG3qIzj2FFOwVInFhe6hHkBMau8xgLo0 ceph-86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:52:20.389 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: The key's randomart image is: 2024-09-10T10:52:20.389 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: +---[RSA 3072]----+ 2024-09-10T10:52:20.390 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: |.=BOB.=+. | 2024-09-10T10:52:20.390 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: |.**B=B.. | 2024-09-10T10:52:20.390 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: |=.===oo . | 2024-09-10T10:52:20.390 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: |O++ooo o . | 2024-09-10T10:52:20.390 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: |EB.+. . S | 2024-09-10T10:52:20.390 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: |. . .o | 2024-09-10T10:52:20.390 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: | . | 2024-09-10T10:52:20.390 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: | | 2024-09-10T10:52:20.391 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: | | 2024-09-10T10:52:20.391 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: +----[SHA256]-----+ 2024-09-10T10:52:20.779 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.809+0000 7fa2a5dfe640 1 Processor -- start 2024-09-10T10:52:20.779 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.809+0000 7fa2a5dfe640 1 -- start start 2024-09-10T10:52:20.779 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.810+0000 7fa2a5dfe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a010a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:20.779 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.810+0000 7fa2a5dfe640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a007be30 con 0x7fa2a01081b0 2024-09-10T10:52:20.779 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.810+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a010a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.810+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a010a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49874/0 (socket says 172.21.15.59:49874) 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.810+0000 7fa29f7fe640 1 -- 172.21.15.59:0/3667444406 learned_addr learned my addr 172.21.15.59:0/3667444406 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.810+0000 7fa29f7fe640 1 -- 172.21.15.59:0/3667444406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a010aae0 con 0x7fa2a01081b0 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.811+0000 7fa29f7fe640 1 --2- 172.21.15.59:0/3667444406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a010a5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa290009820 tx=0x7fa29002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e99ab84fb320b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.811+0000 7fa29e7fc640 1 -- 172.21.15.59:0/3667444406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa290037070 con 0x7fa2a01081b0 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.811+0000 7fa29e7fc640 1 -- 172.21.15.59:0/3667444406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa290032900 con 0x7fa2a01081b0 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.811+0000 7fa29e7fc640 1 -- 172.21.15.59:0/3667444406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa290030850 con 0x7fa2a01081b0 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.812+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3667444406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 msgr2=0x7fa2a010a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.812+0000 7fa2a5dfe640 1 --2- 172.21.15.59:0/3667444406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a010a5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa290009820 tx=0x7fa29002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.812+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3667444406 shutdown_connections 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.812+0000 7fa2a5dfe640 1 --2- 172.21.15.59:0/3667444406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a010a5a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:20.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.812+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3667444406 >> 172.21.15.59:0/3667444406 conn(0x7fa2a0101db0 msgr2=0x7fa2a0104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.812+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3667444406 shutdown_connections 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.812+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3667444406 wait complete. 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.812+0000 7fa2a5dfe640 1 Processor -- start 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.813+0000 7fa2a5dfe640 1 -- start start 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.813+0000 7fa2a5dfe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a0107a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.813+0000 7fa2a5dfe640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a010bb20 con 0x7fa2a01081b0 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.813+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a0107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.813+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a0107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49880/0 (socket says 172.21.15.59:49880) 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.813+0000 7fa29f7fe640 1 -- 172.21.15.59:0/3733969395 learned_addr learned my addr 172.21.15.59:0/3733969395 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.813+0000 7fa29f7fe640 1 -- 172.21.15.59:0/3733969395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a0107f70 con 0x7fa2a01081b0 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.813+0000 7fa29f7fe640 1 --2- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a0107a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa2900097f0 tx=0x7fa290030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.814+0000 7fa29cff9640 1 -- 172.21.15.59:0/3733969395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa290042070 con 0x7fa2a01081b0 2024-09-10T10:52:20.781 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.814+0000 7fa29cff9640 1 -- 172.21.15.59:0/3733969395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa290032ca0 con 0x7fa2a01081b0 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.814+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a0106160 con 0x7fa2a01081b0 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.814+0000 7fa29cff9640 1 -- 172.21.15.59:0/3733969395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa290037040 con 0x7fa2a01081b0 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.814+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01066a0 con 0x7fa2a01081b0 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.814+0000 7fa29cff9640 1 -- 172.21.15.59:0/3733969395 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa290045070 con 0x7fa2a01081b0 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.815+0000 7fa29cff9640 1 --2- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa288038f70 0x7fa28803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.815+0000 7fa29cff9640 1 -- 172.21.15.59:0/3733969395 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa29006bfb0 con 0x7fa2a01081b0 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.815+0000 7fa29effd640 1 --2- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa288038f70 0x7fa28803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.815+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a0108610 con 0x7fa2a01081b0 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.815+0000 7fa29effd640 1 --2- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa288038f70 0x7fa28803b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2940098c0 tx=0x7fa294006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:20.782 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.820+0000 7fa29cff9640 1 -- 172.21.15.59:0/3733969395 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa290045520 con 0x7fa2a01081b0 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:19.996+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fa2a0106d90 con 0x7fa288038f70 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.221+0000 7fa29cff9640 1 -- 172.21.15.59:0/3733969395 <== mgr.14118 v2:172.21.15.59:6800/3293737690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa2a0106d90 con 0x7fa288038f70 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.222+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa288038f70 msgr2=0x7fa28803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.223+0000 7fa2a5dfe640 1 --2- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa288038f70 0x7fa28803b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2940098c0 tx=0x7fa294006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.223+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 msgr2=0x7fa2a0107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.223+0000 7fa2a5dfe640 1 --2- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a0107a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa2900097f0 tx=0x7fa290030ec0 comp rx=0 tx=0).stop 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.223+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 shutdown_connections 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.223+0000 7fa2a5dfe640 1 --2- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa288038f70 0x7fa28803b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.223+0000 7fa2a5dfe640 1 --2- 172.21.15.59:0/3733969395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a01081b0 0x7fa2a0107a30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.223+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 >> 172.21.15.59:0/3733969395 conn(0x7fa2a0101db0 msgr2=0x7fa2a0102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.223+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 shutdown_connections 2024-09-10T10:52:20.783 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:20.223+0000 7fa2a5dfe640 1 -- 172.21.15.59:0/3733969395 wait complete. 2024-09-10T10:52:21.635 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:21 smithi059 ceph-mon[30978]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:21.635 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:21 smithi059 ceph-mon[30978]: Generating ssh key... 2024-09-10T10:52:21.635 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:21 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:21.636 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:21 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:21.902 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjtOhPzQbo3yZQdbKGZ1FkPJoXj+fyuUYrbvWWo2JHvSvo5aAa+hiNPrcal7xyXth2KUKLUc9zCCLupArCN/TDHabIc+4yQhoMOTiNXg5Mzmf4vZhHwRgVkIpj4JxUBg9UVxIW/Si2GW68ndBnO1TTDl1mMq4D3b2deWIrHTT3eNn0Xd7aI/SKkBu/vImuqZtVNFp4DDOrvx/+lBiVBLzfcyXg/b7QMG86plgXWqc2TcJw1BjTwyRXs/CDv3xdUWGsRDrIbGpRSLje9KlBz1ISLOjB9SxtVBhB8IfSwciCYPVFt5fMFw24oVQnIy6biStr3mfB6zcJPWL4QzYhWfXvixdB+wBEAESqHLGSCPuHsKIR8L5zWctzghCO2rCcfhdNrhimnn8o98shM809kwLQjqX3RV1KLp8vTgPi26r2LGJPsjy2Ch3EP2uSGJ80tuKnR0V85sO+0DEkLBoxUuReXVaCh+1Y57pOY69iCtxmChcydIZTHQ1a+axCFqt+mXs= ceph-86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:52:21.902 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.137+0000 7fa64b5c8640 1 Processor -- start 2024-09-10T10:52:21.902 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.137+0000 7fa64b5c8640 1 -- start start 2024-09-10T10:52:21.902 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.137+0000 7fa64b5c8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa644107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:21.902 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.137+0000 7fa64b5c8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa644108170 con 0x7fa6441077a0 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.137+0000 7fa649364640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa644107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.137+0000 7fa649364640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa644107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49886/0 (socket says 172.21.15.59:49886) 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.137+0000 7fa649364640 1 -- 172.21.15.59:0/1466307235 learned_addr learned my addr 172.21.15.59:0/1466307235 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.137+0000 7fa649364640 1 -- 172.21.15.59:0/1466307235 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa644108950 con 0x7fa6441077a0 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.138+0000 7fa649364640 1 --2- 172.21.15.59:0/1466307235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa644107ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009820 tx=0x7fa63c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07c8ccac00fd94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.138+0000 7fa643fff640 1 -- 172.21.15.59:0/1466307235 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63c037070 con 0x7fa6441077a0 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.138+0000 7fa643fff640 1 -- 172.21.15.59:0/1466307235 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa63c032900 con 0x7fa6441077a0 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.138+0000 7fa643fff640 1 -- 172.21.15.59:0/1466307235 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63c030850 con 0x7fa6441077a0 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.139+0000 7fa64b5c8640 1 -- 172.21.15.59:0/1466307235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 msgr2=0x7fa644107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.139+0000 7fa64b5c8640 1 --2- 172.21.15.59:0/1466307235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa644107ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009820 tx=0x7fa63c02a270 comp rx=0 tx=0).stop 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.139+0000 7fa64b5c8640 1 -- 172.21.15.59:0/1466307235 shutdown_connections 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.139+0000 7fa64b5c8640 1 --2- 172.21.15.59:0/1466307235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa644107ba0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:21.903 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.139+0000 7fa64b5c8640 1 -- 172.21.15.59:0/1466307235 >> 172.21.15.59:0/1466307235 conn(0x7fa644102fd0 msgr2=0x7fa6441053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.139+0000 7fa64b5c8640 1 -- 172.21.15.59:0/1466307235 shutdown_connections 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.139+0000 7fa64b5c8640 1 -- 172.21.15.59:0/1466307235 wait complete. 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa64b5c8640 1 Processor -- start 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa64b5c8640 1 -- start start 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa64b5c8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa64419d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa64b5c8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa64410bd00 con 0x7fa6441077a0 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa649364640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa64419d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa649364640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa64419d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49892/0 (socket says 172.21.15.59:49892) 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa649364640 1 -- 172.21.15.59:0/3136945396 learned_addr learned my addr 172.21.15.59:0/3136945396 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa649364640 1 -- 172.21.15.59:0/3136945396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64419deb0 con 0x7fa6441077a0 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa649364640 1 --2- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa64419d970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009940 tx=0x7fa63c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:21.904 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa6427fc640 1 -- 172.21.15.59:0/3136945396 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63c042070 con 0x7fa6441077a0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa64419e140 con 0x7fa6441077a0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa6427fc640 1 -- 172.21.15.59:0/3136945396 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa63c0308c0 con 0x7fa6441077a0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa6427fc640 1 -- 172.21.15.59:0/3136945396 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63c037040 con 0x7fa6441077a0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6441a0e30 con 0x7fa6441077a0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.141+0000 7fa6427fc640 1 -- 172.21.15.59:0/3136945396 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa63c045070 con 0x7fa6441077a0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.142+0000 7fa6427fc640 1 --2- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa62c038f70 0x7fa62c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.142+0000 7fa6427fc640 1 -- 172.21.15.59:0/3136945396 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa63c06d0b0 con 0x7fa6441077a0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.142+0000 7fa648b63640 1 --2- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa62c038f70 0x7fa62c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.142+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa64410be80 con 0x7fa6441077a0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.142+0000 7fa648b63640 1 --2- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa62c038f70 0x7fa62c03b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa6380098c0 tx=0x7fa638006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.147+0000 7fa6427fc640 1 -- 172.21.15.59:0/3136945396 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa63c03cd90 con 0x7fa6441077a0 2024-09-10T10:52:21.905 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.330+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fa6441041e0 con 0x7fa62c038f70 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.331+0000 7fa6427fc640 1 -- 172.21.15.59:0/3136945396 <== mgr.14118 v2:172.21.15.59:6800/3293737690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fa6441041e0 con 0x7fa62c038f70 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa62c038f70 msgr2=0x7fa62c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 --2- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa62c038f70 0x7fa62c03b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa6380098c0 tx=0x7fa638006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 msgr2=0x7fa64419d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 --2- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa64419d970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009940 tx=0x7fa63c032ce0 comp rx=0 tx=0).stop 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 shutdown_connections 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 --2- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fa62c038f70 0x7fa62c03b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 --2- 172.21.15.59:0/3136945396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6441077a0 0x7fa64419d970 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 >> 172.21.15.59:0/3136945396 conn(0x7fa644102fd0 msgr2=0x7fa644103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 shutdown_connections 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:21.333+0000 7fa64b5c8640 1 -- 172.21.15.59:0/3136945396 wait complete. 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:52:21.906 INFO:teuthology.orchestra.run.smithi059.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T10:52:21.908 INFO:teuthology.orchestra.run.smithi059.stdout:Adding host smithi059... 2024-09-10T10:52:22.493 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:22 smithi059 ceph-mon[30978]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:23.537 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:23 smithi059 ceph-mon[30978]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi059", "addr": "172.21.15.59", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:24.748 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:24 smithi059 ceph-mon[30978]: Deploying cephadm binary to smithi059 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Added host 'smithi059' with addr '172.21.15.59' 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.303+0000 7f1a75324640 1 Processor -- start 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.303+0000 7f1a75324640 1 -- start start 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.303+0000 7f1a75324640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a70107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.303+0000 7f1a75324640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70108170 con 0x7f1a701077a0 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.303+0000 7f1a6effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a70107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.303+0000 7f1a6effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a70107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49894/0 (socket says 172.21.15.59:49894) 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.303+0000 7f1a6effd640 1 -- 172.21.15.59:0/1744120086 learned_addr learned my addr 172.21.15.59:0/1744120086 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.304+0000 7f1a6effd640 1 -- 172.21.15.59:0/1744120086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a70108950 con 0x7f1a701077a0 2024-09-10T10:52:26.926 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.304+0000 7f1a6effd640 1 --2- 172.21.15.59:0/1744120086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a70107ba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009820 tx=0x7f1a6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee77fbd7d4921b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a6dffb640 1 -- 172.21.15.59:0/1744120086 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a60037070 con 0x7f1a701077a0 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a6dffb640 1 -- 172.21.15.59:0/1744120086 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a60032900 con 0x7f1a701077a0 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a6dffb640 1 -- 172.21.15.59:0/1744120086 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a60030850 con 0x7f1a701077a0 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a75324640 1 -- 172.21.15.59:0/1744120086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 msgr2=0x7f1a70107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a75324640 1 --2- 172.21.15.59:0/1744120086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a70107ba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009820 tx=0x7f1a6002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a75324640 1 -- 172.21.15.59:0/1744120086 shutdown_connections 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a75324640 1 --2- 172.21.15.59:0/1744120086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a70107ba0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a75324640 1 -- 172.21.15.59:0/1744120086 >> 172.21.15.59:0/1744120086 conn(0x7f1a70102fd0 msgr2=0x7f1a701053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a75324640 1 -- 172.21.15.59:0/1744120086 shutdown_connections 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.305+0000 7f1a75324640 1 -- 172.21.15.59:0/1744120086 wait complete. 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.306+0000 7f1a75324640 1 Processor -- start 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.306+0000 7f1a75324640 1 -- start start 2024-09-10T10:52:26.927 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.306+0000 7f1a75324640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a7019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.306+0000 7f1a75324640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7010bd00 con 0x7f1a701077a0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.306+0000 7f1a6effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a7019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.306+0000 7f1a6effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a7019b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49904/0 (socket says 172.21.15.59:49904) 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.306+0000 7f1a6effd640 1 -- 172.21.15.59:0/4284717645 learned_addr learned my addr 172.21.15.59:0/4284717645 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.307+0000 7f1a6effd640 1 -- 172.21.15.59:0/4284717645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7019bc80 con 0x7f1a701077a0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.307+0000 7f1a6effd640 1 --2- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a7019b740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009940 tx=0x7f1a60032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.307+0000 7f1a57fff640 1 -- 172.21.15.59:0/4284717645 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a60042070 con 0x7f1a701077a0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.307+0000 7f1a57fff640 1 -- 172.21.15.59:0/4284717645 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a600308c0 con 0x7f1a701077a0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.307+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7019bf10 con 0x7f1a701077a0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.307+0000 7f1a57fff640 1 -- 172.21.15.59:0/4284717645 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a60037040 con 0x7f1a701077a0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.307+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a7019ec00 con 0x7f1a701077a0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.308+0000 7f1a57fff640 1 -- 172.21.15.59:0/4284717645 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1a60045070 con 0x7f1a701077a0 2024-09-10T10:52:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.308+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7010be80 con 0x7f1a701077a0 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.308+0000 7f1a57fff640 1 --2- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f1a58038f70 0x7f1a5803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.308+0000 7f1a57fff640 1 -- 172.21.15.59:0/4284717645 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1a6006c130 con 0x7f1a701077a0 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.308+0000 7f1a6e7fc640 1 --2- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f1a58038f70 0x7f1a5803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.309+0000 7f1a6e7fc640 1 --2- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f1a58038f70 0x7f1a5803b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1a640098c0 tx=0x7f1a64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.313+0000 7f1a57fff640 1 -- 172.21.15.59:0/4284717645 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a6006ba80 con 0x7f1a701077a0 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:22.493+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi059", "addr": "172.21.15.59", "target": ["mon-mgr", ""]}) -- 0x7f1a70104240 con 0x7f1a58038f70 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.394+0000 7f1a57fff640 1 -- 172.21.15.59:0/4284717645 <== mgr.14118 v2:172.21.15.59:6800/3293737690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f1a70104240 con 0x7f1a58038f70 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.397+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f1a58038f70 msgr2=0x7f1a5803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.397+0000 7f1a75324640 1 --2- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f1a58038f70 0x7f1a5803b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1a640098c0 tx=0x7f1a64006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.397+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 msgr2=0x7f1a7019b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.397+0000 7f1a75324640 1 --2- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a7019b740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009940 tx=0x7f1a60032ce0 comp rx=0 tx=0).stop 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.398+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 shutdown_connections 2024-09-10T10:52:26.929 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.398+0000 7f1a75324640 1 --2- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f1a58038f70 0x7f1a5803b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:26.930 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.398+0000 7f1a75324640 1 --2- 172.21.15.59:0/4284717645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a701077a0 0x7f1a7019b740 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:26.930 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.398+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 >> 172.21.15.59:0/4284717645 conn(0x7f1a70102fd0 msgr2=0x7f1a70103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:26.930 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.398+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 shutdown_connections 2024-09-10T10:52:26.930 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:26.398+0000 7f1a75324640 1 -- 172.21.15.59:0/4284717645 wait complete. 2024-09-10T10:52:26.930 INFO:teuthology.orchestra.run.smithi059.stdout:Deploying unmanaged mon service... 2024-09-10T10:52:27.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:27 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:27.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:27 smithi059 ceph-mon[30978]: Added host smithi059 2024-09-10T10:52:27.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:27 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:52:28.351 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.321+0000 7fb651413640 1 Processor -- start 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.321+0000 7fb651413640 1 -- start start 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.321+0000 7fb651413640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.321+0000 7fb651413640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c108170 con 0x7fb64c1077a0 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.321+0000 7fb64affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.321+0000 7fb64affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49402/0 (socket says 172.21.15.59:49402) 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.321+0000 7fb64affd640 1 -- 172.21.15.59:0/2668264461 learned_addr learned my addr 172.21.15.59:0/2668264461 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.321+0000 7fb64affd640 1 -- 172.21.15.59:0/2668264461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c108950 con 0x7fb64c1077a0 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.322+0000 7fb64affd640 1 --2- 172.21.15.59:0/2668264461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c107ba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009820 tx=0x7fb63c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fdf05a77692644 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb649ffb640 1 -- 172.21.15.59:0/2668264461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63c037070 con 0x7fb64c1077a0 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb649ffb640 1 -- 172.21.15.59:0/2668264461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb63c032900 con 0x7fb64c1077a0 2024-09-10T10:52:28.352 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb649ffb640 1 -- 172.21.15.59:0/2668264461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63c030850 con 0x7fb64c1077a0 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb651413640 1 -- 172.21.15.59:0/2668264461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 msgr2=0x7fb64c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb651413640 1 --2- 172.21.15.59:0/2668264461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c107ba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009820 tx=0x7fb63c02a270 comp rx=0 tx=0).stop 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb651413640 1 -- 172.21.15.59:0/2668264461 shutdown_connections 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb651413640 1 --2- 172.21.15.59:0/2668264461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c107ba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb651413640 1 -- 172.21.15.59:0/2668264461 >> 172.21.15.59:0/2668264461 conn(0x7fb64c102fd0 msgr2=0x7fb64c1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb651413640 1 -- 172.21.15.59:0/2668264461 shutdown_connections 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.323+0000 7fb651413640 1 -- 172.21.15.59:0/2668264461 wait complete. 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.324+0000 7fb651413640 1 Processor -- start 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.324+0000 7fb651413640 1 -- start start 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.324+0000 7fb651413640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c07e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.324+0000 7fb651413640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c10bd00 con 0x7fb64c1077a0 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.324+0000 7fb64affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c07e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:28.353 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.324+0000 7fb64affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c07e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49404/0 (socket says 172.21.15.59:49404) 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.324+0000 7fb64affd640 1 -- 172.21.15.59:0/953059963 learned_addr learned my addr 172.21.15.59:0/953059963 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.325+0000 7fb64affd640 1 -- 172.21.15.59:0/953059963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c07e910 con 0x7fb64c1077a0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.325+0000 7fb64affd640 1 --2- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c07e3d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097f0 tx=0x7fb63c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.325+0000 7fb633fff640 1 -- 172.21.15.59:0/953059963 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63c037040 con 0x7fb64c1077a0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.325+0000 7fb633fff640 1 -- 172.21.15.59:0/953059963 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb63c040070 con 0x7fb64c1077a0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.325+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64c07cb00 con 0x7fb64c1077a0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.325+0000 7fb633fff640 1 -- 172.21.15.59:0/953059963 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63c03a390 con 0x7fb64c1077a0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.325+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64c07cfe0 con 0x7fb64c1077a0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.326+0000 7fb633fff640 1 -- 172.21.15.59:0/953059963 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb63c03a630 con 0x7fb64c1077a0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.326+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64c10be80 con 0x7fb64c1077a0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.326+0000 7fb633fff640 1 --2- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fb634038f70 0x7fb63403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.326+0000 7fb633fff640 1 -- 172.21.15.59:0/953059963 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb63c06c810 con 0x7fb64c1077a0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.326+0000 7fb64a7fc640 1 --2- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fb634038f70 0x7fb63403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:28.354 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.327+0000 7fb64a7fc640 1 --2- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fb634038f70 0x7fb63403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb6400098c0 tx=0x7fb640006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.331+0000 7fb633fff640 1 -- 172.21.15.59:0/953059963 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb63c04a200 con 0x7fb64c1077a0 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.534+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fb64c07d890 con 0x7fb634038f70 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.538+0000 7fb633fff640 1 -- 172.21.15.59:0/953059963 <== mgr.14118 v2:172.21.15.59:6800/3293737690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb64c07d890 con 0x7fb634038f70 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fb634038f70 msgr2=0x7fb63403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 --2- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fb634038f70 0x7fb63403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb6400098c0 tx=0x7fb640006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 msgr2=0x7fb64c07e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 --2- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c07e3d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097f0 tx=0x7fb63c030d80 comp rx=0 tx=0).stop 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 shutdown_connections 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 --2- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fb634038f70 0x7fb63403b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 --2- 172.21.15.59:0/953059963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb64c1077a0 0x7fb64c07e3d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 >> 172.21.15.59:0/953059963 conn(0x7fb64c102fd0 msgr2=0x7fb64c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 shutdown_connections 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:27.541+0000 7fb651413640 1 -- 172.21.15.59:0/953059963 wait complete. 2024-09-10T10:52:28.355 INFO:teuthology.orchestra.run.smithi059.stdout:Deploying unmanaged mgr service... 2024-09-10T10:52:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:28 smithi059 ceph-mon[30978]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:28 smithi059 ceph-mon[30978]: Saving service mon spec with placement count:5 2024-09-10T10:52:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:28 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:29.571 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T10:52:29.571 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.751+0000 7f3807d0f640 1 Processor -- start 2024-09-10T10:52:29.571 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.751+0000 7f3807d0f640 1 -- start start 2024-09-10T10:52:29.571 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.751+0000 7f3807d0f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f3800107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:29.571 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.751+0000 7f3807d0f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3800108170 con 0x7f38001077a0 2024-09-10T10:52:29.571 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.751+0000 7f3805aab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f3800107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:29.571 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.751+0000 7f3805aab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f3800107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49414/0 (socket says 172.21.15.59:49414) 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.751+0000 7f3805aab640 1 -- 172.21.15.59:0/1680695145 learned_addr learned my addr 172.21.15.59:0/1680695145 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.752+0000 7f3805aab640 1 -- 172.21.15.59:0/1680695145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3800108950 con 0x7f38001077a0 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.752+0000 7f3805aab640 1 --2- 172.21.15.59:0/1680695145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f3800107ba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009820 tx=0x7f37fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a04863315fca925 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3804aa9640 1 -- 172.21.15.59:0/1680695145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc037070 con 0x7f38001077a0 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3804aa9640 1 -- 172.21.15.59:0/1680695145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37fc032900 con 0x7f38001077a0 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3804aa9640 1 -- 172.21.15.59:0/1680695145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc030850 con 0x7f38001077a0 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3807d0f640 1 -- 172.21.15.59:0/1680695145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 msgr2=0x7f3800107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3807d0f640 1 --2- 172.21.15.59:0/1680695145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f3800107ba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009820 tx=0x7f37fc02a270 comp rx=0 tx=0).stop 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3807d0f640 1 -- 172.21.15.59:0/1680695145 shutdown_connections 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3807d0f640 1 --2- 172.21.15.59:0/1680695145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f3800107ba0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3807d0f640 1 -- 172.21.15.59:0/1680695145 >> 172.21.15.59:0/1680695145 conn(0x7f3800102fd0 msgr2=0x7f38001053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3807d0f640 1 -- 172.21.15.59:0/1680695145 shutdown_connections 2024-09-10T10:52:29.572 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.753+0000 7f3807d0f640 1 -- 172.21.15.59:0/1680695145 wait complete. 2024-09-10T10:52:29.573 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.754+0000 7f3807d0f640 1 Processor -- start 2024-09-10T10:52:29.573 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.754+0000 7f3807d0f640 1 -- start start 2024-09-10T10:52:29.573 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.754+0000 7f3807d0f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f380019d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:29.573 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.754+0000 7f3807d0f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f380010bd00 con 0x7f38001077a0 2024-09-10T10:52:29.573 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.754+0000 7f3805aab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f380019d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:29.573 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.754+0000 7f3805aab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f380019d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49420/0 (socket says 172.21.15.59:49420) 2024-09-10T10:52:29.573 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.754+0000 7f3805aab640 1 -- 172.21.15.59:0/3726729092 learned_addr learned my addr 172.21.15.59:0/3726729092 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:29.573 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.755+0000 7f3805aab640 1 -- 172.21.15.59:0/3726729092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380019de80 con 0x7f38001077a0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.755+0000 7f3805aab640 1 --2- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f380019d940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0097f0 tx=0x7f37fc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.755+0000 7f37f6ffd640 1 -- 172.21.15.59:0/3726729092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc037040 con 0x7f38001077a0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.755+0000 7f37f6ffd640 1 -- 172.21.15.59:0/3726729092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37fc040070 con 0x7f38001077a0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.755+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380019e110 con 0x7f38001077a0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.755+0000 7f37f6ffd640 1 -- 172.21.15.59:0/3726729092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc03a390 con 0x7f38001077a0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.755+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38001a0e00 con 0x7f38001077a0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.756+0000 7f37f6ffd640 1 -- 172.21.15.59:0/3726729092 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f37fc032900 con 0x7f38001077a0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.756+0000 7f37f6ffd640 1 --2- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f37ec038fc0 0x7f37ec03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.756+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3800107c20 con 0x7f38001077a0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.756+0000 7f37f6ffd640 1 -- 172.21.15.59:0/3726729092 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f37fc06c400 con 0x7f38001077a0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.756+0000 7f38052aa640 1 --2- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f37ec038fc0 0x7f37ec03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.757+0000 7f38052aa640 1 --2- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f37ec038fc0 0x7f37ec03b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f37f00098c0 tx=0x7f37f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.761+0000 7f37f6ffd640 1 -- 172.21.15.59:0/3726729092 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37fc06b5b0 con 0x7f38001077a0 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.954+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f38001041f0 con 0x7f37ec038fc0 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.958+0000 7f37f6ffd640 1 -- 172.21.15.59:0/3726729092 <== mgr.14118 v2:172.21.15.59:6800/3293737690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f38001041f0 con 0x7f37ec038fc0 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.960+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f37ec038fc0 msgr2=0x7f37ec03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.960+0000 7f3807d0f640 1 --2- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f37ec038fc0 0x7f37ec03b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f37f00098c0 tx=0x7f37f0006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.960+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 msgr2=0x7f380019d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.960+0000 7f3807d0f640 1 --2- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f380019d940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0097f0 tx=0x7f37fc030d80 comp rx=0 tx=0).stop 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.960+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 shutdown_connections 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.960+0000 7f3807d0f640 1 --2- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f37ec038fc0 0x7f37ec03b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.960+0000 7f3807d0f640 1 --2- 172.21.15.59:0/3726729092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38001077a0 0x7f380019d940 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.960+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 >> 172.21.15.59:0/3726729092 conn(0x7f3800102fd0 msgr2=0x7f3800103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.961+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 shutdown_connections 2024-09-10T10:52:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:28.961+0000 7f3807d0f640 1 -- 172.21.15.59:0/3726729092 wait complete. 2024-09-10T10:52:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:29 smithi059 ceph-mon[30978]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:29 smithi059 ceph-mon[30978]: Saving service mgr spec with placement count:2 2024-09-10T10:52:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:29 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:30.936 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.026+0000 7f5610d68640 1 Processor -- start 2024-09-10T10:52:30.936 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.026+0000 7f5610d68640 1 -- start start 2024-09-10T10:52:30.936 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.027+0000 7f5610d68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:30.936 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.027+0000 7f5610d68640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f560c108170 con 0x7f560c1077a0 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.027+0000 7f560a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.027+0000 7f560a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49424/0 (socket says 172.21.15.59:49424) 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.027+0000 7f560a59c640 1 -- 172.21.15.59:0/2620286049 learned_addr learned my addr 172.21.15.59:0/2620286049 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.027+0000 7f560a59c640 1 -- 172.21.15.59:0/2620286049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c108950 con 0x7f560c1077a0 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.028+0000 7f560a59c640 1 --2- 172.21.15.59:0/2620286049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c107ba0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009820 tx=0x7f55fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bcd69e1e6b9ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.028+0000 7f560959a640 1 -- 172.21.15.59:0/2620286049 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc037070 con 0x7f560c1077a0 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.028+0000 7f560959a640 1 -- 172.21.15.59:0/2620286049 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55fc032900 con 0x7f560c1077a0 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.028+0000 7f560959a640 1 -- 172.21.15.59:0/2620286049 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc030850 con 0x7f560c1077a0 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.029+0000 7f5610d68640 1 -- 172.21.15.59:0/2620286049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 msgr2=0x7f560c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.029+0000 7f5610d68640 1 --2- 172.21.15.59:0/2620286049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c107ba0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009820 tx=0x7f55fc02a270 comp rx=0 tx=0).stop 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.029+0000 7f5610d68640 1 -- 172.21.15.59:0/2620286049 shutdown_connections 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.029+0000 7f5610d68640 1 --2- 172.21.15.59:0/2620286049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c107ba0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:30.937 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.029+0000 7f5610d68640 1 -- 172.21.15.59:0/2620286049 >> 172.21.15.59:0/2620286049 conn(0x7f560c102fd0 msgr2=0x7f560c1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.029+0000 7f5610d68640 1 -- 172.21.15.59:0/2620286049 shutdown_connections 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.029+0000 7f5610d68640 1 -- 172.21.15.59:0/2620286049 wait complete. 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.029+0000 7f5610d68640 1 Processor -- start 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.030+0000 7f5610d68640 1 -- start start 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.030+0000 7f5610d68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c19b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.030+0000 7f5610d68640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f560c10bd00 con 0x7f560c1077a0 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.030+0000 7f560a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c19b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.030+0000 7f560a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c19b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49440/0 (socket says 172.21.15.59:49440) 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.030+0000 7f560a59c640 1 -- 172.21.15.59:0/3692213986 learned_addr learned my addr 172.21.15.59:0/3692213986 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.030+0000 7f560a59c640 1 -- 172.21.15.59:0/3692213986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c19bc80 con 0x7f560c1077a0 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.030+0000 7f560a59c640 1 --2- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c19b740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009940 tx=0x7f55fc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.031+0000 7f55fb7fe640 1 -- 172.21.15.59:0/3692213986 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc042070 con 0x7f560c1077a0 2024-09-10T10:52:30.938 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.031+0000 7f55fb7fe640 1 -- 172.21.15.59:0/3692213986 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55fc0308c0 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.031+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560c19bf10 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.031+0000 7f55fb7fe640 1 -- 172.21.15.59:0/3692213986 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc037040 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.031+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560c19ec00 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.031+0000 7f55fb7fe640 1 -- 172.21.15.59:0/3692213986 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f55fc045070 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.032+0000 7f55fb7fe640 1 --2- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f55f4038fc0 0x7f55f403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.032+0000 7f55fb7fe640 1 -- 172.21.15.59:0/3692213986 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f55fc06c360 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.032+0000 7f5609d9b640 1 --2- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f55f4038fc0 0x7f55f403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.032+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560c10be80 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.032+0000 7f5609d9b640 1 --2- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f55f4038fc0 0x7f55f403b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56000098c0 tx=0x7f5600006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.037+0000 7f55fb7fe640 1 -- 172.21.15.59:0/3692213986 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55fc03add0 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.212+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f560c19f150 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.217+0000 7f55fb7fe640 1 -- 172.21.15.59:0/3692213986 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f55fc045520 con 0x7f560c1077a0 2024-09-10T10:52:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f55f4038fc0 msgr2=0x7f55f403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 --2- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f55f4038fc0 0x7f55f403b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56000098c0 tx=0x7f5600006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 msgr2=0x7f560c19b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 --2- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c19b740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009940 tx=0x7f55fc032ce0 comp rx=0 tx=0).stop 2024-09-10T10:52:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 shutdown_connections 2024-09-10T10:52:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 --2- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f55f4038fc0 0x7f55f403b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 --2- 172.21.15.59:0/3692213986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f560c1077a0 0x7f560c19b740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 >> 172.21.15.59:0/3692213986 conn(0x7f560c102fd0 msgr2=0x7f560c103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 shutdown_connections 2024-09-10T10:52:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:30.221+0000 7f5610d68640 1 -- 172.21.15.59:0/3692213986 wait complete. 2024-09-10T10:52:31.330 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:31 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3692213986' entity='client.admin' 2024-09-10T10:52:32.319 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.336+0000 7efff6ed3640 1 Processor -- start 2024-09-10T10:52:32.319 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.336+0000 7efff6ed3640 1 -- start start 2024-09-10T10:52:32.319 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.337+0000 7efff6ed3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff0107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:32.319 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.337+0000 7efff6ed3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efff0108170 con 0x7efff01077a0 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.337+0000 7efff4c6f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff0107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.337+0000 7efff4c6f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff0107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49448/0 (socket says 172.21.15.59:49448) 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.337+0000 7efff4c6f640 1 -- 172.21.15.59:0/81835469 learned_addr learned my addr 172.21.15.59:0/81835469 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.337+0000 7efff4c6f640 1 -- 172.21.15.59:0/81835469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff0108950 con 0x7efff01077a0 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.338+0000 7efff4c6f640 1 --2- 172.21.15.59:0/81835469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff0107ba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effe0009820 tx=0x7effe002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd1ebc8d6575779 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.338+0000 7effef7fe640 1 -- 172.21.15.59:0/81835469 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe0037070 con 0x7efff01077a0 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.338+0000 7effef7fe640 1 -- 172.21.15.59:0/81835469 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effe0032900 con 0x7efff01077a0 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.338+0000 7effef7fe640 1 -- 172.21.15.59:0/81835469 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe0030850 con 0x7efff01077a0 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.339+0000 7efff6ed3640 1 -- 172.21.15.59:0/81835469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 msgr2=0x7efff0107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.339+0000 7efff6ed3640 1 --2- 172.21.15.59:0/81835469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff0107ba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effe0009820 tx=0x7effe002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.339+0000 7efff6ed3640 1 -- 172.21.15.59:0/81835469 shutdown_connections 2024-09-10T10:52:32.320 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.339+0000 7efff6ed3640 1 --2- 172.21.15.59:0/81835469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff0107ba0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.339+0000 7efff6ed3640 1 -- 172.21.15.59:0/81835469 >> 172.21.15.59:0/81835469 conn(0x7efff0102fd0 msgr2=0x7efff01053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.339+0000 7efff6ed3640 1 -- 172.21.15.59:0/81835469 shutdown_connections 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.339+0000 7efff6ed3640 1 -- 172.21.15.59:0/81835469 wait complete. 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.339+0000 7efff6ed3640 1 Processor -- start 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.339+0000 7efff6ed3640 1 -- start start 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7efff6ed3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff019d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7efff6ed3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efff010bd00 con 0x7efff01077a0 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7efff4c6f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff019d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7efff4c6f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff019d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49460/0 (socket says 172.21.15.59:49460) 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7efff4c6f640 1 -- 172.21.15.59:0/1170068905 learned_addr learned my addr 172.21.15.59:0/1170068905 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7efff4c6f640 1 -- 172.21.15.59:0/1170068905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff019deb0 con 0x7efff01077a0 2024-09-10T10:52:32.321 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7efff4c6f640 1 --2- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff019d970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7effe0009940 tx=0x7effe0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7effedffb640 1 -- 172.21.15.59:0/1170068905 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe0042070 con 0x7efff01077a0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7effedffb640 1 -- 172.21.15.59:0/1170068905 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effe00308c0 con 0x7efff01077a0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff019e140 con 0x7efff01077a0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.340+0000 7effedffb640 1 -- 172.21.15.59:0/1170068905 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe0037040 con 0x7efff01077a0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.341+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff01a0e30 con 0x7efff01077a0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.342+0000 7effedffb640 1 -- 172.21.15.59:0/1170068905 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7effe0045070 con 0x7efff01077a0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.342+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff010be80 con 0x7efff01077a0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.342+0000 7effedffb640 1 --2- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7effd8038f70 0x7effd803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.342+0000 7effedffb640 1 -- 172.21.15.59:0/1170068905 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7effe006c040 con 0x7efff01077a0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.342+0000 7effeffff640 1 --2- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7effd8038f70 0x7effd803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.343+0000 7effeffff640 1 --2- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7effd8038f70 0x7effd803b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7effe40098c0 tx=0x7effe4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.347+0000 7effedffb640 1 -- 172.21.15.59:0/1170068905 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7effe003cd90 con 0x7efff01077a0 2024-09-10T10:52:32.322 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.525+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7efff0107c20 con 0x7efff01077a0 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.530+0000 7effedffb640 1 -- 172.21.15.59:0/1170068905 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v7)=0 v7) ==== 130+0+0 (secure 0 0 0) 0x7effe002fd90 con 0x7efff01077a0 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7effd8038f70 msgr2=0x7effd803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 --2- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7effd8038f70 0x7effd803b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7effe40098c0 tx=0x7effe4006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 msgr2=0x7efff019d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 --2- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff019d970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7effe0009940 tx=0x7effe0032ce0 comp rx=0 tx=0).stop 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 shutdown_connections 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 --2- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7effd8038f70 0x7effd803b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 --2- 172.21.15.59:0/1170068905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff01077a0 0x7efff019d970 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 >> 172.21.15.59:0/1170068905 conn(0x7efff0102fd0 msgr2=0x7efff0103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 shutdown_connections 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:31.533+0000 7efff6ed3640 1 -- 172.21.15.59:0/1170068905 wait complete. 2024-09-10T10:52:32.323 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling the dashboard module... 2024-09-10T10:52:32.585 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:32 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1170068905' entity='client.admin' 2024-09-10T10:52:32.586 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:32 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:32.586 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:32 smithi059 ceph-mon[30978]: from='mgr.14118 172.21.15.59:0/2245881429' entity='mgr.x' 2024-09-10T10:52:33.595 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:33 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1910331985' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T10:52:33.888 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:33.888 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:33.888 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:33.697+0000 7f5254a5f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:52:33.888 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:33.756+0000 7f5254a5f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:52:34.164 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:33.912+0000 7f5254a5f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:52:34.164 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:33.981+0000 7f5254a5f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:52:34.164 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:34.135+0000 7f5254a5f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:52:34.172 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.771+0000 7fcca2b68640 1 Processor -- start 2024-09-10T10:52:34.172 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.771+0000 7fcca2b68640 1 -- start start 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.771+0000 7fcca2b68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.771+0000 7fcca2b68640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c108170 con 0x7fcc9c1077a0 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.771+0000 7fcca0904640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.771+0000 7fcca0904640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c107ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49472/0 (socket says 172.21.15.59:49472) 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.771+0000 7fcca0904640 1 -- 172.21.15.59:0/2843854224 learned_addr learned my addr 172.21.15.59:0/2843854224 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.771+0000 7fcca0904640 1 -- 172.21.15.59:0/2843854224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c108950 con 0x7fcc9c1077a0 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.772+0000 7fcca0904640 1 --2- 172.21.15.59:0/2843854224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c107ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009820 tx=0x7fcc9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9032904b926479 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.772+0000 7fcc9b7fe640 1 -- 172.21.15.59:0/2843854224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc90037070 con 0x7fcc9c1077a0 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.772+0000 7fcc9b7fe640 1 -- 172.21.15.59:0/2843854224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc90032920 con 0x7fcc9c1077a0 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.772+0000 7fcc9b7fe640 1 -- 172.21.15.59:0/2843854224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc90030810 con 0x7fcc9c1077a0 2024-09-10T10:52:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.773+0000 7fcca2b68640 1 -- 172.21.15.59:0/2843854224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 msgr2=0x7fcc9c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.773+0000 7fcca2b68640 1 --2- 172.21.15.59:0/2843854224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c107ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009820 tx=0x7fcc9002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.773+0000 7fcca2b68640 1 -- 172.21.15.59:0/2843854224 shutdown_connections 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.773+0000 7fcca2b68640 1 --2- 172.21.15.59:0/2843854224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c107ba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.773+0000 7fcca2b68640 1 -- 172.21.15.59:0/2843854224 >> 172.21.15.59:0/2843854224 conn(0x7fcc9c102fd0 msgr2=0x7fcc9c1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.773+0000 7fcca2b68640 1 -- 172.21.15.59:0/2843854224 shutdown_connections 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.773+0000 7fcca2b68640 1 -- 172.21.15.59:0/2843854224 wait complete. 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.773+0000 7fcca2b68640 1 Processor -- start 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.773+0000 7fcca2b68640 1 -- start start 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcca2b68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c19b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcca2b68640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c10bd00 con 0x7fcc9c1077a0 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcca0904640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c19b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcca0904640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c19b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49480/0 (socket says 172.21.15.59:49480) 2024-09-10T10:52:34.174 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcca0904640 1 -- 172.21.15.59:0/1910331985 learned_addr learned my addr 172.21.15.59:0/1910331985 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcca0904640 1 -- 172.21.15.59:0/1910331985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c19bcb0 con 0x7fcc9c1077a0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcca0904640 1 --2- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c19b770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc90030560 tx=0x7fcc90032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcc99ffb640 1 -- 172.21.15.59:0/1910331985 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc90037040 con 0x7fcc9c1077a0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcc99ffb640 1 -- 172.21.15.59:0/1910331985 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc90040070 con 0x7fcc9c1077a0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcc99ffb640 1 -- 172.21.15.59:0/1910331985 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc9003a740 con 0x7fcc9c1077a0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.774+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9c19bf40 con 0x7fcc9c1077a0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.775+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9c19ec30 con 0x7fcc9c1077a0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.775+0000 7fcc99ffb640 1 -- 172.21.15.59:0/1910331985 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fcc9003bb90 con 0x7fcc9c1077a0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.776+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c10be80 con 0x7fcc9c1077a0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.776+0000 7fcc99ffb640 1 --2- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fcc8c038fc0 0x7fcc8c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.776+0000 7fcc99ffb640 1 -- 172.21.15.59:0/1910331985 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcc9006c540 con 0x7fcc9c1077a0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.776+0000 7fcc9bfff640 1 --2- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fcc8c038fc0 0x7fcc8c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.776+0000 7fcc9bfff640 1 --2- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fcc8c038fc0 0x7fcc8c03b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcc880098c0 tx=0x7fcc88006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:34.175 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:32.780+0000 7fcc99ffb640 1 -- 172.21.15.59:0/1910331985 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc9004a200 con 0x7fcc9c1077a0 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.019+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fcc9c19ee00 con 0x7fcc9c1077a0 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.536+0000 7fcc99ffb640 1 -- 172.21.15.59:0/1910331985 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fcc90031e80 con 0x7fcc9c1077a0 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.538+0000 7fcc99ffb640 1 -- 172.21.15.59:0/1910331985 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fcc9003a8e0 con 0x7fcc9c1077a0 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fcc8c038fc0 msgr2=0x7fcc8c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 --2- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fcc8c038fc0 0x7fcc8c03b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcc880098c0 tx=0x7fcc88006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 msgr2=0x7fcc9c19b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 --2- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c19b770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc90030560 tx=0x7fcc90032670 comp rx=0 tx=0).stop 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 shutdown_connections 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 --2- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fcc8c038fc0 0x7fcc8c03b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 --2- 172.21.15.59:0/1910331985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9c1077a0 0x7fcc9c19b770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:34.177 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 >> 172.21.15.59:0/1910331985 conn(0x7fcc9c102fd0 msgr2=0x7fcc9c103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:34.177 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 shutdown_connections 2024-09-10T10:52:34.177 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:33.539+0000 7fcca2b68640 1 -- 172.21.15.59:0/1910331985 wait complete. 2024-09-10T10:52:34.413 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:34.286+0000 7f5254a5f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:52:34.667 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:34 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1910331985' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T10:52:34.667 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:34 smithi059 ceph-mon[30978]: mgrmap e9: x(active, since 17s) 2024-09-10T10:52:34.668 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:34.629+0000 7f5254a5f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:52:35.137 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:34.698+0000 7f5254a5f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:52:35.137 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:34.896+0000 7f5254a5f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:52:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:52:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T10:52:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T10:52:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T10:52:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T10:52:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.596+0000 7f0f4e1be640 1 Processor -- start 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.596+0000 7f0f4e1be640 1 -- start start 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.596+0000 7f0f4e1be640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.596+0000 7f0f4e1be640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4807be30 con 0x7f0f481081b0 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.596+0000 7f0f477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.596+0000 7f0f477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4810a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49514/0 (socket says 172.21.15.59:49514) 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.596+0000 7f0f477fe640 1 -- 172.21.15.59:0/3448502142 learned_addr learned my addr 172.21.15.59:0/3448502142 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.597+0000 7f0f477fe640 1 -- 172.21.15.59:0/3448502142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4810aae0 con 0x7f0f481081b0 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.597+0000 7f0f477fe640 1 --2- 172.21.15.59:0/3448502142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4810a5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009820 tx=0x7f0f3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7188bab6491318f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.598+0000 7f0f467fc640 1 -- 172.21.15.59:0/3448502142 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f38037070 con 0x7f0f481081b0 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.598+0000 7f0f467fc640 1 -- 172.21.15.59:0/3448502142 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f38032920 con 0x7f0f481081b0 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.598+0000 7f0f467fc640 1 -- 172.21.15.59:0/3448502142 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f38030810 con 0x7f0f481081b0 2024-09-10T10:52:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.599+0000 7f0f4e1be640 1 -- 172.21.15.59:0/3448502142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 msgr2=0x7f0f4810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.599+0000 7f0f4e1be640 1 --2- 172.21.15.59:0/3448502142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4810a5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009820 tx=0x7f0f3802a270 comp rx=0 tx=0).stop 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.599+0000 7f0f4e1be640 1 -- 172.21.15.59:0/3448502142 shutdown_connections 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.599+0000 7f0f4e1be640 1 --2- 172.21.15.59:0/3448502142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4810a5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.599+0000 7f0f4e1be640 1 -- 172.21.15.59:0/3448502142 >> 172.21.15.59:0/3448502142 conn(0x7f0f48101db0 msgr2=0x7f0f48104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.599+0000 7f0f4e1be640 1 -- 172.21.15.59:0/3448502142 shutdown_connections 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.599+0000 7f0f4e1be640 1 -- 172.21.15.59:0/3448502142 wait complete. 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.599+0000 7f0f4e1be640 1 Processor -- start 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f4e1be640 1 -- start start 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f4e1be640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f4e1be640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4810bb60 con 0x7f0f481081b0 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4819b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49524/0 (socket says 172.21.15.59:49524) 2024-09-10T10:52:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f477fe640 1 -- 172.21.15.59:0/2209563887 learned_addr learned my addr 172.21.15.59:0/2209563887 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f477fe640 1 -- 172.21.15.59:0/2209563887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4819bcb0 con 0x7f0f481081b0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f477fe640 1 --2- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4819b770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f38030420 tx=0x7f0f38032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f44ff9640 1 -- 172.21.15.59:0/2209563887 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f38037040 con 0x7f0f481081b0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f44ff9640 1 -- 172.21.15.59:0/2209563887 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f38040070 con 0x7f0f481081b0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.600+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4819bf40 con 0x7f0f481081b0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.601+0000 7f0f44ff9640 1 -- 172.21.15.59:0/2209563887 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f3803a6e0 con 0x7f0f481081b0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.601+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4819ec30 con 0x7f0f481081b0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.601+0000 7f0f44ff9640 1 -- 172.21.15.59:0/2209563887 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f0f3803a990 con 0x7f0f481081b0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.602+0000 7f0f44ff9640 1 --2- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0f30039020 0x7f0f3003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.602+0000 7f0f44ff9640 1 -- 172.21.15.59:0/2209563887 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0f3806c610 con 0x7f0f481081b0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.602+0000 7f0f46ffd640 1 -- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0f30039020 msgr2=0x7f0f3003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3293737690 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.602+0000 7f0f46ffd640 1 --2- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0f30039020 0x7f0f3003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.602+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f48108610 con 0x7f0f481081b0 2024-09-10T10:52:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.607+0000 7f0f44ff9640 1 -- 172.21.15.59:0/2209563887 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f38038280 con 0x7f0f481081b0 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.803+0000 7f0f46ffd640 1 -- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0f30039020 msgr2=0x7f0f3003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3293737690 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.803+0000 7f0f46ffd640 1 --2- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0f30039020 0x7f0f3003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.842+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0f4819f0f0 con 0x7f0f481081b0 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.843+0000 7f0f44ff9640 1 -- 172.21.15.59:0/2209563887 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f0f3802ed40 con 0x7f0f481081b0 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0f30039020 msgr2=0x7f0f3003b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 --2- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0f30039020 0x7f0f3003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 msgr2=0x7f0f4819b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 --2- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4819b770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f38030420 tx=0x7f0f38032670 comp rx=0 tx=0).stop 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 shutdown_connections 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 --2- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7f0f30039020 0x7f0f3003b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 --2- 172.21.15.59:0/2209563887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f481081b0 0x7f0f4819b770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 >> 172.21.15.59:0/2209563887 conn(0x7f0f48101db0 msgr2=0x7f0f48102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 shutdown_connections 2024-09-10T10:52:35.425 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:34.845+0000 7f0f4e1be640 1 -- 172.21.15.59:0/2209563887 wait complete. 2024-09-10T10:52:35.425 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for the mgr to restart... 2024-09-10T10:52:35.425 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr epoch 9... 2024-09-10T10:52:35.740 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:35 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2209563887' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T10:52:36.027 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:35 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:35.839+0000 7f5254a5f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:52:36.027 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:35 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:35.910+0000 7f5254a5f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:52:36.780 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:36 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:36.659+0000 7f5254a5f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:52:36.781 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:36 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:36.779+0000 7f5254a5f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:52:37.137 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:36 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:36.929+0000 7f5254a5f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:52:37.138 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:36 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:36.992+0000 7f5254a5f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:52:37.449 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:37 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:37.148+0000 7f5254a5f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:52:37.449 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:37 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:37.219+0000 7f5254a5f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:52:37.449 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:37 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:37.282+0000 7f5254a5f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:52:37.449 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:37 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:37.448+0000 7f5254a5f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:52:37.735 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:37 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:37.516+0000 7f5254a5f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:52:37.735 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:37 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:37.586+0000 7f5254a5f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:52:37.735 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:37 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:37.672+0000 7f5254a5f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:52:37.735 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:37 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:37.734+0000 7f5254a5f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:52:38.137 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:37 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:37.796+0000 7f5254a5f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:52:38.884 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:38.623+0000 7f5254a5f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:52:38.884 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: Active manager daemon x restarted 2024-09-10T10:52:38.884 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: Activating manager daemon x 2024-09-10T10:52:38.884 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T10:52:38.884 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: mgrmap e10: x(active, starting, since 0.00344985s) 2024-09-10T10:52:38.884 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:52:38.884 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:52:38.884 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:52:38.884 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:52:38.885 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:52:38.885 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: Manager daemon x is now available 2024-09-10T10:52:38.885 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:52:38.885 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:52:38.885 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:52:40.548 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:52:40.548 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T10:52:40.548 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T10:52:40.548 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:52:40.548 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.819+0000 7fca487b6640 1 Processor -- start 2024-09-10T10:52:40.548 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.819+0000 7fca487b6640 1 -- start start 2024-09-10T10:52:40.548 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.820+0000 7fca487b6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca40106420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:40.548 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.820+0000 7fca487b6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fca4007bdb0 con 0x7fca40106020 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.820+0000 7fca46552640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca40106420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.820+0000 7fca46552640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca40106420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49534/0 (socket says 172.21.15.59:49534) 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.820+0000 7fca46552640 1 -- 172.21.15.59:0/1026674791 learned_addr learned my addr 172.21.15.59:0/1026674791 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.820+0000 7fca46552640 1 -- 172.21.15.59:0/1026674791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca40106960 con 0x7fca40106020 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.821+0000 7fca46552640 1 --2- 172.21.15.59:0/1026674791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca40106420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009820 tx=0x7fca3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523df6a27b1fcd6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.822+0000 7fca45550640 1 -- 172.21.15.59:0/1026674791 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c037070 con 0x7fca40106020 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.822+0000 7fca45550640 1 -- 172.21.15.59:0/1026674791 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca3c032920 con 0x7fca40106020 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.822+0000 7fca45550640 1 -- 172.21.15.59:0/1026674791 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c030810 con 0x7fca40106020 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.822+0000 7fca487b6640 1 -- 172.21.15.59:0/1026674791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 msgr2=0x7fca40106420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.822+0000 7fca487b6640 1 --2- 172.21.15.59:0/1026674791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca40106420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009820 tx=0x7fca3c02a270 comp rx=0 tx=0).stop 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.822+0000 7fca487b6640 1 -- 172.21.15.59:0/1026674791 shutdown_connections 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.822+0000 7fca487b6640 1 --2- 172.21.15.59:0/1026674791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca40106420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.549 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.822+0000 7fca487b6640 1 -- 172.21.15.59:0/1026674791 >> 172.21.15.59:0/1026674791 conn(0x7fca40101db0 msgr2=0x7fca40104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.822+0000 7fca487b6640 1 -- 172.21.15.59:0/1026674791 shutdown_connections 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.823+0000 7fca487b6640 1 -- 172.21.15.59:0/1026674791 wait complete. 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.823+0000 7fca487b6640 1 Processor -- start 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.823+0000 7fca487b6640 1 -- start start 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.823+0000 7fca487b6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca4019d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.823+0000 7fca487b6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fca40107920 con 0x7fca40106020 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.823+0000 7fca46552640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca4019d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.823+0000 7fca46552640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca4019d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49542/0 (socket says 172.21.15.59:49542) 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.823+0000 7fca46552640 1 -- 172.21.15.59:0/3622848258 learned_addr learned my addr 172.21.15.59:0/3622848258 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.824+0000 7fca46552640 1 -- 172.21.15.59:0/3622848258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4019dea0 con 0x7fca40106020 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.824+0000 7fca46552640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca4019d960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0097f0 tx=0x7fca3c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.824+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c037040 con 0x7fca40106020 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.824+0000 7fca487b6640 1 -- 172.21.15.59:0/3622848258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4019e130 con 0x7fca40106020 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.824+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca3c030c40 con 0x7fca40106020 2024-09-10T10:52:40.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.824+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca3c03a5d0 con 0x7fca40106020 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.824+0000 7fca487b6640 1 -- 172.21.15.59:0/3622848258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca401a0e20 con 0x7fca40106020 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.825+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fca3c03a810 con 0x7fca40106020 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.825+0000 7fca377fe640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 0x7fca2c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.825+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 --> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fca2c03bb90 con 0x7fca2c038fc0 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.825+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fca3c06c500 con 0x7fca40106020 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.825+0000 7fca45d51640 1 -- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 msgr2=0x7fca2c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3293737690 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:35.825+0000 7fca45d51640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 0x7fca2c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:36.026+0000 7fca45d51640 1 -- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 msgr2=0x7fca2c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3293737690 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:36.026+0000 7fca45d51640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 0x7fca2c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:36.427+0000 7fca45d51640 1 -- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 msgr2=0x7fca2c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3293737690 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:36.427+0000 7fca45d51640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 0x7fca2c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:37.228+0000 7fca45d51640 1 -- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 msgr2=0x7fca2c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3293737690 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:37.228+0000 7fca45d51640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 0x7fca2c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T10:52:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:38.627+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7fca3c06afb0 con 0x7fca40106020 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:38.627+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 msgr2=0x7fca2c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:38.627+0000 7fca377fe640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 0x7fca2c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.628+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fca3c044920 con 0x7fca40106020 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.629+0000 7fca377fe640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fca2c03ca80 0x7fca2c03ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.629+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fca3c03eec0 con 0x7fca2c03ca80 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.629+0000 7fca45d51640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fca2c03ca80 0x7fca2c03ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.630+0000 7fca45d51640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fca2c03ca80 0x7fca2c03ee70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fca30003980 tx=0x7fca30006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.630+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fca3c03eec0 con 0x7fca2c03ca80 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 -- 172.21.15.59:0/3622848258 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fca40107fd0 con 0x7fca2c03ca80 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca377fe640 1 -- 172.21.15.59:0/3622848258 <== mgr.14150 v2:172.21.15.59:6800/3145930564 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fca40107fd0 con 0x7fca2c03ca80 2024-09-10T10:52:40.552 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 -- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fca2c03ca80 msgr2=0x7fca2c03ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fca2c03ca80 0x7fca2c03ee70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fca30003980 tx=0x7fca30006e10 comp rx=0 tx=0).stop 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 -- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 msgr2=0x7fca4019d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca4019d960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0097f0 tx=0x7fca3c0327b0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 -- 172.21.15.59:0/3622848258 shutdown_connections 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fca2c03ca80 0x7fca2c03ee70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:6800/3293737690,v1:172.21.15.59:6801/3293737690] conn(0x7fca2c038fc0 0x7fca2c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 --2- 172.21.15.59:0/3622848258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca40106020 0x7fca4019d960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 -- 172.21.15.59:0/3622848258 >> 172.21.15.59:0/3622848258 conn(0x7fca40101db0 msgr2=0x7fca401945c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 -- 172.21.15.59:0/3622848258 shutdown_connections 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:39.638+0000 7fca487b6640 1 -- 172.21.15.59:0/3622848258 wait complete. 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:mgr epoch 9 is available 2024-09-10T10:52:40.553 INFO:teuthology.orchestra.run.smithi059.stdout:Generating a dashboard self-signed certificate... 2024-09-10T10:52:40.858 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-mon[30978]: mgrmap e11: x(active, since 1.00598s) 2024-09-10T10:52:40.858 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:40] ENGINE Bus STARTING 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:40] ENGINE Serving on http://172.21.15.59:8765 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:40.728+0000 7f51ba528640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:10:52:40] ENGINE Error in HTTPServer.serve 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: Traceback (most recent call last): 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self._connections.run(self.expiration_interval) 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self._run(expiration_interval) 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:52:40.859 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: s = self.context.wrap_socket( 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: return self.sslsocket_class._create( 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self.do_handshake() 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self._sslobj.do_handshake() 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:52:40.860 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:52:40 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:52:41.787 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T10:52:41.787 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.940+0000 7fbe94c06640 1 Processor -- start 2024-09-10T10:52:41.787 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.940+0000 7fbe94c06640 1 -- start start 2024-09-10T10:52:41.787 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.940+0000 7fbe94c06640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:41.787 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.940+0000 7fbe94c06640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe90107010 con 0x7fbe90106640 2024-09-10T10:52:41.787 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.940+0000 7fbe8e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:41.787 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.940+0000 7fbe8e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60310/0 (socket says 172.21.15.59:60310) 2024-09-10T10:52:41.788 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.940+0000 7fbe8e59c640 1 -- 172.21.15.59:0/1498663567 learned_addr learned my addr 172.21.15.59:0/1498663567 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:41.788 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.941+0000 7fbe8e59c640 1 -- 172.21.15.59:0/1498663567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe901077f0 con 0x7fbe90106640 2024-09-10T10:52:41.788 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.941+0000 7fbe8e59c640 1 --2- 172.21.15.59:0/1498663567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90106a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009820 tx=0x7fbe8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43401d053f633e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:41.788 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.942+0000 7fbe8d59a640 1 -- 172.21.15.59:0/1498663567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80037070 con 0x7fbe90106640 2024-09-10T10:52:41.788 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.942+0000 7fbe8d59a640 1 -- 172.21.15.59:0/1498663567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe80032920 con 0x7fbe90106640 2024-09-10T10:52:41.788 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.942+0000 7fbe8d59a640 1 -- 172.21.15.59:0/1498663567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80030810 con 0x7fbe90106640 2024-09-10T10:52:41.788 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.942+0000 7fbe94c06640 1 -- 172.21.15.59:0/1498663567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 msgr2=0x7fbe90106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:41.788 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.942+0000 7fbe94c06640 1 --2- 172.21.15.59:0/1498663567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90106a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009820 tx=0x7fbe8002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.942+0000 7fbe94c06640 1 -- 172.21.15.59:0/1498663567 shutdown_connections 2024-09-10T10:52:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.942+0000 7fbe94c06640 1 --2- 172.21.15.59:0/1498663567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90106a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.942+0000 7fbe94c06640 1 -- 172.21.15.59:0/1498663567 >> 172.21.15.59:0/1498663567 conn(0x7fbe90101db0 msgr2=0x7fbe90104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.943+0000 7fbe94c06640 1 -- 172.21.15.59:0/1498663567 shutdown_connections 2024-09-10T10:52:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.943+0000 7fbe94c06640 1 -- 172.21.15.59:0/1498663567 wait complete. 2024-09-10T10:52:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.943+0000 7fbe94c06640 1 Processor -- start 2024-09-10T10:52:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.943+0000 7fbe94c06640 1 -- start start 2024-09-10T10:52:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe94c06640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90191820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe94c06640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9010aba0 con 0x7fbe90106640 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe8e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90191820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe8e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90191820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60318/0 (socket says 172.21.15.59:60318) 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe8e59c640 1 -- 172.21.15.59:0/296732426 learned_addr learned my addr 172.21.15.59:0/296732426 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe8e59c640 1 -- 172.21.15.59:0/296732426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe90191d60 con 0x7fbe90106640 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe8e59c640 1 --2- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90191820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe80030560 tx=0x7fbe80032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe877fe640 1 -- 172.21.15.59:0/296732426 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80037040 con 0x7fbe90106640 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9018ff50 con 0x7fbe90106640 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe877fe640 1 -- 172.21.15.59:0/296732426 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe80040070 con 0x7fbe90106640 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe877fe640 1 -- 172.21.15.59:0/296732426 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8003a6d0 con 0x7fbe90106640 2024-09-10T10:52:41.790 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.944+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe90190490 con 0x7fbe90106640 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.945+0000 7fbe877fe640 1 -- 172.21.15.59:0/296732426 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fbe8003a870 con 0x7fbe90106640 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.945+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9010ad20 con 0x7fbe90106640 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.946+0000 7fbe877fe640 1 --2- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbe7c038f00 0x7fbe7c03b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.946+0000 7fbe877fe640 1 -- 172.21.15.59:0/296732426 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbe8006c450 con 0x7fbe90106640 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.946+0000 7fbe8dd9b640 1 --2- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbe7c038f00 0x7fbe7c03b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.946+0000 7fbe8dd9b640 1 --2- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbe7c038f00 0x7fbe7c03b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbe780098c0 tx=0x7fbe78006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.951+0000 7fbe877fe640 1 -- 172.21.15.59:0/296732426 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe80041270 con 0x7fbe90106640 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:40.994+0000 7fbe877fe640 1 -- 172.21.15.59:0/296732426 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fbe80045980 con 0x7fbe90106640 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.140+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fbe90195600 con 0x7fbe7c038f00 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.220+0000 7fbe877fe640 1 -- 172.21.15.59:0/296732426 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fbe90195600 con 0x7fbe7c038f00 2024-09-10T10:52:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.222+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbe7c038f00 msgr2=0x7fbe7c03b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:41.792 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.222+0000 7fbe94c06640 1 --2- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbe7c038f00 0x7fbe7c03b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbe780098c0 tx=0x7fbe78006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:41.792 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.222+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 msgr2=0x7fbe90191820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:41.792 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.222+0000 7fbe94c06640 1 --2- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90191820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe80030560 tx=0x7fbe80032670 comp rx=0 tx=0).stop 2024-09-10T10:52:41.792 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.222+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 shutdown_connections 2024-09-10T10:52:41.792 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.222+0000 7fbe94c06640 1 --2- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbe7c038f00 0x7fbe7c03b3c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:41.792 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.222+0000 7fbe94c06640 1 --2- 172.21.15.59:0/296732426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe90106640 0x7fbe90191820 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:41.792 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.222+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 >> 172.21.15.59:0/296732426 conn(0x7fbe90101db0 msgr2=0x7fbe90102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:41.792 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.223+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 shutdown_connections 2024-09-10T10:52:41.792 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:41.223+0000 7fbe94c06640 1 -- 172.21.15.59:0/296732426 wait complete. 2024-09-10T10:52:41.793 INFO:teuthology.orchestra.run.smithi059.stdout:Creating initial admin user... 2024-09-10T10:52:42.081 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:41 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:40] ENGINE Serving on https://172.21.15.59:7150 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:41 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:40] ENGINE Bus STARTED 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:41 smithi059 ceph-mon[30978]: [10/Sep/2024:10:52:40] ENGINE Error in HTTPServer.serve 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout: Traceback (most recent call last): 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._run(expiration_interval) 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:52:42.082 INFO:journalctl@ceph.mon.a.smithi059.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout: s = self.context.wrap_socket( 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout: return self.sslsocket_class._create( 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout: self.do_handshake() 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._sslobj.do_handshake() 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:41 smithi059 ceph-mon[30978]: mgrmap e12: x(active, since 2s) 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:42.083 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:41 smithi059 ceph-mon[30978]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:42.084 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:42.084 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:43.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:42 smithi059 ceph-mon[30978]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:43.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:42 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:43.330 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$CKDLxDPkMTa6JFUxOxEsdueeiRgCnCe4OE15HGaSu8B51lBvFK8IW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725965562, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T10:52:43.330 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.165+0000 7fb047688640 1 Processor -- start 2024-09-10T10:52:43.330 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.165+0000 7fb047688640 1 -- start start 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.165+0000 7fb047688640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb04010a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.165+0000 7fb047688640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb04007c710 con 0x7fb0401081d0 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.166+0000 7fb045424640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb04010a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.166+0000 7fb045424640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb04010a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60326/0 (socket says 172.21.15.59:60326) 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.166+0000 7fb045424640 1 -- 172.21.15.59:0/624119513 learned_addr learned my addr 172.21.15.59:0/624119513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.166+0000 7fb045424640 1 -- 172.21.15.59:0/624119513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04010ab00 con 0x7fb0401081d0 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.167+0000 7fb045424640 1 --2- 172.21.15.59:0/624119513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb04010a5c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009820 tx=0x7fb03c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d492da93985013ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.167+0000 7fb037fff640 1 -- 172.21.15.59:0/624119513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03c037070 con 0x7fb0401081d0 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.167+0000 7fb037fff640 1 -- 172.21.15.59:0/624119513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb03c032920 con 0x7fb0401081d0 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.167+0000 7fb037fff640 1 -- 172.21.15.59:0/624119513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03c030810 con 0x7fb0401081d0 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.168+0000 7fb047688640 1 -- 172.21.15.59:0/624119513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 msgr2=0x7fb04010a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:43.331 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.168+0000 7fb047688640 1 --2- 172.21.15.59:0/624119513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb04010a5c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009820 tx=0x7fb03c02a270 comp rx=0 tx=0).stop 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.168+0000 7fb047688640 1 -- 172.21.15.59:0/624119513 shutdown_connections 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.168+0000 7fb047688640 1 --2- 172.21.15.59:0/624119513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb04010a5c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.168+0000 7fb047688640 1 -- 172.21.15.59:0/624119513 >> 172.21.15.59:0/624119513 conn(0x7fb040101e50 msgr2=0x7fb040104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.168+0000 7fb047688640 1 -- 172.21.15.59:0/624119513 shutdown_connections 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.168+0000 7fb047688640 1 -- 172.21.15.59:0/624119513 wait complete. 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.169+0000 7fb047688640 1 Processor -- start 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.169+0000 7fb047688640 1 -- start start 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.169+0000 7fb047688640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb040107a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.169+0000 7fb047688640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb04010bbe0 con 0x7fb0401081d0 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.169+0000 7fb045424640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb040107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:43.332 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.169+0000 7fb045424640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb040107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60336/0 (socket says 172.21.15.59:60336) 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.169+0000 7fb045424640 1 -- 172.21.15.59:0/2523165086 learned_addr learned my addr 172.21.15.59:0/2523165086 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.169+0000 7fb045424640 1 -- 172.21.15.59:0/2523165086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb040107f90 con 0x7fb0401081d0 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.169+0000 7fb045424640 1 --2- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb040107a50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb03c030380 tx=0x7fb03c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.170+0000 7fb0367fc640 1 -- 172.21.15.59:0/2523165086 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03c037040 con 0x7fb0401081d0 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.170+0000 7fb0367fc640 1 -- 172.21.15.59:0/2523165086 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb03c040070 con 0x7fb0401081d0 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.170+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb040106180 con 0x7fb0401081d0 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.170+0000 7fb0367fc640 1 -- 172.21.15.59:0/2523165086 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03c03a7b0 con 0x7fb0401081d0 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.170+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0401066c0 con 0x7fb0401081d0 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.171+0000 7fb0367fc640 1 -- 172.21.15.59:0/2523165086 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fb03c03a9e0 con 0x7fb0401081d0 2024-09-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.171+0000 7fb0367fc640 1 --2- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb02c039020 0x7fb02c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.171+0000 7fb0367fc640 1 -- 172.21.15.59:0/2523165086 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb03c03b910 con 0x7fb0401081d0 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.171+0000 7fb044c23640 1 --2- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb02c039020 0x7fb02c03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.171+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb040108630 con 0x7fb0401081d0 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.171+0000 7fb044c23640 1 --2- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb02c039020 0x7fb02c03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0300098c0 tx=0x7fb030006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.177+0000 7fb0367fc640 1 -- 172.21.15.59:0/2523165086 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb03c041270 con 0x7fb0401081d0 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.390+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fb040106d40 con 0x7fb02c039020 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.639+0000 7fb0367fc640 1 -- 172.21.15.59:0/2523165086 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fb040106d40 con 0x7fb02c039020 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb02c039020 msgr2=0x7fb02c03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 --2- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb02c039020 0x7fb02c03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0300098c0 tx=0x7fb030006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 msgr2=0x7fb040107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 --2- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb040107a50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb03c030380 tx=0x7fb03c032670 comp rx=0 tx=0).stop 2024-09-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 shutdown_connections 2024-09-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 --2- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb02c039020 0x7fb02c03b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 --2- 172.21.15.59:0/2523165086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0401081d0 0x7fb040107a50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 >> 172.21.15.59:0/2523165086 conn(0x7fb040101e50 msgr2=0x7fb040102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 shutdown_connections 2024-09-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:42.641+0000 7fb047688640 1 -- 172.21.15.59:0/2523165086 wait complete. 2024-09-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi059.stdout:Fetching dashboard port number... 2024-09-10T10:52:44.219 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:43 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/995507992' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T10:52:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T10:52:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.745+0000 7f3168416640 1 Processor -- start 2024-09-10T10:52:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.745+0000 7f3168416640 1 -- start start 2024-09-10T10:52:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.745+0000 7f3168416640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f316010a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.745+0000 7f3168416640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f316007be80 con 0x7f3160108170 2024-09-10T10:52:44.831 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.746+0000 7f31661b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f316010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.746+0000 7f31661b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f316010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60344/0 (socket says 172.21.15.59:60344) 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.746+0000 7f31661b2640 1 -- 172.21.15.59:0/3905928648 learned_addr learned my addr 172.21.15.59:0/3905928648 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.746+0000 7f31661b2640 1 -- 172.21.15.59:0/3905928648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316010aaa0 con 0x7f3160108170 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.747+0000 7f31661b2640 1 --2- 172.21.15.59:0/3905928648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f316010a560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f315c009820 tx=0x7f315c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2947775280b862fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.747+0000 7f31651b0640 1 -- 172.21.15.59:0/3905928648 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f315c037070 con 0x7f3160108170 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.747+0000 7f31651b0640 1 -- 172.21.15.59:0/3905928648 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f315c032920 con 0x7f3160108170 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.747+0000 7f31651b0640 1 -- 172.21.15.59:0/3905928648 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f315c030810 con 0x7f3160108170 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.748+0000 7f3168416640 1 -- 172.21.15.59:0/3905928648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 msgr2=0x7f316010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.748+0000 7f3168416640 1 --2- 172.21.15.59:0/3905928648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f316010a560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f315c009820 tx=0x7f315c02a270 comp rx=0 tx=0).stop 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.748+0000 7f3168416640 1 -- 172.21.15.59:0/3905928648 shutdown_connections 2024-09-10T10:52:44.832 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.748+0000 7f3168416640 1 --2- 172.21.15.59:0/3905928648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f316010a560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.748+0000 7f3168416640 1 -- 172.21.15.59:0/3905928648 >> 172.21.15.59:0/3905928648 conn(0x7f3160101db0 msgr2=0x7f31601041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.748+0000 7f3168416640 1 -- 172.21.15.59:0/3905928648 shutdown_connections 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.748+0000 7f3168416640 1 -- 172.21.15.59:0/3905928648 wait complete. 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.748+0000 7f3168416640 1 Processor -- start 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.748+0000 7f3168416640 1 -- start start 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f3168416640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f31601079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f3168416640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f316010bb80 con 0x7f3160108170 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f31661b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f31601079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f31661b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f31601079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60350/0 (socket says 172.21.15.59:60350) 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f31661b2640 1 -- 172.21.15.59:0/995507992 learned_addr learned my addr 172.21.15.59:0/995507992 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:44.833 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f31661b2640 1 -- 172.21.15.59:0/995507992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3160107f30 con 0x7f3160108170 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f31661b2640 1 --2- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f31601079f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f315c0097f0 tx=0x7f315c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f31537fe640 1 -- 172.21.15.59:0/995507992 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f315c037040 con 0x7f3160108170 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f31537fe640 1 -- 172.21.15.59:0/995507992 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f315c030c40 con 0x7f3160108170 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.749+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3160106120 con 0x7f3160108170 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.750+0000 7f31537fe640 1 -- 172.21.15.59:0/995507992 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f315c03a5d0 con 0x7f3160108170 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.750+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3160106660 con 0x7f3160108170 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.751+0000 7f31537fe640 1 -- 172.21.15.59:0/995507992 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f315c03a830 con 0x7f3160108170 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.751+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31601085d0 con 0x7f3160108170 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.751+0000 7f31537fe640 1 --2- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f314c038fc0 0x7f314c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.751+0000 7f31537fe640 1 -- 172.21.15.59:0/995507992 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f315c06c6f0 con 0x7f3160108170 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.751+0000 7f31659b1640 1 --2- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f314c038fc0 0x7f314c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:44.834 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.752+0000 7f31659b1640 1 --2- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f314c038fc0 0x7f314c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f31540098c0 tx=0x7f3154006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.756+0000 7f31537fe640 1 -- 172.21.15.59:0/995507992 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f315c0392f0 con 0x7f3160108170 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.935+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f3160106e00 con 0x7f3160108170 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.936+0000 7f31537fe640 1 -- 172.21.15.59:0/995507992 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f315c03b9d0 con 0x7f3160108170 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f314c038fc0 msgr2=0x7f314c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 --2- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f314c038fc0 0x7f314c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f31540098c0 tx=0x7f3154006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 msgr2=0x7f31601079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 --2- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f31601079f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f315c0097f0 tx=0x7f315c0327b0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 shutdown_connections 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 --2- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f314c038fc0 0x7f314c03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 --2- 172.21.15.59:0/995507992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3160108170 0x7f31601079f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.835 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 >> 172.21.15.59:0/995507992 conn(0x7f3160101db0 msgr2=0x7f3160102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:44.836 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 shutdown_connections 2024-09-10T10:52:44.836 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:43.938+0000 7f3168416640 1 -- 172.21.15.59:0/995507992 wait complete. 2024-09-10T10:52:44.841 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:52:44.842 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2024-09-10T10:52:44.850 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:52:44.850 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T10:52:44.850 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2024-09-10T10:52:44.850 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T10:52:44.853 INFO:teuthology.orchestra.run.smithi059.stdout:Ceph Dashboard is now available at: 2024-09-10T10:52:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: URL: https://smithi059.front.sepia.ceph.com:8443/ 2024-09-10T10:52:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: User: admin 2024-09-10T10:52:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: Password: 8i668o6zgx 2024-09-10T10:52:44.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:44.853 INFO:teuthology.orchestra.run.smithi059.stdout:Saving cluster configuration to /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config directory 2024-09-10T10:52:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:45 smithi059 ceph-mon[30978]: mgrmap e13: x(active, since 6s) 2024-09-10T10:52:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:45 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/4144148278' entity='client.admin' 2024-09-10T10:52:46.153 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.264+0000 7f262b7a4640 1 Processor -- start 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.264+0000 7f262b7a4640 1 -- start start 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.264+0000 7f262b7a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f2624107b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.264+0000 7f262b7a4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2624108160 con 0x7f2624107790 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.264+0000 7f2629540640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f2624107b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.265+0000 7f2629540640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f2624107b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60366/0 (socket says 172.21.15.59:60366) 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.265+0000 7f2629540640 1 -- 172.21.15.59:0/4111298450 learned_addr learned my addr 172.21.15.59:0/4111298450 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.265+0000 7f2629540640 1 -- 172.21.15.59:0/4111298450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2624108940 con 0x7f2624107790 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.265+0000 7f2629540640 1 --2- 172.21.15.59:0/4111298450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f2624107b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2620009820 tx=0x7f262002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbec4f567eeba494 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.266+0000 7f261bfff640 1 -- 172.21.15.59:0/4111298450 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2620037070 con 0x7f2624107790 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.266+0000 7f261bfff640 1 -- 172.21.15.59:0/4111298450 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2620032920 con 0x7f2624107790 2024-09-10T10:52:46.154 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.266+0000 7f261bfff640 1 -- 172.21.15.59:0/4111298450 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2620030810 con 0x7f2624107790 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.266+0000 7f262b7a4640 1 -- 172.21.15.59:0/4111298450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 msgr2=0x7f2624107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.266+0000 7f262b7a4640 1 --2- 172.21.15.59:0/4111298450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f2624107b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2620009820 tx=0x7f262002a270 comp rx=0 tx=0).stop 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.266+0000 7f262b7a4640 1 -- 172.21.15.59:0/4111298450 shutdown_connections 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.266+0000 7f262b7a4640 1 --2- 172.21.15.59:0/4111298450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f2624107b90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.266+0000 7f262b7a4640 1 -- 172.21.15.59:0/4111298450 >> 172.21.15.59:0/4111298450 conn(0x7f2624102fa0 msgr2=0x7f26241053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.266+0000 7f262b7a4640 1 -- 172.21.15.59:0/4111298450 shutdown_connections 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.267+0000 7f262b7a4640 1 -- 172.21.15.59:0/4111298450 wait complete. 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.267+0000 7f262b7a4640 1 Processor -- start 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.267+0000 7f262b7a4640 1 -- start start 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.267+0000 7f262b7a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f262419b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:46.155 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.267+0000 7f262b7a4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f262410bcf0 con 0x7f2624107790 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.267+0000 7f2629540640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f262419b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.268+0000 7f2629540640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f262419b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60374/0 (socket says 172.21.15.59:60374) 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.268+0000 7f2629540640 1 -- 172.21.15.59:0/4144148278 learned_addr learned my addr 172.21.15.59:0/4144148278 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.268+0000 7f2629540640 1 -- 172.21.15.59:0/4144148278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262419bca0 con 0x7f2624107790 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.268+0000 7f2629540640 1 --2- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f262419b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2620030560 tx=0x7f2620032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.268+0000 7f261a7fc640 1 -- 172.21.15.59:0/4144148278 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2620037040 con 0x7f2624107790 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.268+0000 7f261a7fc640 1 -- 172.21.15.59:0/4144148278 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2620040070 con 0x7f2624107790 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.268+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f262419bf30 con 0x7f2624107790 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.268+0000 7f261a7fc640 1 -- 172.21.15.59:0/4144148278 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262003a740 con 0x7f2624107790 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.268+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f262419ec20 con 0x7f2624107790 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.269+0000 7f261a7fc640 1 -- 172.21.15.59:0/4144148278 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f262003b420 con 0x7f2624107790 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.269+0000 7f261a7fc640 1 --2- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f26100390c0 0x7f261003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.269+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f262410be70 con 0x7f2624107790 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.269+0000 7f261a7fc640 1 -- 172.21.15.59:0/4144148278 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f262006c710 con 0x7f2624107790 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.269+0000 7f2628d3f640 1 --2- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f26100390c0 0x7f261003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.270+0000 7f2628d3f640 1 --2- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f26100390c0 0x7f261003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26140098c0 tx=0x7f2614006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.274+0000 7f261a7fc640 1 -- 172.21.15.59:0/4144148278 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2620043360 con 0x7f2624107790 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.539+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f262419edf0 con 0x7f2624107790 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.542+0000 7f261a7fc640 1 -- 172.21.15.59:0/4144148278 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7f2620042b50 con 0x7f2624107790 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f26100390c0 msgr2=0x7f261003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 --2- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f26100390c0 0x7f261003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26140098c0 tx=0x7f2614006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 msgr2=0x7f262419b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 --2- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f262419b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2620030560 tx=0x7f2620032670 comp rx=0 tx=0).stop 2024-09-10T10:52:46.157 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 shutdown_connections 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 --2- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f26100390c0 0x7f261003b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 --2- 172.21.15.59:0/4144148278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2624107790 0x7f262419b760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 >> 172.21.15.59:0/4144148278 conn(0x7f2624102fa0 msgr2=0x7f2624103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 shutdown_connections 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr 2024-09-10T10:52:45.544+0000 7f262b7a4640 1 -- 172.21.15.59:0/4144148278 wait complete. 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T10:52:46.158 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:46.159 INFO:teuthology.orchestra.run.smithi059.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T10:52:46.159 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:46.159 INFO:teuthology.orchestra.run.smithi059.stdout: ceph telemetry on 2024-09-10T10:52:46.159 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:46.159 INFO:teuthology.orchestra.run.smithi059.stdout:For more information see: 2024-09-10T10:52:46.159 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:46.159 INFO:teuthology.orchestra.run.smithi059.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T10:52:46.159 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:46.159 INFO:teuthology.orchestra.run.smithi059.stdout:Bootstrap complete. 2024-09-10T10:52:46.195 INFO:tasks.cephadm:Fetching config... 2024-09-10T10:52:46.196 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:52:46.196 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T10:52:46.213 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T10:52:46.213 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:52:46.213 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T10:52:46.270 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T10:52:46.270 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:52:46.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T10:52:46.335 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T10:52:46.336 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:52:46.336 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T10:52:46.392 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T10:52:46.392 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjtOhPzQbo3yZQdbKGZ1FkPJoXj+fyuUYrbvWWo2JHvSvo5aAa+hiNPrcal7xyXth2KUKLUc9zCCLupArCN/TDHabIc+4yQhoMOTiNXg5Mzmf4vZhHwRgVkIpj4JxUBg9UVxIW/Si2GW68ndBnO1TTDl1mMq4D3b2deWIrHTT3eNn0Xd7aI/SKkBu/vImuqZtVNFp4DDOrvx/+lBiVBLzfcyXg/b7QMG86plgXWqc2TcJw1BjTwyRXs/CDv3xdUWGsRDrIbGpRSLje9KlBz1ISLOjB9SxtVBhB8IfSwciCYPVFt5fMFw24oVQnIy6biStr3mfB6zcJPWL4QzYhWfXvixdB+wBEAESqHLGSCPuHsKIR8L5zWctzghCO2rCcfhdNrhimnn8o98shM809kwLQjqX3RV1KLp8vTgPi26r2LGJPsjy2Ch3EP2uSGJ80tuKnR0V85sO+0DEkLBoxUuReXVaCh+1Y57pOY69iCtxmChcydIZTHQ1a+axCFqt+mXs= ceph-86a09b02-6f62-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T10:52:46.467 INFO:teuthology.orchestra.run.smithi059.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjtOhPzQbo3yZQdbKGZ1FkPJoXj+fyuUYrbvWWo2JHvSvo5aAa+hiNPrcal7xyXth2KUKLUc9zCCLupArCN/TDHabIc+4yQhoMOTiNXg5Mzmf4vZhHwRgVkIpj4JxUBg9UVxIW/Si2GW68ndBnO1TTDl1mMq4D3b2deWIrHTT3eNn0Xd7aI/SKkBu/vImuqZtVNFp4DDOrvx/+lBiVBLzfcyXg/b7QMG86plgXWqc2TcJw1BjTwyRXs/CDv3xdUWGsRDrIbGpRSLje9KlBz1ISLOjB9SxtVBhB8IfSwciCYPVFt5fMFw24oVQnIy6biStr3mfB6zcJPWL4QzYhWfXvixdB+wBEAESqHLGSCPuHsKIR8L5zWctzghCO2rCcfhdNrhimnn8o98shM809kwLQjqX3RV1KLp8vTgPi26r2LGJPsjy2Ch3EP2uSGJ80tuKnR0V85sO+0DEkLBoxUuReXVaCh+1Y57pOY69iCtxmChcydIZTHQ1a+axCFqt+mXs= ceph-86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:52:46.501 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjtOhPzQbo3yZQdbKGZ1FkPJoXj+fyuUYrbvWWo2JHvSvo5aAa+hiNPrcal7xyXth2KUKLUc9zCCLupArCN/TDHabIc+4yQhoMOTiNXg5Mzmf4vZhHwRgVkIpj4JxUBg9UVxIW/Si2GW68ndBnO1TTDl1mMq4D3b2deWIrHTT3eNn0Xd7aI/SKkBu/vImuqZtVNFp4DDOrvx/+lBiVBLzfcyXg/b7QMG86plgXWqc2TcJw1BjTwyRXs/CDv3xdUWGsRDrIbGpRSLje9KlBz1ISLOjB9SxtVBhB8IfSwciCYPVFt5fMFw24oVQnIy6biStr3mfB6zcJPWL4QzYhWfXvixdB+wBEAESqHLGSCPuHsKIR8L5zWctzghCO2rCcfhdNrhimnn8o98shM809kwLQjqX3RV1KLp8vTgPi26r2LGJPsjy2Ch3EP2uSGJ80tuKnR0V85sO+0DEkLBoxUuReXVaCh+1Y57pOY69iCtxmChcydIZTHQ1a+axCFqt+mXs= ceph-86a09b02-6f62-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T10:52:46.542 INFO:teuthology.orchestra.run.smithi115.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjtOhPzQbo3yZQdbKGZ1FkPJoXj+fyuUYrbvWWo2JHvSvo5aAa+hiNPrcal7xyXth2KUKLUc9zCCLupArCN/TDHabIc+4yQhoMOTiNXg5Mzmf4vZhHwRgVkIpj4JxUBg9UVxIW/Si2GW68ndBnO1TTDl1mMq4D3b2deWIrHTT3eNn0Xd7aI/SKkBu/vImuqZtVNFp4DDOrvx/+lBiVBLzfcyXg/b7QMG86plgXWqc2TcJw1BjTwyRXs/CDv3xdUWGsRDrIbGpRSLje9KlBz1ISLOjB9SxtVBhB8IfSwciCYPVFt5fMFw24oVQnIy6biStr3mfB6zcJPWL4QzYhWfXvixdB+wBEAESqHLGSCPuHsKIR8L5zWctzghCO2rCcfhdNrhimnn8o98shM809kwLQjqX3RV1KLp8vTgPi26r2LGJPsjy2Ch3EP2uSGJ80tuKnR0V85sO+0DEkLBoxUuReXVaCh+1Y57pOY69iCtxmChcydIZTHQ1a+axCFqt+mXs= ceph-86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:52:46.555 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjtOhPzQbo3yZQdbKGZ1FkPJoXj+fyuUYrbvWWo2JHvSvo5aAa+hiNPrcal7xyXth2KUKLUc9zCCLupArCN/TDHabIc+4yQhoMOTiNXg5Mzmf4vZhHwRgVkIpj4JxUBg9UVxIW/Si2GW68ndBnO1TTDl1mMq4D3b2deWIrHTT3eNn0Xd7aI/SKkBu/vImuqZtVNFp4DDOrvx/+lBiVBLzfcyXg/b7QMG86plgXWqc2TcJw1BjTwyRXs/CDv3xdUWGsRDrIbGpRSLje9KlBz1ISLOjB9SxtVBhB8IfSwciCYPVFt5fMFw24oVQnIy6biStr3mfB6zcJPWL4QzYhWfXvixdB+wBEAESqHLGSCPuHsKIR8L5zWctzghCO2rCcfhdNrhimnn8o98shM809kwLQjqX3RV1KLp8vTgPi26r2LGJPsjy2Ch3EP2uSGJ80tuKnR0V85sO+0DEkLBoxUuReXVaCh+1Y57pOY69iCtxmChcydIZTHQ1a+axCFqt+mXs= ceph-86a09b02-6f62-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T10:52:46.596 INFO:teuthology.orchestra.run.smithi181.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjtOhPzQbo3yZQdbKGZ1FkPJoXj+fyuUYrbvWWo2JHvSvo5aAa+hiNPrcal7xyXth2KUKLUc9zCCLupArCN/TDHabIc+4yQhoMOTiNXg5Mzmf4vZhHwRgVkIpj4JxUBg9UVxIW/Si2GW68ndBnO1TTDl1mMq4D3b2deWIrHTT3eNn0Xd7aI/SKkBu/vImuqZtVNFp4DDOrvx/+lBiVBLzfcyXg/b7QMG86plgXWqc2TcJw1BjTwyRXs/CDv3xdUWGsRDrIbGpRSLje9KlBz1ISLOjB9SxtVBhB8IfSwciCYPVFt5fMFw24oVQnIy6biStr3mfB6zcJPWL4QzYhWfXvixdB+wBEAESqHLGSCPuHsKIR8L5zWctzghCO2rCcfhdNrhimnn8o98shM809kwLQjqX3RV1KLp8vTgPi26r2LGJPsjy2Ch3EP2uSGJ80tuKnR0V85sO+0DEkLBoxUuReXVaCh+1Y57pOY69iCtxmChcydIZTHQ1a+axCFqt+mXs= ceph-86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:52:46.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T10:52:46.863 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.316+0000 7f37524bf640 1 -- 172.21.15.59:0/2815565057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 msgr2=0x7f374c1044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.316+0000 7f37524bf640 1 --2- 172.21.15.59:0/2815565057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 0x7f374c1044f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f373c009880 tx=0x7f373c02a5d0 comp rx=0 tx=0).stop 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.316+0000 7f37524bf640 1 -- 172.21.15.59:0/2815565057 shutdown_connections 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.316+0000 7f37524bf640 1 --2- 172.21.15.59:0/2815565057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 0x7f374c1044f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.316+0000 7f37524bf640 1 -- 172.21.15.59:0/2815565057 >> 172.21.15.59:0/2815565057 conn(0x7f374c0fbc80 msgr2=0x7f374c0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.316+0000 7f37524bf640 1 -- 172.21.15.59:0/2815565057 shutdown_connections 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.316+0000 7f37524bf640 1 -- 172.21.15.59:0/2815565057 wait complete. 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.317+0000 7f37524bf640 1 Processor -- start 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.317+0000 7f37524bf640 1 -- start start 2024-09-10T10:52:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.317+0000 7f37524bf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 0x7f374c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.317+0000 7f37524bf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f374c107710 con 0x7f374c102100 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.317+0000 7f374bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 0x7f374c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.317+0000 7f374bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 0x7f374c196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46878/0 (socket says 172.21.15.59:46878) 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.317+0000 7f374bfff640 1 -- 172.21.15.59:0/1645670072 learned_addr learned my addr 172.21.15.59:0/1645670072 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.318+0000 7f374bfff640 1 -- 172.21.15.59:0/1645670072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c197270 con 0x7f374c102100 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.318+0000 7f374bfff640 1 --2- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 0x7f374c196d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f373c004f60 tx=0x7f373c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.318+0000 7f37497fa640 1 -- 172.21.15.59:0/1645670072 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f373c03f070 con 0x7f374c102100 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.318+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374c197500 con 0x7f374c102100 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.318+0000 7f37497fa640 1 -- 172.21.15.59:0/1645670072 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f373c003ad0 con 0x7f374c102100 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.318+0000 7f37497fa640 1 -- 172.21.15.59:0/1645670072 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f373c035030 con 0x7f374c102100 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.318+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374c19a1f0 con 0x7f374c102100 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.319+0000 7f37497fa640 1 -- 172.21.15.59:0/1645670072 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f373c042070 con 0x7f374c102100 2024-09-10T10:52:47.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.319+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374c107e90 con 0x7f374c102100 2024-09-10T10:52:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.319+0000 7f37497fa640 1 --2- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3734039060 0x7f373403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.319+0000 7f37497fa640 1 -- 172.21.15.59:0/1645670072 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f373c06cdb0 con 0x7f374c102100 2024-09-10T10:52:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.319+0000 7f374b7fe640 1 --2- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3734039060 0x7f373403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.320+0000 7f374b7fe640 1 --2- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3734039060 0x7f373403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f37400098c0 tx=0x7f3740006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:47.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.324+0000 7f37497fa640 1 -- 172.21.15.59:0/1645670072 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f373c04a260 con 0x7f374c102100 2024-09-10T10:52:47.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.501+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f374c02d830 con 0x7f374c102100 2024-09-10T10:52:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.503+0000 7f37497fa640 1 -- 172.21.15.59:0/1645670072 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f373c042c30 con 0x7f374c102100 2024-09-10T10:52:47.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.505+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3734039060 msgr2=0x7f373403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:47.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.505+0000 7f37524bf640 1 --2- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3734039060 0x7f373403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f37400098c0 tx=0x7f3740006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:47.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.505+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 msgr2=0x7f374c196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:47.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.505+0000 7f37524bf640 1 --2- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 0x7f374c196d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f373c004f60 tx=0x7f373c0048f0 comp rx=0 tx=0).stop 2024-09-10T10:52:47.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.506+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 shutdown_connections 2024-09-10T10:52:47.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.506+0000 7f37524bf640 1 --2- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3734039060 0x7f373403b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:47.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.506+0000 7f37524bf640 1 --2- 172.21.15.59:0/1645670072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374c102100 0x7f374c196d30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:47.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.506+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 >> 172.21.15.59:0/1645670072 conn(0x7f374c0fbc80 msgr2=0x7f374c0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:47.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.506+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 shutdown_connections 2024-09-10T10:52:47.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:47.506+0000 7f37524bf640 1 -- 172.21.15.59:0/1645670072 wait complete. 2024-09-10T10:52:48.505 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T10:52:48.506 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T10:52:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:48.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:48 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1645670072' entity='client.admin' 2024-09-10T10:52:48.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:48.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:48.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:52:48.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:48.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:52:48.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.181+0000 7fa091242640 1 -- 172.21.15.59:0/295886257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 msgr2=0x7fa08c1044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.181+0000 7fa091242640 1 --2- 172.21.15.59:0/295886257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 0x7fa08c1044c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009880 tx=0x7fa07c02a5d0 comp rx=0 tx=0).stop 2024-09-10T10:52:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.181+0000 7fa091242640 1 -- 172.21.15.59:0/295886257 shutdown_connections 2024-09-10T10:52:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.181+0000 7fa091242640 1 --2- 172.21.15.59:0/295886257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 0x7fa08c1044c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.181+0000 7fa091242640 1 -- 172.21.15.59:0/295886257 >> 172.21.15.59:0/295886257 conn(0x7fa08c0fbcd0 msgr2=0x7fa08c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.181+0000 7fa091242640 1 -- 172.21.15.59:0/295886257 shutdown_connections 2024-09-10T10:52:49.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.181+0000 7fa091242640 1 -- 172.21.15.59:0/295886257 wait complete. 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.182+0000 7fa091242640 1 Processor -- start 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.182+0000 7fa091242640 1 -- start start 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.182+0000 7fa091242640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 0x7fa08c196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.182+0000 7fa091242640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c107670 con 0x7fa08c1020d0 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.182+0000 7fa08ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 0x7fa08c196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.182+0000 7fa08ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 0x7fa08c196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46888/0 (socket says 172.21.15.59:46888) 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.182+0000 7fa08ad9d640 1 -- 172.21.15.59:0/90960454 learned_addr learned my addr 172.21.15.59:0/90960454 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.183+0000 7fa08ad9d640 1 -- 172.21.15.59:0/90960454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c197280 con 0x7fa08c1020d0 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.183+0000 7fa08ad9d640 1 --2- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 0x7fa08c196d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa07c004f60 tx=0x7fa07c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:49.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.183+0000 7fa073fff640 1 -- 172.21.15.59:0/90960454 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa07c03f070 con 0x7fa08c1020d0 2024-09-10T10:52:49.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.183+0000 7fa073fff640 1 -- 172.21.15.59:0/90960454 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa07c003ad0 con 0x7fa08c1020d0 2024-09-10T10:52:49.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.183+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c197570 con 0x7fa08c1020d0 2024-09-10T10:52:49.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.183+0000 7fa073fff640 1 -- 172.21.15.59:0/90960454 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa07c035030 con 0x7fa08c1020d0 2024-09-10T10:52:49.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.183+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c19a200 con 0x7fa08c1020d0 2024-09-10T10:52:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.184+0000 7fa073fff640 1 -- 172.21.15.59:0/90960454 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa07c042070 con 0x7fa08c1020d0 2024-09-10T10:52:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.184+0000 7fa073fff640 1 --2- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa0740390c0 0x7fa07403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.184+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08c107df0 con 0x7fa08c1020d0 2024-09-10T10:52:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.184+0000 7fa073fff640 1 -- 172.21.15.59:0/90960454 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa07c06cdb0 con 0x7fa08c1020d0 2024-09-10T10:52:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.184+0000 7fa08a59c640 1 --2- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa0740390c0 0x7fa07403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:49.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.185+0000 7fa08a59c640 1 --2- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa0740390c0 0x7fa07403b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa0800098c0 tx=0x7fa080006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:49.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.189+0000 7fa073fff640 1 -- 172.21.15.59:0/90960454 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa07c02f300 con 0x7fa08c1020d0 2024-09-10T10:52:49.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.367+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fa08c02d970 con 0x7fa0740390c0 2024-09-10T10:52:49.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.370+0000 7fa073fff640 1 -- 172.21.15.59:0/90960454 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa08c02d970 con 0x7fa0740390c0 2024-09-10T10:52:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.372+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa0740390c0 msgr2=0x7fa07403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.372+0000 7fa091242640 1 --2- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa0740390c0 0x7fa07403b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa0800098c0 tx=0x7fa080006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.372+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 msgr2=0x7fa08c196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.372+0000 7fa091242640 1 --2- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 0x7fa08c196d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa07c004f60 tx=0x7fa07c0048f0 comp rx=0 tx=0).stop 2024-09-10T10:52:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.372+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 shutdown_connections 2024-09-10T10:52:49.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.372+0000 7fa091242640 1 --2- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa0740390c0 0x7fa07403b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.372+0000 7fa091242640 1 --2- 172.21.15.59:0/90960454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c1020d0 0x7fa08c196d40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.372+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 >> 172.21.15.59:0/90960454 conn(0x7fa08c0fbcd0 msgr2=0x7fa08c0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.373+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 shutdown_connections 2024-09-10T10:52:49.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:49.373+0000 7fa091242640 1 -- 172.21.15.59:0/90960454 wait complete. 2024-09-10T10:52:50.133 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi115 2024-09-10T10:52:50.133 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:52:50.133 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/etc/ceph/ceph.conf 2024-09-10T10:52:50.153 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:52:50.153 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:52:50.212 INFO:tasks.cephadm:Adding host smithi115 to orchestrator... 2024-09-10T10:52:50.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch host add smithi115 2024-09-10T10:52:50.465 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:50.578 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:50.578 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:50.578 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:52:50.578 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:52:50.578 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:52:50.578 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T10:52:50.578 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:52:50.579 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:50.579 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:50.579 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.898+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/36213644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 msgr2=0x7fd0e4102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.898+0000 7fd0ea4d2640 1 --2- 172.21.15.59:0/36213644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 0x7fd0e4102b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009880 tx=0x7fd0d402a670 comp rx=0 tx=0).stop 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.898+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/36213644 shutdown_connections 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.898+0000 7fd0ea4d2640 1 --2- 172.21.15.59:0/36213644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 0x7fd0e4102b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.898+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/36213644 >> 172.21.15.59:0/36213644 conn(0x7fd0e40fc1b0 msgr2=0x7fd0e40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.898+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/36213644 shutdown_connections 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.898+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/36213644 wait complete. 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.899+0000 7fd0ea4d2640 1 Processor -- start 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.899+0000 7fd0ea4d2640 1 -- start start 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.899+0000 7fd0ea4d2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 0x7fd0e41971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.899+0000 7fd0ea4d2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e410bcc0 con 0x7fd0e4102750 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.899+0000 7fd0e3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 0x7fd0e41971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.899+0000 7fd0e3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 0x7fd0e41971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46910/0 (socket says 172.21.15.59:46910) 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.899+0000 7fd0e3fff640 1 -- 172.21.15.59:0/2833834558 learned_addr learned my addr 172.21.15.59:0/2833834558 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.900+0000 7fd0e3fff640 1 -- 172.21.15.59:0/2833834558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e4197710 con 0x7fd0e4102750 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.900+0000 7fd0e3fff640 1 --2- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 0x7fd0e41971d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009230 tx=0x7fd0d4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.900+0000 7fd0e17fa640 1 -- 172.21.15.59:0/2833834558 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d403f070 con 0x7fd0e4102750 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.900+0000 7fd0e17fa640 1 -- 172.21.15.59:0/2833834558 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d403bc80 con 0x7fd0e4102750 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.900+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e41979a0 con 0x7fd0e4102750 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.900+0000 7fd0e17fa640 1 -- 172.21.15.59:0/2833834558 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d4035030 con 0x7fd0e4102750 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.900+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e4197e00 con 0x7fd0e4102750 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.901+0000 7fd0e17fa640 1 -- 172.21.15.59:0/2833834558 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd0d4042070 con 0x7fd0e4102750 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.901+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e406a7b0 con 0x7fd0e4102750 2024-09-10T10:52:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.901+0000 7fd0e17fa640 1 --2- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd0cc0390c0 0x7fd0cc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:50.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.901+0000 7fd0e17fa640 1 -- 172.21.15.59:0/2833834558 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd0d406ce50 con 0x7fd0e4102750 2024-09-10T10:52:50.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.902+0000 7fd0e37fe640 1 --2- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd0cc0390c0 0x7fd0cc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:50.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.902+0000 7fd0e37fe640 1 --2- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd0cc0390c0 0x7fd0cc03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80098c0 tx=0x7fd0d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:50.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:50.906+0000 7fd0e17fa640 1 -- 172.21.15.59:0/2833834558 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0d40314c0 con 0x7fd0e4102750 2024-09-10T10:52:51.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:51.085+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi115", "target": ["mon-mgr", ""]}) -- 0x7fd0e4198530 con 0x7fd0cc0390c0 2024-09-10T10:52:51.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:51 smithi059 ceph-mon[30978]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:52:51.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:51 smithi059 ceph-mon[30978]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:52:52.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:52 smithi059 ceph-mon[30978]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi115", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:53.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:53 smithi059 ceph-mon[30978]: Deploying cephadm binary to smithi115 2024-09-10T10:52:55.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.062+0000 7fd0e17fa640 1 -- 172.21.15.59:0/2833834558 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd0e4198530 con 0x7fd0cc0390c0 2024-09-10T10:52:55.064 INFO:teuthology.orchestra.run.smithi059.stdout:Added host 'smithi115' with addr '172.21.15.115' 2024-09-10T10:52:55.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.064+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd0cc0390c0 msgr2=0x7fd0cc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.064+0000 7fd0ea4d2640 1 --2- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd0cc0390c0 0x7fd0cc03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80098c0 tx=0x7fd0d8006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.064+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 msgr2=0x7fd0e41971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.064+0000 7fd0ea4d2640 1 --2- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 0x7fd0e41971d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009230 tx=0x7fd0d4003d40 comp rx=0 tx=0).stop 2024-09-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.065+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 shutdown_connections 2024-09-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.065+0000 7fd0ea4d2640 1 --2- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd0cc0390c0 0x7fd0cc03b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.065+0000 7fd0ea4d2640 1 --2- 172.21.15.59:0/2833834558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e4102750 0x7fd0e41971d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.065+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 >> 172.21.15.59:0/2833834558 conn(0x7fd0e40fc1b0 msgr2=0x7fd0e4105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.065+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 shutdown_connections 2024-09-10T10:52:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:55.065+0000 7fd0ea4d2640 1 -- 172.21.15.59:0/2833834558 wait complete. 2024-09-10T10:52:55.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T10:52:55.899 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:56.329 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:56.329 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:56 smithi059 ceph-mon[30978]: Added host smithi115 2024-09-10T10:52:56.329 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:52:56.330 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:56.330 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.335+0000 7f4460a3f640 1 -- 172.21.15.59:0/2814793503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 msgr2=0x7f445c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.335+0000 7f4460a3f640 1 --2- 172.21.15.59:0/2814793503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 0x7f445c106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f444c009880 tx=0x7f444c02a5d0 comp rx=0 tx=0).stop 2024-09-10T10:52:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.336+0000 7f4460a3f640 1 -- 172.21.15.59:0/2814793503 shutdown_connections 2024-09-10T10:52:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.336+0000 7f4460a3f640 1 --2- 172.21.15.59:0/2814793503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 0x7f445c106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.336+0000 7f4460a3f640 1 -- 172.21.15.59:0/2814793503 >> 172.21.15.59:0/2814793503 conn(0x7f445c0fc1b0 msgr2=0x7f445c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.336+0000 7f4460a3f640 1 -- 172.21.15.59:0/2814793503 shutdown_connections 2024-09-10T10:52:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.336+0000 7f4460a3f640 1 -- 172.21.15.59:0/2814793503 wait complete. 2024-09-10T10:52:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.336+0000 7f4460a3f640 1 Processor -- start 2024-09-10T10:52:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.336+0000 7f4460a3f640 1 -- start start 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f4460a3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 0x7f445c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f4460a3f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f445c10ab90 con 0x7f445c106560 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f445a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 0x7f445c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f445a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 0x7f445c199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46936/0 (socket says 172.21.15.59:46936) 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f445a59c640 1 -- 172.21.15.59:0/4246809482 learned_addr learned my addr 172.21.15.59:0/4246809482 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f445a59c640 1 -- 172.21.15.59:0/4246809482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c199890 con 0x7f445c106560 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f445a59c640 1 --2- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 0x7f445c199350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f444c009230 tx=0x7f444c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f444b7fe640 1 -- 172.21.15.59:0/4246809482 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f444c03f070 con 0x7f445c106560 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f444b7fe640 1 -- 172.21.15.59:0/4246809482 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f444c03bc80 con 0x7f445c106560 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.337+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c199b20 con 0x7f445c106560 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.338+0000 7f444b7fe640 1 -- 172.21.15.59:0/4246809482 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f444c035030 con 0x7f445c106560 2024-09-10T10:52:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.338+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c199f80 con 0x7f445c106560 2024-09-10T10:52:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.338+0000 7f444b7fe640 1 -- 172.21.15.59:0/4246809482 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f444c042070 con 0x7f445c106560 2024-09-10T10:52:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.338+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c101bd0 con 0x7f445c106560 2024-09-10T10:52:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.339+0000 7f444b7fe640 1 --2- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4444039060 0x7f444403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.339+0000 7f444b7fe640 1 -- 172.21.15.59:0/4246809482 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f444c06cee0 con 0x7f445c106560 2024-09-10T10:52:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.339+0000 7f4459d9b640 1 --2- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4444039060 0x7f444403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:56.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.339+0000 7f4459d9b640 1 --2- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4444039060 0x7f444403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f44500098c0 tx=0x7f4450006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:56.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.344+0000 7f444b7fe640 1 -- 172.21.15.59:0/4246809482 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f444c04c350 con 0x7f445c106560 2024-09-10T10:52:56.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.526+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f445c19a710 con 0x7f4444039060 2024-09-10T10:52:56.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.527+0000 7f444b7fe640 1 -- 172.21.15.59:0/4246809482 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f445c19a710 con 0x7f4444039060 2024-09-10T10:52:56.528 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:52:56.528 INFO:teuthology.orchestra.run.smithi059.stdout:[{"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}, {"addr": "172.21.15.115", "hostname": "smithi115", "labels": [], "status": ""}] 2024-09-10T10:52:56.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4444039060 msgr2=0x7f444403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:56.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 --2- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4444039060 0x7f444403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f44500098c0 tx=0x7f4450006db0 comp rx=0 tx=0).stop 2024-09-10T10:52:56.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 msgr2=0x7f445c199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:56.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 --2- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 0x7f445c199350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f444c009230 tx=0x7f444c003d40 comp rx=0 tx=0).stop 2024-09-10T10:52:56.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 shutdown_connections 2024-09-10T10:52:56.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 --2- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4444039060 0x7f444403b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:56.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 --2- 172.21.15.59:0/4246809482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445c106560 0x7f445c199350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:56.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 >> 172.21.15.59:0/4246809482 conn(0x7f445c0fc1b0 msgr2=0x7f445c0fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:56.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 shutdown_connections 2024-09-10T10:52:56.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:56.530+0000 7f4460a3f640 1 -- 172.21.15.59:0/4246809482 wait complete. 2024-09-10T10:52:57.135 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi181 2024-09-10T10:52:57.135 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:52:57.135 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.conf 2024-09-10T10:52:57.153 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:52:57.154 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:52:57.212 INFO:tasks.cephadm:Adding host smithi181 to orchestrator... 2024-09-10T10:52:57.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch host add smithi181 2024-09-10T10:52:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:57.705 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:52:57.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:57 smithi059 ceph-mon[30978]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:52:57.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.875+0000 7f72df5a2640 1 -- 172.21.15.59:0/1588041374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 msgr2=0x7f72d8106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.875+0000 7f72df5a2640 1 --2- 172.21.15.59:0/1588041374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 0x7f72d8106940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009c20 tx=0x7f72d402aa90 comp rx=0 tx=0).stop 2024-09-10T10:52:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.875+0000 7f72df5a2640 1 -- 172.21.15.59:0/1588041374 shutdown_connections 2024-09-10T10:52:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.875+0000 7f72df5a2640 1 --2- 172.21.15.59:0/1588041374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 0x7f72d8106940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.875+0000 7f72df5a2640 1 -- 172.21.15.59:0/1588041374 >> 172.21.15.59:0/1588041374 conn(0x7f72d80fc1b0 msgr2=0x7f72d80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.875+0000 7f72df5a2640 1 -- 172.21.15.59:0/1588041374 shutdown_connections 2024-09-10T10:52:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.875+0000 7f72df5a2640 1 -- 172.21.15.59:0/1588041374 wait complete. 2024-09-10T10:52:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.876+0000 7f72df5a2640 1 Processor -- start 2024-09-10T10:52:57.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.876+0000 7f72df5a2640 1 -- start start 2024-09-10T10:52:57.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.876+0000 7f72df5a2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 0x7f72d8197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:57.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.876+0000 7f72df5a2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f72d810ab90 con 0x7f72d8106560 2024-09-10T10:52:57.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.876+0000 7f72dd33e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 0x7f72d8197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.876+0000 7f72dd33e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 0x7f72d8197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48128/0 (socket says 172.21.15.59:48128) 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.876+0000 7f72dd33e640 1 -- 172.21.15.59:0/3326672545 learned_addr learned my addr 172.21.15.59:0/3326672545 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.877+0000 7f72dd33e640 1 -- 172.21.15.59:0/3326672545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d8197640 con 0x7f72d8106560 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.877+0000 7f72dd33e640 1 --2- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 0x7f72d8197100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009d40 tx=0x7f72d402fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.877+0000 7f72ce7fc640 1 -- 172.21.15.59:0/3326672545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72d4047070 con 0x7f72d8106560 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.877+0000 7f72ce7fc640 1 -- 172.21.15.59:0/3326672545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72d4003e40 con 0x7f72d8106560 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.877+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d81978d0 con 0x7f72d8106560 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.877+0000 7f72ce7fc640 1 -- 172.21.15.59:0/3326672545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72d4033050 con 0x7f72d8106560 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.877+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d8197d50 con 0x7f72d8106560 2024-09-10T10:52:57.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.878+0000 7f72ce7fc640 1 -- 172.21.15.59:0/3326672545 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f72d404a070 con 0x7f72d8106560 2024-09-10T10:52:57.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.878+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d8101bd0 con 0x7f72d8106560 2024-09-10T10:52:57.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.878+0000 7f72ce7fc640 1 --2- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f72c4039060 0x7f72c403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:57.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.878+0000 7f72ce7fc640 1 -- 172.21.15.59:0/3326672545 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f72d403e030 con 0x7f72d8106560 2024-09-10T10:52:57.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.878+0000 7f72dcb3d640 1 --2- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f72c4039060 0x7f72c403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:57.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.879+0000 7f72dcb3d640 1 --2- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f72c4039060 0x7f72c403b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72c80098c0 tx=0x7f72c8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:57.883+0000 7f72ce7fc640 1 -- 172.21.15.59:0/3326672545 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72d4004180 con 0x7f72d8106560 2024-09-10T10:52:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:52:58.061+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}) -- 0x7f72d8198460 con 0x7f72c4039060 2024-09-10T10:52:59.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:52:58 smithi059 ceph-mon[30978]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:53:00.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:00.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:00.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:00.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:00.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:00.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:53:00.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:00.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:00.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-10T10:53:00.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: Deploying cephadm binary to smithi181 2024-09-10T10:53:00.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:00.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:53:00.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:00.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:00.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:01.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:01 smithi059 ceph-mon[30978]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:53:01.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.923+0000 7f72ce7fc640 1 -- 172.21.15.59:0/3326672545 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f72d8198460 con 0x7f72c4039060 2024-09-10T10:53:01.925 INFO:teuthology.orchestra.run.smithi059.stdout:Added host 'smithi181' with addr '172.21.15.181' 2024-09-10T10:53:01.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.925+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f72c4039060 msgr2=0x7f72c403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.925+0000 7f72df5a2640 1 --2- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f72c4039060 0x7f72c403b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72c80098c0 tx=0x7f72c8006db0 comp rx=0 tx=0).stop 2024-09-10T10:53:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.926+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 msgr2=0x7f72d8197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.926+0000 7f72df5a2640 1 --2- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 0x7f72d8197100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009d40 tx=0x7f72d402fc10 comp rx=0 tx=0).stop 2024-09-10T10:53:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.926+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 shutdown_connections 2024-09-10T10:53:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.926+0000 7f72df5a2640 1 --2- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f72c4039060 0x7f72c403b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.926+0000 7f72df5a2640 1 --2- 172.21.15.59:0/3326672545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72d8106560 0x7f72d8197100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.926+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 >> 172.21.15.59:0/3326672545 conn(0x7f72d80fc1b0 msgr2=0x7f72d8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.926+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 shutdown_connections 2024-09-10T10:53:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:01.926+0000 7f72df5a2640 1 -- 172.21.15.59:0/3326672545 wait complete. 2024-09-10T10:53:02.238 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:02 smithi059 ceph-mon[30978]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:02.238 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:02.238 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:02.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T10:53:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:53:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.198+0000 7fb74ceaf640 1 -- 172.21.15.59:0/1551359128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 msgr2=0x7fb748102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.198+0000 7fb74ceaf640 1 --2- 172.21.15.59:0/1551359128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 0x7fb748102b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb738009880 tx=0x7fb73802a670 comp rx=0 tx=0).stop 2024-09-10T10:53:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.198+0000 7fb74ceaf640 1 -- 172.21.15.59:0/1551359128 shutdown_connections 2024-09-10T10:53:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.198+0000 7fb74ceaf640 1 --2- 172.21.15.59:0/1551359128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 0x7fb748102b40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.198+0000 7fb74ceaf640 1 -- 172.21.15.59:0/1551359128 >> 172.21.15.59:0/1551359128 conn(0x7fb7480fc1a0 msgr2=0x7fb7480fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.198+0000 7fb74ceaf640 1 -- 172.21.15.59:0/1551359128 shutdown_connections 2024-09-10T10:53:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.198+0000 7fb74ceaf640 1 -- 172.21.15.59:0/1551359128 wait complete. 2024-09-10T10:53:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.199+0000 7fb74ceaf640 1 Processor -- start 2024-09-10T10:53:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.199+0000 7fb74ceaf640 1 -- start start 2024-09-10T10:53:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.199+0000 7fb74ceaf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 0x7fb7481003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.199+0000 7fb74ceaf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb74810bcd0 con 0x7fb748102760 2024-09-10T10:53:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.199+0000 7fb74659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 0x7fb7481003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.199+0000 7fb74659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 0x7fb7481003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48150/0 (socket says 172.21.15.59:48150) 2024-09-10T10:53:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.199+0000 7fb74659c640 1 -- 172.21.15.59:0/2569662993 learned_addr learned my addr 172.21.15.59:0/2569662993 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:53:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.199+0000 7fb74659c640 1 -- 172.21.15.59:0/2569662993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7481022b0 con 0x7fb748102760 2024-09-10T10:53:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.200+0000 7fb74659c640 1 --2- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 0x7fb7481003c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb738009230 tx=0x7fb738003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.200+0000 7fb7377fe640 1 -- 172.21.15.59:0/2569662993 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb73803f070 con 0x7fb748102760 2024-09-10T10:53:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.200+0000 7fb7377fe640 1 -- 172.21.15.59:0/2569662993 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb73803bc80 con 0x7fb748102760 2024-09-10T10:53:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.200+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb748100900 con 0x7fb748102760 2024-09-10T10:53:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.200+0000 7fb7377fe640 1 -- 172.21.15.59:0/2569662993 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb738035030 con 0x7fb748102760 2024-09-10T10:53:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.200+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb748100dc0 con 0x7fb748102760 2024-09-10T10:53:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.201+0000 7fb7377fe640 1 -- 172.21.15.59:0/2569662993 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb738042070 con 0x7fb748102760 2024-09-10T10:53:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.201+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb74806a7b0 con 0x7fb748102760 2024-09-10T10:53:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.201+0000 7fb7377fe640 1 --2- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb730039060 0x7fb73003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.201+0000 7fb7377fe640 1 -- 172.21.15.59:0/2569662993 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb73806c9f0 con 0x7fb748102760 2024-09-10T10:53:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.201+0000 7fb745d9b640 1 --2- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb730039060 0x7fb73003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.202+0000 7fb745d9b640 1 --2- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb730039060 0x7fb73003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0098c0 tx=0x7fb73c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:03.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.206+0000 7fb7377fe640 1 -- 172.21.15.59:0/2569662993 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb738031570 con 0x7fb748102760 2024-09-10T10:53:03.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.386+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7481018f0 con 0x7fb730039060 2024-09-10T10:53:03.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.387+0000 7fb7377fe640 1 -- 172.21.15.59:0/2569662993 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7fb7481018f0 con 0x7fb730039060 2024-09-10T10:53:03.389 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:53:03.389 INFO:teuthology.orchestra.run.smithi059.stdout:[{"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}, {"addr": "172.21.15.115", "hostname": "smithi115", "labels": [], "status": ""}, {"addr": "172.21.15.181", "hostname": "smithi181", "labels": [], "status": ""}] 2024-09-10T10:53:03.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb730039060 msgr2=0x7fb73003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:03.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 --2- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb730039060 0x7fb73003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0098c0 tx=0x7fb73c006db0 comp rx=0 tx=0).stop 2024-09-10T10:53:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 msgr2=0x7fb7481003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 --2- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 0x7fb7481003c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb738009230 tx=0x7fb738003d40 comp rx=0 tx=0).stop 2024-09-10T10:53:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 shutdown_connections 2024-09-10T10:53:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 --2- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb730039060 0x7fb73003b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 --2- 172.21.15.59:0/2569662993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb748102760 0x7fb7481003c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 >> 172.21.15.59:0/2569662993 conn(0x7fb7480fc1a0 msgr2=0x7fb748105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 shutdown_connections 2024-09-10T10:53:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:03.389+0000 7fb74ceaf640 1 -- 172.21.15.59:0/2569662993 wait complete. 2024-09-10T10:53:03.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:03 smithi059 ceph-mon[30978]: Added host smithi181 2024-09-10T10:53:03.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:03 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:03.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:03 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:03.998 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T10:53:03.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T10:53:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:53:04.600 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:04 smithi059 ceph-mon[30978]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:04.600 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:04 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:04.601 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:04 smithi059 ceph-mon[30978]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:53:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.680+0000 7f614969e640 1 -- 172.21.15.59:0/2382593604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 msgr2=0x7f6144102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.680+0000 7f614969e640 1 --2- 172.21.15.59:0/2382593604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 0x7f6144102b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6134009880 tx=0x7f613402a670 comp rx=0 tx=0).stop 2024-09-10T10:53:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.680+0000 7f614969e640 1 -- 172.21.15.59:0/2382593604 shutdown_connections 2024-09-10T10:53:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.680+0000 7f614969e640 1 --2- 172.21.15.59:0/2382593604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 0x7f6144102b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.680+0000 7f614969e640 1 -- 172.21.15.59:0/2382593604 >> 172.21.15.59:0/2382593604 conn(0x7f61440fc1b0 msgr2=0x7f61440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.680+0000 7f614969e640 1 -- 172.21.15.59:0/2382593604 shutdown_connections 2024-09-10T10:53:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.680+0000 7f614969e640 1 -- 172.21.15.59:0/2382593604 wait complete. 2024-09-10T10:53:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.681+0000 7f614969e640 1 Processor -- start 2024-09-10T10:53:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.681+0000 7f614969e640 1 -- start start 2024-09-10T10:53:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.681+0000 7f614969e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 0x7f61441971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.681+0000 7f614969e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f614410bcb0 con 0x7f61441027b0 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.681+0000 7f6142ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 0x7f61441971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.681+0000 7f6142ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 0x7f61441971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48168/0 (socket says 172.21.15.59:48168) 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.681+0000 7f6142ffd640 1 -- 172.21.15.59:0/2693357215 learned_addr learned my addr 172.21.15.59:0/2693357215 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.681+0000 7f6142ffd640 1 -- 172.21.15.59:0/2693357215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61441976f0 con 0x7f61441027b0 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.681+0000 7f6142ffd640 1 --2- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 0x7f61441971b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6134009230 tx=0x7f6134003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.682+0000 7f6140ff9640 1 -- 172.21.15.59:0/2693357215 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f613403f070 con 0x7f61441027b0 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.682+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6144197980 con 0x7f61441027b0 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.682+0000 7f6140ff9640 1 -- 172.21.15.59:0/2693357215 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f613403bd40 con 0x7f61441027b0 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.682+0000 7f6140ff9640 1 -- 172.21.15.59:0/2693357215 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6134035030 con 0x7f61441027b0 2024-09-10T10:53:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.682+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6144197de0 con 0x7f61441027b0 2024-09-10T10:53:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.683+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614406a750 con 0x7f61441027b0 2024-09-10T10:53:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.683+0000 7f6140ff9640 1 -- 172.21.15.59:0/2693357215 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6134042070 con 0x7f61441027b0 2024-09-10T10:53:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.683+0000 7f6140ff9640 1 --2- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f6130039060 0x7f613003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.683+0000 7f6140ff9640 1 -- 172.21.15.59:0/2693357215 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f613406cc40 con 0x7f61441027b0 2024-09-10T10:53:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.683+0000 7f613bfff640 1 --2- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f6130039060 0x7f613003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.684+0000 7f613bfff640 1 --2- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f6130039060 0x7f613003b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f612c0098c0 tx=0x7f612c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.688+0000 7f6140ff9640 1 -- 172.21.15.59:0/2693357215 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6134036df0 con 0x7f61441027b0 2024-09-10T10:53:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:04.869+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f6144198570 con 0x7f61441027b0 2024-09-10T10:53:05.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.297+0000 7f6140ff9640 1 -- 172.21.15.59:0/2693357215 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f613403b860 con 0x7f61441027b0 2024-09-10T10:53:05.299 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2024-09-10T10:53:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f6130039060 msgr2=0x7f613003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 --2- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f6130039060 0x7f613003b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f612c0098c0 tx=0x7f612c006db0 comp rx=0 tx=0).stop 2024-09-10T10:53:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 msgr2=0x7f61441971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 --2- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 0x7f61441971b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6134009230 tx=0x7f6134003d80 comp rx=0 tx=0).stop 2024-09-10T10:53:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 shutdown_connections 2024-09-10T10:53:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 --2- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f6130039060 0x7f613003b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 --2- 172.21.15.59:0/2693357215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61441027b0 0x7f61441971b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:05.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 >> 172.21.15.59:0/2693357215 conn(0x7f61440fc1b0 msgr2=0x7f6144103560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:05.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 shutdown_connections 2024-09-10T10:53:05.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:05.300+0000 7f614969e640 1 -- 172.21.15.59:0/2693357215 wait complete. 2024-09-10T10:53:05.593 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:05 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2693357215' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T10:53:05.877 INFO:tasks.cephadm:Adding mon.a on smithi059 2024-09-10T10:53:05.877 INFO:tasks.cephadm:Adding mon.b on smithi115 2024-09-10T10:53:05.877 INFO:tasks.cephadm:Adding mon.c on smithi181 2024-09-10T10:53:05.877 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi059:172.21.15.59=a;smithi115:172.21.15.115=b;smithi181:172.21.15.181=c' 2024-09-10T10:53:06.135 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T10:53:06.180 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T10:53:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2693357215' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T10:53:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:53:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:06.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:53:06.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:06.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:06.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.637+0000 7f06c2d46640 1 -- 172.21.15.181:0/3714299972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 msgr2=0x7f06bc104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:06.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.637+0000 7f06c2d46640 1 --2- 172.21.15.181:0/3714299972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 0x7f06bc104460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009880 tx=0x7f06b802a5d0 comp rx=0 tx=0).stop 2024-09-10T10:53:06.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.637+0000 7f06c2d46640 1 -- 172.21.15.181:0/3714299972 shutdown_connections 2024-09-10T10:53:06.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.637+0000 7f06c2d46640 1 --2- 172.21.15.181:0/3714299972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 0x7f06bc104460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.637+0000 7f06c2d46640 1 -- 172.21.15.181:0/3714299972 >> 172.21.15.181:0/3714299972 conn(0x7f06bc0fbc70 msgr2=0x7f06bc0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.637+0000 7f06c2d46640 1 -- 172.21.15.181:0/3714299972 shutdown_connections 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.637+0000 7f06c2d46640 1 -- 172.21.15.181:0/3714299972 wait complete. 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.638+0000 7f06c2d46640 1 Processor -- start 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.638+0000 7f06c2d46640 1 -- start start 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.638+0000 7f06c2d46640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 0x7f06bc1018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.638+0000 7f06c2d46640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06bc107680 con 0x7f06bc102070 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.638+0000 7f06c0ae2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 0x7f06bc1018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.638+0000 7f06c0ae2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 0x7f06bc1018f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.181:43888/0 (socket says 172.21.15.181:43888) 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.638+0000 7f06c0ae2640 1 -- 172.21.15.181:0/1729254619 learned_addr learned my addr 172.21.15.181:0/1729254619 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.638+0000 7f06c0ae2640 1 -- 172.21.15.181:0/1729254619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06bc101e30 con 0x7f06bc102070 2024-09-10T10:53:06.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.639+0000 7f06c0ae2640 1 --2- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 0x7f06bc1018f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06b8004f60 tx=0x7f06b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.639+0000 7f06b1ffb640 1 -- 172.21.15.181:0/1729254619 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06b803f070 con 0x7f06bc102070 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.639+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06bc100020 con 0x7f06bc102070 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.639+0000 7f06b1ffb640 1 -- 172.21.15.181:0/1729254619 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06b8003ad0 con 0x7f06bc102070 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.639+0000 7f06b1ffb640 1 -- 172.21.15.181:0/1729254619 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06b8035030 con 0x7f06bc102070 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.639+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06bc100560 con 0x7f06bc102070 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.640+0000 7f06b1ffb640 1 -- 172.21.15.181:0/1729254619 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f06b8042070 con 0x7f06bc102070 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.640+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06bc107e00 con 0x7f06bc102070 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.640+0000 7f06b1ffb640 1 --2- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f06a4039060 0x7f06a403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.640+0000 7f06b1ffb640 1 -- 172.21.15.181:0/1729254619 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f06b806ce00 con 0x7f06bc102070 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.641+0000 7f06b3fff640 1 --2- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f06a4039060 0x7f06a403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.641+0000 7f06b3fff640 1 --2- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f06a4039060 0x7f06a403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0098c0 tx=0x7f06ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:06.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.645+0000 7f06b1ffb640 1 -- 172.21.15.181:0/1729254619 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06b804c350 con 0x7f06bc102070 2024-09-10T10:53:06.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.834+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi059:172.21.15.59=a;smithi115:172.21.15.115=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}) -- 0x7f06bc190420 con 0x7f06a4039060 2024-09-10T10:53:06.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.840+0000 7f06b1ffb640 1 -- 172.21.15.181:0/1729254619 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f06bc190420 con 0x7f06a4039060 2024-09-10T10:53:06.841 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mon update... 2024-09-10T10:53:06.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f06a4039060 msgr2=0x7f06a403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:06.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 --2- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f06a4039060 0x7f06a403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0098c0 tx=0x7f06ac006db0 comp rx=0 tx=0).stop 2024-09-10T10:53:06.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 msgr2=0x7f06bc1018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:06.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 --2- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 0x7f06bc1018f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06b8004f60 tx=0x7f06b80048f0 comp rx=0 tx=0).stop 2024-09-10T10:53:06.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 shutdown_connections 2024-09-10T10:53:06.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 --2- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f06a4039060 0x7f06a403b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:06.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 --2- 172.21.15.181:0/1729254619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06bc102070 0x7f06bc1018f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:06.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 >> 172.21.15.181:0/1729254619 conn(0x7f06bc0fbc70 msgr2=0x7f06bc0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:06.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 shutdown_connections 2024-09-10T10:53:06.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:06.842+0000 7f06c2d46640 1 -- 172.21.15.181:0/1729254619 wait complete. 2024-09-10T10:53:07.451 DEBUG:teuthology.orchestra.run.smithi115:mon.b> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T10:53:07.454 DEBUG:teuthology.orchestra.run.smithi181:mon.c> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T10:53:07.456 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:53:07.457 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:53:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:07 smithi059 ceph-mon[30978]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-10T10:53:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:07 smithi059 ceph-mon[30978]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:07 smithi059 ceph-mon[30978]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:53:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:08.200 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:08.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.601+0000 7f73ce7fc640 1 -- 172.21.15.181:0/2033292675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 msgr2=0x7f73c8106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.601+0000 7f73ce7fc640 1 --2- 172.21.15.181:0/2033292675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 0x7f73c8106940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009880 tx=0x7f73b802a5d0 comp rx=0 tx=0).stop 2024-09-10T10:53:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.601+0000 7f73ce7fc640 1 -- 172.21.15.181:0/2033292675 shutdown_connections 2024-09-10T10:53:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.601+0000 7f73ce7fc640 1 --2- 172.21.15.181:0/2033292675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 0x7f73c8106940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.601+0000 7f73ce7fc640 1 -- 172.21.15.181:0/2033292675 >> 172.21.15.181:0/2033292675 conn(0x7f73c80fc1b0 msgr2=0x7f73c80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.601+0000 7f73ce7fc640 1 -- 172.21.15.181:0/2033292675 shutdown_connections 2024-09-10T10:53:08.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.601+0000 7f73ce7fc640 1 -- 172.21.15.181:0/2033292675 wait complete. 2024-09-10T10:53:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.602+0000 7f73ce7fc640 1 Processor -- start 2024-09-10T10:53:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.602+0000 7f73ce7fc640 1 -- start start 2024-09-10T10:53:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.602+0000 7f73ce7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 0x7f73c8194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.602+0000 7f73ce7fc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8109a80 con 0x7f73c8106560 2024-09-10T10:53:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.602+0000 7f73c7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 0x7f73c8194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.602+0000 7f73c7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 0x7f73c8194ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.181:34888/0 (socket says 172.21.15.181:34888) 2024-09-10T10:53:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.602+0000 7f73c7fff640 1 -- 172.21.15.181:0/1070558052 learned_addr learned my addr 172.21.15.181:0/1070558052 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:53:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.603+0000 7f73c7fff640 1 -- 172.21.15.181:0/1070558052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c8195410 con 0x7f73c8106560 2024-09-10T10:53:08.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.603+0000 7f73c7fff640 1 --2- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 0x7f73c8194ed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009230 tx=0x7f73b8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:08.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.603+0000 7f73c57fa640 1 -- 172.21.15.181:0/1070558052 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73b803f070 con 0x7f73c8106560 2024-09-10T10:53:08.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.603+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c81956a0 con 0x7f73c8106560 2024-09-10T10:53:08.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.603+0000 7f73c57fa640 1 -- 172.21.15.181:0/1070558052 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b803bc80 con 0x7f73c8106560 2024-09-10T10:53:08.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.603+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c81997a0 con 0x7f73c8106560 2024-09-10T10:53:08.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.603+0000 7f73c57fa640 1 -- 172.21.15.181:0/1070558052 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73b8049060 con 0x7f73c8106560 2024-09-10T10:53:08.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.604+0000 7f73c57fa640 1 -- 172.21.15.181:0/1070558052 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f73b8042070 con 0x7f73c8106560 2024-09-10T10:53:08.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.604+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c8101bd0 con 0x7f73c8106560 2024-09-10T10:53:08.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.604+0000 7f73c57fa640 1 --2- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f73b003b2c0 0x7f73b003d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:08.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.604+0000 7f73c57fa640 1 -- 172.21.15.181:0/1070558052 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f73b806cd00 con 0x7f73c8106560 2024-09-10T10:53:08.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.605+0000 7f73c77fe640 1 --2- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f73b003b2c0 0x7f73b003d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:08.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.605+0000 7f73c77fe640 1 --2- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f73b003b2c0 0x7f73b003d780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0098c0 tx=0x7f73bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:08.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.610+0000 7f73c57fa640 1 -- 172.21.15.181:0/1070558052 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73b8031d40 con 0x7f73c8106560 2024-09-10T10:53:08.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:08 smithi059 ceph-mon[30978]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:08.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:08 smithi059 ceph-mon[30978]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:53:08.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:08 smithi059 ceph-mon[30978]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi059:172.21.15.59=a;smithi115:172.21.15.115=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:53:08.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:08 smithi059 ceph-mon[30978]: Saving service mon spec with placement smithi059:172.21.15.59=a;smithi115:172.21.15.115=b;smithi181:172.21.15.181=c;count:3 2024-09-10T10:53:08.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:08 smithi059 ceph-mon[30978]: Deploying daemon mon.c on smithi181 2024-09-10T10:53:08.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.847+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f73c8196230 con 0x7f73c8106560 2024-09-10T10:53:08.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.848+0000 7f73c57fa640 1 -- 172.21.15.181:0/1070558052 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f73b80314c0 con 0x7f73c8106560 2024-09-10T10:53:08.849 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:53:08.850 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","modified":"2024-09-10T10:51:50.263729Z","created":"2024-09-10T10:51:50.263729Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T10:53:08.851 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-09-10T10:53:08.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f73b003b2c0 msgr2=0x7f73b003d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:08.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 --2- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f73b003b2c0 0x7f73b003d780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0098c0 tx=0x7f73bc006db0 comp rx=0 tx=0).stop 2024-09-10T10:53:08.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 msgr2=0x7f73c8194ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:08.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 --2- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 0x7f73c8194ed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009230 tx=0x7f73b8003d40 comp rx=0 tx=0).stop 2024-09-10T10:53:08.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 shutdown_connections 2024-09-10T10:53:08.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 --2- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f73b003b2c0 0x7f73b003d780 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:08.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 --2- 172.21.15.181:0/1070558052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73c8106560 0x7f73c8194ed0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:08.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 >> 172.21.15.181:0/1070558052 conn(0x7f73c80fc1b0 msgr2=0x7f73c80fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:08.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 shutdown_connections 2024-09-10T10:53:08.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:08.850+0000 7f73ce7fc640 1 -- 172.21.15.181:0/1070558052 wait complete. 2024-09-10T10:53:09.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:09 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/1070558052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:53:10.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:10 smithi059 ceph-mon[30978]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:11.801 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:53:11.802 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:53:11.827 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:11 smithi181 systemd[1]: Started Ceph mon.c for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:53:12.061 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:53:16.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: mon.a calling monitor election 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: mon.c calling monitor election 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:53:16.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: monmap epoch 2 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: last_changed 2024-09-10T10:53:11.499335+0000 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: min_mon_release 19 (squid) 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: election_strategy: 1 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: fsmap 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: mgrmap e13: x(active, since 37s) 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: overall HEALTH_OK 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:16.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:16.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:16.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:16.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:16.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:16.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:53:16.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: mon.a calling monitor election 2024-09-10T10:53:16.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:16.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: mon.c calling monitor election 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: monmap epoch 2 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: last_changed 2024-09-10T10:53:11.499335+0000 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: min_mon_release 19 (squid) 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: election_strategy: 1 2024-09-10T10:53:16.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: fsmap 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: mgrmap e13: x(active, since 37s) 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: overall HEALTH_OK 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:16.939 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:17.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.055+0000 7f104759e640 1 -- 172.21.15.181:0/1695919157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10481064f0 msgr2=0x7f1030005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:17.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.055+0000 7f104759e640 1 --2- 172.21.15.181:0/1695919157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10481064f0 0x7f1030005580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1038012c60 tx=0x7f103802c620 comp rx=0 tx=0).stop 2024-09-10T10:53:17.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.055+0000 7f104759e640 1 -- 172.21.15.181:0/1695919157 shutdown_connections 2024-09-10T10:53:17.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.055+0000 7f104759e640 1 --2- 172.21.15.181:0/1695919157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10481064f0 0x7f1030005580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.055+0000 7f104759e640 1 -- 172.21.15.181:0/1695919157 >> 172.21.15.181:0/1695919157 conn(0x7f10480784e0 msgr2=0x7f10480788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.055+0000 7f104759e640 1 -- 172.21.15.181:0/1695919157 shutdown_connections 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.055+0000 7f104759e640 1 -- 172.21.15.181:0/1695919157 wait complete. 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.056+0000 7f104759e640 1 Processor -- start 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.056+0000 7f104759e640 1 -- start start 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104759e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 0x7f10480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1048074a30 0x7f1048074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104759e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f10481095d0 con 0x7f1048074a30 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104759e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1048109450 con 0x7f10481064f0 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 0x7f10480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:17.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 0x7f10480744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41696/0 (socket says 172.21.15.181:41696) 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104659c640 1 -- 172.21.15.181:0/3630371709 learned_addr learned my addr 172.21.15.181:0/3630371709 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104659c640 1 -- 172.21.15.181:0/3630371709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 msgr2=0x7f10480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104659c640 1 -- 172.21.15.181:0/3630371709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 msgr2=0x7f10480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104659c640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 0x7f10480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f1045d9b640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1048074a30 0x7f1048074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f104659c640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 0x7f10480744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f1045d9b640 1 -- 172.21.15.181:0/3630371709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 msgr2=0x7f10480744f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f1045d9b640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 0x7f10480744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.057+0000 7f1045d9b640 1 -- 172.21.15.181:0/3630371709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10480763e0 con 0x7f1048074a30 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.058+0000 7f1045d9b640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1048074a30 0x7f1048074e90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f103c00b400 tx=0x7f103c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.058+0000 7f10377fe640 1 -- 172.21.15.181:0/3630371709 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f103c011630 con 0x7f1048074a30 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.058+0000 7f10377fe640 1 -- 172.21.15.181:0/3630371709 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f103c011cb0 con 0x7f1048074a30 2024-09-10T10:53:17.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.058+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10481a3300 con 0x7f1048074a30 2024-09-10T10:53:17.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.058+0000 7f10377fe640 1 -- 172.21.15.181:0/3630371709 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f103c010d80 con 0x7f1048074a30 2024-09-10T10:53:17.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.058+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10481a3890 con 0x7f1048074a30 2024-09-10T10:53:17.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.059+0000 7f10377fe640 1 -- 172.21.15.181:0/3630371709 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f103c018020 con 0x7f1048074a30 2024-09-10T10:53:17.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.059+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1048102bf0 con 0x7f1048074a30 2024-09-10T10:53:17.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.059+0000 7f10377fe640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1028038df0 0x7f102803b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:17.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.059+0000 7f10377fe640 1 -- 172.21.15.181:0/3630371709 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f103c04bd00 con 0x7f1048074a30 2024-09-10T10:53:17.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.060+0000 7f104659c640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1028038df0 0x7f102803b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:17.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.060+0000 7f104659c640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1028038df0 0x7f102803b2b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1038035040 tx=0x7f1038033660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:17.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.065+0000 7f10377fe640 1 -- 172.21.15.181:0/3630371709 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f103c01f020 con 0x7f1048074a30 2024-09-10T10:53:17.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.292+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f104802d7c0 con 0x7f1048074a30 2024-09-10T10:53:17.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.293+0000 7f10377fe640 1 -- 172.21.15.181:0/3630371709 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f103c018310 con 0x7f1048074a30 2024-09-10T10:53:17.294 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:53:17.295 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","modified":"2024-09-10T10:53:11.499335Z","created":"2024-09-10T10:51:50.263729Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T10:53:17.295 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-09-10T10:53:17.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1028038df0 msgr2=0x7f102803b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:17.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1028038df0 0x7f102803b2b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1038035040 tx=0x7f1038033660 comp rx=0 tx=0).stop 2024-09-10T10:53:17.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1048074a30 msgr2=0x7f1048074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:17.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1048074a30 0x7f1048074e90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f103c00b400 tx=0x7f103c00b8c0 comp rx=0 tx=0).stop 2024-09-10T10:53:17.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 shutdown_connections 2024-09-10T10:53:17.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1028038df0 0x7f102803b2b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:17.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1048074a30 0x7f1048074e90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:17.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 --2- 172.21.15.181:0/3630371709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10481064f0 0x7f10480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:17.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 >> 172.21.15.181:0/3630371709 conn(0x7f10480784e0 msgr2=0x7f10480ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:17.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 shutdown_connections 2024-09-10T10:53:17.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:17.296+0000 7f104759e640 1 -- 172.21.15.181:0/3630371709 wait complete. 2024-09-10T10:53:17.840 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:17 smithi181 ceph-mon[35409]: Deploying daemon mon.b on smithi115 2024-09-10T10:53:17.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:17 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/3630371709' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:53:17.841 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:17 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:17.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:17 smithi059 ceph-mon[30978]: Deploying daemon mon.b on smithi115 2024-09-10T10:53:17.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:17 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/3630371709' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:53:17.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:17 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:18.867 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:53:18.868 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:53:18.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:18 smithi059 ceph-mon[30978]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:18.895 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:18 smithi181 ceph-mon[35409]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:19.114 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:53:19.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.605+0000 7fba4cc1e640 1 -- 172.21.15.181:0/3783827393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba48107660 msgr2=0x7fba48107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:19.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.605+0000 7fba4cc1e640 1 --2- 172.21.15.181:0/3783827393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba48107660 0x7fba48107a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba38009880 tx=0x7fba3802a5d0 comp rx=0 tx=0).stop 2024-09-10T10:53:19.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.606+0000 7fba4cc1e640 1 -- 172.21.15.181:0/3783827393 shutdown_connections 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.606+0000 7fba4cc1e640 1 --2- 172.21.15.181:0/3783827393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba48107660 0x7fba48107a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.606+0000 7fba4cc1e640 1 -- 172.21.15.181:0/3783827393 >> 172.21.15.181:0/3783827393 conn(0x7fba480fd320 msgr2=0x7fba480ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.606+0000 7fba4cc1e640 1 -- 172.21.15.181:0/3783827393 shutdown_connections 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.606+0000 7fba4cc1e640 1 -- 172.21.15.181:0/3783827393 wait complete. 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.606+0000 7fba4cc1e640 1 Processor -- start 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.606+0000 7fba4cc1e640 1 -- start start 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4cc1e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 0x7fba481973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4cc1e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba48197900 0x7fba4819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4cc1e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba4810bd20 con 0x7fba48197900 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4cc1e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fba4810bba0 con 0x7fba48107660 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 0x7fba481973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 0x7fba481973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46126/0 (socket says 172.21.15.181:46126) 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4659c640 1 -- 172.21.15.181:0/4095137443 learned_addr learned my addr 172.21.15.181:0/4095137443 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba45d9b640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba48197900 0x7fba4819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4659c640 1 -- 172.21.15.181:0/4095137443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 msgr2=0x7fba481973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4659c640 1 -- 172.21.15.181:0/4095137443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 msgr2=0x7fba481973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4659c640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 0x7fba481973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba4659c640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 0x7fba481973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba45d9b640 1 -- 172.21.15.181:0/4095137443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 msgr2=0x7fba481973c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba45d9b640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 0x7fba481973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba45d9b640 1 -- 172.21.15.181:0/4095137443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba48197f20 con 0x7fba48197900 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.607+0000 7fba45d9b640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba48197900 0x7fba4819bc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00b3d0 tx=0x7fba3c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.608+0000 7fba377fe640 1 -- 172.21.15.181:0/4095137443 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fba3c011630 con 0x7fba48197900 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.608+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4819c1d0 con 0x7fba48197900 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.608+0000 7fba377fe640 1 -- 172.21.15.181:0/4095137443 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba3c011cb0 con 0x7fba48197900 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.608+0000 7fba377fe640 1 -- 172.21.15.181:0/4095137443 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fba3c010df0 con 0x7fba48197900 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.608+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4819c710 con 0x7fba48197900 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.609+0000 7fba377fe640 1 -- 172.21.15.181:0/4095137443 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fba3c018020 con 0x7fba48197900 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.609+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba48102da0 con 0x7fba48197900 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.609+0000 7fba377fe640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fba30038e00 0x7fba3003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.609+0000 7fba377fe640 1 -- 172.21.15.181:0/4095137443 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fba3c04bc00 con 0x7fba48197900 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.609+0000 7fba4659c640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fba30038e00 0x7fba3003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.610+0000 7fba4659c640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fba30038e00 0x7fba3003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba380096c0 tx=0x7fba38005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.617+0000 7fba377fe640 1 -- 172.21.15.181:0/4095137443 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba3c052080 con 0x7fba48197900 2024-09-10T10:53:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.843+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fba4819ca20 con 0x7fba48197900 2024-09-10T10:53:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.844+0000 7fba377fe640 1 -- 172.21.15.181:0/4095137443 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fba3c01f020 con 0x7fba48197900 2024-09-10T10:53:19.845 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:53:19.846 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","modified":"2024-09-10T10:53:11.499335Z","created":"2024-09-10T10:51:50.263729Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T10:53:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-09-10T10:53:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fba30038e00 msgr2=0x7fba3003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fba30038e00 0x7fba3003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba380096c0 tx=0x7fba38005a40 comp rx=0 tx=0).stop 2024-09-10T10:53:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba48197900 msgr2=0x7fba4819bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba48197900 0x7fba4819bc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00b3d0 tx=0x7fba3c00b890 comp rx=0 tx=0).stop 2024-09-10T10:53:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 shutdown_connections 2024-09-10T10:53:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fba30038e00 0x7fba3003b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba48197900 0x7fba4819bc90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 --2- 172.21.15.181:0/4095137443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba48107660 0x7fba481973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 >> 172.21.15.181:0/4095137443 conn(0x7fba480fd320 msgr2=0x7fba480fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 shutdown_connections 2024-09-10T10:53:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:19.846+0000 7fba4cc1e640 1 -- 172.21.15.181:0/4095137443 wait complete. 2024-09-10T10:53:20.419 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:20 smithi115 ceph-mon[34719]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T10:53:20.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:20 smithi115 bash[34699]: 32a1631198bff76f6f54c65ab9ad9451a6f074a166a60fc63f0ebe7022293f18 2024-09-10T10:53:20.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:20 smithi115 systemd[1]: Started Ceph mon.b for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:53:21.450 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:53:21.450 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:53:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:53:25.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.768+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/1504415805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50003530 msgr2=0x7f1d500059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:25.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.768+0000 7f1d6d3d8640 1 --2- 172.21.15.181:0/1504415805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50003530 0x7f1d500059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1d681016a0 tx=0x7f1d5802c3f0 comp rx=0 tx=0).stop 2024-09-10T10:53:25.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.768+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/1504415805 shutdown_connections 2024-09-10T10:53:25.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.768+0000 7f1d6d3d8640 1 --2- 172.21.15.181:0/1504415805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50003530 0x7f1d500059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:25.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.768+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/1504415805 >> 172.21.15.181:0/1504415805 conn(0x7f1d680fc220 msgr2=0x7f1d680fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:25.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.768+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/1504415805 shutdown_connections 2024-09-10T10:53:25.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.768+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/1504415805 wait complete. 2024-09-10T10:53:25.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:53:25.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: mon.c calling monitor election 2024-09-10T10:53:25.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: mon.a calling monitor election 2024-09-10T10:53:25.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:25.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:25.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.771 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: monmap epoch 3 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: last_changed 2024-09-10T10:53:20.391401+0000 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: min_mon_release 19 (squid) 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: election_strategy: 1 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-10T10:53:25.772 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: fsmap 2024-09-10T10:53:25.773 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:53:25.773 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: mgrmap e13: x(active, since 46s) 2024-09-10T10:53:25.773 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: overall HEALTH_OK 2024-09-10T10:53:25.773 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:25.773 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:25.773 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:25.773 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:25.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.769+0000 7f1d6d3d8640 1 Processor -- start 2024-09-10T10:53:25.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.769+0000 7f1d6d3d8640 1 -- start start 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.769+0000 7f1d6d3d8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d50003530 0x7f1d681972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d6d3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d68197810 0x7f1d6819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d6d3d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 0x7f1d6819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d6d3d8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1d68108670 con 0x7f1d68197810 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d6d3d8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1d681084f0 con 0x7f1d50003530 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d6d3d8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1d681087f0 con 0x7f1d6819c0e0 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d677fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 0x7f1d6819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d66ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d50003530 0x7f1d681972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d677fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 0x7f1d6819c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:46138/0 (socket says 172.21.15.181:46138) 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d677fe640 1 -- 172.21.15.181:0/2736535566 learned_addr learned my addr 172.21.15.181:0/2736535566 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d667fc640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d68197810 0x7f1d6819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:25.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d677fe640 1 -- 172.21.15.181:0/2736535566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 msgr2=0x7f1d6819c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d66ffd640 1 -- 172.21.15.181:0/2736535566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d50003530 msgr2=0x7f1d681972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d677fe640 1 -- 172.21.15.181:0/2736535566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 msgr2=0x7f1d6819c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d66ffd640 1 -- 172.21.15.181:0/2736535566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d50003530 msgr2=0x7f1d681972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d677fe640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 0x7f1d6819c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d66ffd640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d50003530 0x7f1d681972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d66ffd640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d50003530 0x7f1d681972d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d677fe640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 0x7f1d6819c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d667fc640 1 -- 172.21.15.181:0/2736535566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 msgr2=0x7f1d6819c590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d667fc640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 0x7f1d6819c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d667fc640 1 -- 172.21.15.181:0/2736535566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d50003530 msgr2=0x7f1d681972d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:53:25.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d667fc640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d50003530 0x7f1d681972d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.770+0000 7f1d667fc640 1 -- 172.21.15.181:0/2736535566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d681a3e50 con 0x7f1d68197810 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.771+0000 7f1d667fc640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d68197810 0x7f1d6819bba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00b450 tx=0x7f1d5c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.771+0000 7f1d4ffff640 1 -- 172.21.15.181:0/2736535566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c004230 con 0x7f1d68197810 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.771+0000 7f1d4ffff640 1 -- 172.21.15.181:0/2736535566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d5c0043d0 con 0x7f1d68197810 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.771+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d681a4080 con 0x7f1d68197810 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.771+0000 7f1d4ffff640 1 -- 172.21.15.181:0/2736535566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c003cb0 con 0x7f1d68197810 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.771+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d681a4610 con 0x7f1d68197810 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.772+0000 7f1d4ffff640 1 -- 172.21.15.181:0/2736535566 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1d5c00f050 con 0x7f1d68197810 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.772+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d681097a0 con 0x7f1d68197810 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.772+0000 7f1d4ffff640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1d540394f0 0x7f1d5403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.772+0000 7f1d4ffff640 1 -- 172.21.15.181:0/2736535566 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1d5c04bdb0 con 0x7f1d68197810 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.773+0000 7f1d66ffd640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1d540394f0 0x7f1d5403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:25.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.773+0000 7f1d66ffd640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1d540394f0 0x7f1d5403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d58014cc0 tx=0x7f1d58005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:25.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:25.778+0000 7f1d4ffff640 1 -- 172.21.15.181:0/2736535566 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d5c00d040 con 0x7f1d68197810 2024-09-10T10:53:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:53:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: mon.c calling monitor election 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: mon.a calling monitor election 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: monmap epoch 3 2024-09-10T10:53:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: last_changed 2024-09-10T10:53:20.391401+0000 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: min_mon_release 19 (squid) 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: election_strategy: 1 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: fsmap 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: mgrmap e13: x(active, since 46s) 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: overall HEALTH_OK 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:25.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:25.891 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:26.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.024+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1d681a4a00 con 0x7f1d68197810 2024-09-10T10:53:26.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.025+0000 7f1d4ffff640 1 -- 172.21.15.181:0/2736535566 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f1d5c011d00 con 0x7f1d68197810 2024-09-10T10:53:26.027 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:53:26.027 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":3,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","modified":"2024-09-10T10:53:20.391401Z","created":"2024-09-10T10:51:50.263729Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T10:53:26.027 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 3 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1d540394f0 msgr2=0x7f1d5403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1d540394f0 0x7f1d5403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d58014cc0 tx=0x7f1d58005f60 comp rx=0 tx=0).stop 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d68197810 msgr2=0x7f1d6819bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d68197810 0x7f1d6819bba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00b450 tx=0x7f1d5c00b910 comp rx=0 tx=0).stop 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 shutdown_connections 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f1d540394f0 0x7f1d5403b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d6819c0e0 0x7f1d6819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d68197810 0x7f1d6819bba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 --2- 172.21.15.181:0/2736535566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d50003530 0x7f1d681972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 >> 172.21.15.181:0/2736535566 conn(0x7f1d680fc220 msgr2=0x7f1d68105890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 shutdown_connections 2024-09-10T10:53:26.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:26.027+0000 7f1d6d3d8640 1 -- 172.21.15.181:0/2736535566 wait complete. 2024-09-10T10:53:26.763 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:26 smithi181 ceph-mon[35409]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:26.763 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:26.763 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:26 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/2736535566' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:53:26.764 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:26.790 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T10:53:26.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T10:53:26.819 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:26 smithi059 ceph-mon[30978]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:26.819 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:26.819 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:26 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/2736535566' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:53:26.819 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:27.055 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:53:27.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.535+0000 7fae32360640 1 -- 172.21.15.59:0/3637863949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c1002d0 msgr2=0x7fae2c1006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.535+0000 7fae32360640 1 --2- 172.21.15.59:0/3637863949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c1002d0 0x7fae2c1006b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009880 tx=0x7fae1c02a5d0 comp rx=0 tx=0).stop 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.535+0000 7fae32360640 1 -- 172.21.15.59:0/3637863949 shutdown_connections 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.535+0000 7fae32360640 1 --2- 172.21.15.59:0/3637863949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c1002d0 0x7fae2c1006b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.535+0000 7fae32360640 1 -- 172.21.15.59:0/3637863949 >> 172.21.15.59:0/3637863949 conn(0x7fae2c0fc120 msgr2=0x7fae2c0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.536+0000 7fae32360640 1 -- 172.21.15.59:0/3637863949 shutdown_connections 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.536+0000 7fae32360640 1 -- 172.21.15.59:0/3637863949 wait complete. 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.536+0000 7fae32360640 1 Processor -- start 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.536+0000 7fae32360640 1 -- start start 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae32360640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c1002d0 0x7fae2c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae32360640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c199b70 0x7fae2c19df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae32360640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae2c19e440 0x7fae2c19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:27.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae32360640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c10de90 con 0x7fae2c199b70 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae32360640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c10dd10 con 0x7fae2c1002d0 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae32360640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c10e010 con 0x7fae2c19e440 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c199b70 0x7fae2c19df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c1002d0 0x7fae2c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c199b70 0x7fae2c19df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51740/0 (socket says 172.21.15.59:51740) 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2b7fe640 1 -- 172.21.15.59:0/3666541456 learned_addr learned my addr 172.21.15.59:0/3666541456 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae308fd640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae2c19e440 0x7fae2c19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2b7fe640 1 -- 172.21.15.59:0/3666541456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae2c19e440 msgr2=0x7fae2c19e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2b7fe640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae2c19e440 0x7fae2c19e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2b7fe640 1 -- 172.21.15.59:0/3666541456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c1002d0 msgr2=0x7fae2c199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2b7fe640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c1002d0 0x7fae2c199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2b7fe640 1 -- 172.21.15.59:0/3666541456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c1a61b0 con 0x7fae2c199b70 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.537+0000 7fae2bfff640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c1002d0 0x7fae2c199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.538+0000 7fae2b7fe640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c199b70 0x7fae2c19df00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fae2000b520 tx=0x7fae2000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.538+0000 7fae297fa640 1 -- 172.21.15.59:0/3666541456 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20004230 con 0x7fae2c199b70 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.538+0000 7fae297fa640 1 -- 172.21.15.59:0/3666541456 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae200043d0 con 0x7fae2c199b70 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.538+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c1a63e0 con 0x7fae2c199b70 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.538+0000 7fae297fa640 1 -- 172.21.15.59:0/3666541456 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20003d60 con 0x7fae2c199b70 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.538+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c1a68f0 con 0x7fae2c199b70 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.539+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2c100730 con 0x7fae2c199b70 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.539+0000 7fae297fa640 1 -- 172.21.15.59:0/3666541456 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fae2000e070 con 0x7fae2c199b70 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.539+0000 7fae297fa640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fae140394f0 0x7fae1403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.539+0000 7fae297fa640 1 -- 172.21.15.59:0/3666541456 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fae2004ba70 con 0x7fae2c199b70 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.540+0000 7fae2bfff640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fae140394f0 0x7fae1403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.540+0000 7fae2bfff640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fae140394f0 0x7fae1403b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae1c000c00 tx=0x7fae1c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:27.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.548+0000 7fae297fa640 1 -- 172.21.15.59:0/3666541456 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae20014020 con 0x7fae2c199b70 2024-09-10T10:53:27.692 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: mon.c calling monitor election 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: mon.a calling monitor election 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:27.693 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: monmap epoch 3 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: last_changed 2024-09-10T10:53:20.391401+0000 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: min_mon_release 19 (squid) 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: election_strategy: 1 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: fsmap 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: mgrmap e13: x(active, since 46s) 2024-09-10T10:53:27.694 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: overall HEALTH_OK 2024-09-10T10:53:27.695 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:27.695 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:27.695 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:27.695 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:27.695 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:27.695 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:27.695 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='client.? 172.21.15.181:0/2736535566' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:53:27.695 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.744+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fae2c1a6ca0 con 0x7fae2c199b70 2024-09-10T10:53:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.744+0000 7fae297fa640 1 -- 172.21.15.59:0/3666541456 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7fae2000ed70 con 0x7fae2c199b70 2024-09-10T10:53:27.746 INFO:teuthology.orchestra.run.smithi059.stdout:# minimal ceph.conf for 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:27.746 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-09-10T10:53:27.747 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:27.747 INFO:teuthology.orchestra.run.smithi059.stdout: mon_host = [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-10T10:53:27.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fae140394f0 msgr2=0x7fae1403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:27.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fae140394f0 0x7fae1403b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae1c000c00 tx=0x7fae1c005a20 comp rx=0 tx=0).stop 2024-09-10T10:53:27.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c199b70 msgr2=0x7fae2c19df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:27.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c199b70 0x7fae2c19df00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fae2000b520 tx=0x7fae2000b9e0 comp rx=0 tx=0).stop 2024-09-10T10:53:27.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 shutdown_connections 2024-09-10T10:53:27.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fae140394f0 0x7fae1403b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:27.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae2c19e440 0x7fae2c19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:27.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae2c199b70 0x7fae2c19df00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 --2- 172.21.15.59:0/3666541456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae2c1002d0 0x7fae2c199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 >> 172.21.15.59:0/3666541456 conn(0x7fae2c0fc120 msgr2=0x7fae2c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 shutdown_connections 2024-09-10T10:53:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:27.748+0000 7fae32360640 1 -- 172.21.15.59:0/3666541456 wait complete. 2024-09-10T10:53:28.319 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: mon.b calling monitor election 2024-09-10T10:53:28.319 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:28.319 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: mon.b calling monitor election 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: mon.c calling monitor election 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: mon.a calling monitor election 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: monmap epoch 3 2024-09-10T10:53:28.320 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: last_changed 2024-09-10T10:53:20.391401+0000 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: min_mon_release 19 (squid) 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: election_strategy: 1 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: fsmap 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: mgrmap e13: x(active, since 48s) 2024-09-10T10:53:28.321 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: overall HEALTH_OK 2024-09-10T10:53:28.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.323 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.323 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.323 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.323 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:28.323 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:53:28.323 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:28.323 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:28 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3666541456' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:28.346 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T10:53:28.346 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:53:28.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T10:53:28.415 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:53:28.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:53:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: mon.b calling monitor election 2024-09-10T10:53:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T10:53:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-10T10:53:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-10T10:53:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: mon.b calling monitor election 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: mon.c calling monitor election 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: mon.a calling monitor election 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: monmap epoch 3 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: last_changed 2024-09-10T10:53:20.391401+0000 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: min_mon_release 19 (squid) 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: election_strategy: 1 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-10T10:53:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: fsmap 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: mgrmap e13: x(active, since 48s) 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: overall HEALTH_OK 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.440 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.440 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:28.440 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:53:28.440 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:28.440 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:28 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3666541456' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: mon.b calling monitor election 2024-09-10T10:53:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T10:53:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-10T10:53:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-10T10:53:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:53:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: mon.b calling monitor election 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: mon.c calling monitor election 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: mon.a calling monitor election 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: monmap epoch 3 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: last_changed 2024-09-10T10:53:20.391401+0000 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: created 2024-09-10T10:51:50.263729+0000 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: min_mon_release 19 (squid) 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: election_strategy: 1 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-10T10:53:28.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-10T10:53:28.461 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: fsmap 2024-09-10T10:53:28.461 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:53:28.461 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: mgrmap e13: x(active, since 48s) 2024-09-10T10:53:28.461 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: overall HEALTH_OK 2024-09-10T10:53:28.461 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.461 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.461 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.461 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.461 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:28.462 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:28 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3666541456' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:28.481 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:53:28.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T10:53:28.509 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:53:28.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:53:28.575 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:53:28.575 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T10:53:28.608 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:53:28.608 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:53:28.678 INFO:tasks.cephadm:Adding mgr.x on smithi059 2024-09-10T10:53:28.678 INFO:tasks.cephadm:Adding mgr.y on smithi115 2024-09-10T10:53:28.678 INFO:tasks.cephadm:Adding mgr.z on smithi181 2024-09-10T10:53:28.678 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi059=x;smithi115=y;smithi181=z' 2024-09-10T10:53:28.964 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:53:29.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:29 smithi181 ceph-mon[35409]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T10:53:29.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:29 smithi181 ceph-mon[35409]: Reconfiguring daemon mon.a on smithi059 2024-09-10T10:53:29.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:29 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:29.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:29 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:29.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:29 smithi059 ceph-mon[30978]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T10:53:29.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:29 smithi059 ceph-mon[30978]: Reconfiguring daemon mon.a on smithi059 2024-09-10T10:53:29.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:29 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:29.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:29 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.384+0000 7f57447a1640 1 -- 172.21.15.181:0/2494756307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f573c076220 msgr2=0x7f573c074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.384+0000 7f57447a1640 1 --2- 172.21.15.181:0/2494756307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f573c076220 0x7f573c074680 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5738009880 tx=0x7f573802a5d0 comp rx=0 tx=0).stop 2024-09-10T10:53:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.384+0000 7f57447a1640 1 -- 172.21.15.181:0/2494756307 shutdown_connections 2024-09-10T10:53:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.384+0000 7f57447a1640 1 --2- 172.21.15.181:0/2494756307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f573c076220 0x7f573c074680 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.384+0000 7f57447a1640 1 -- 172.21.15.181:0/2494756307 >> 172.21.15.181:0/2494756307 conn(0x7f573c0fce90 msgr2=0x7f573c0ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.384+0000 7f57447a1640 1 -- 172.21.15.181:0/2494756307 shutdown_connections 2024-09-10T10:53:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.384+0000 7f57447a1640 1 -- 172.21.15.181:0/2494756307 wait complete. 2024-09-10T10:53:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f57447a1640 1 Processor -- start 2024-09-10T10:53:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f57447a1640 1 -- start start 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f57447a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f573c076220 0x7f573c19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f57447a1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f573c19db00 0x7f573c1a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f57447a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c19df80 0x7f573c1a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f57447a1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f573c10de40 con 0x7f573c19db00 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f57447a1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f573c10dcc0 con 0x7f573c076220 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f57447a1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f573c10dfc0 con 0x7f573c19df80 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f5742d3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c19df80 0x7f573c1a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f5742d3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c19df80 0x7f573c1a5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:39768/0 (socket says 172.21.15.181:39768) 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f5742d3e640 1 -- 172.21.15.181:0/1797803924 learned_addr learned my addr 172.21.15.181:0/1797803924 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f5741d3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f573c19db00 0x7f573c1a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.385+0000 7f574253d640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f573c076220 0x7f573c19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f5742d3e640 1 -- 172.21.15.181:0/1797803924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f573c076220 msgr2=0x7f573c19d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f5742d3e640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f573c076220 0x7f573c19d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f5742d3e640 1 -- 172.21.15.181:0/1797803924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f573c19db00 msgr2=0x7f573c1a2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f5742d3e640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f573c19db00 0x7f573c1a2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f5742d3e640 1 -- 172.21.15.181:0/1797803924 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c1a59c0 con 0x7f573c19df80 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f5742d3e640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c19df80 0x7f573c1a5100 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f573400ba50 tx=0x7f573400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f57337fe640 1 -- 172.21.15.181:0/1797803924 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734019070 con 0x7f573c19df80 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f57337fe640 1 -- 172.21.15.181:0/1797803924 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f573400cbe0 con 0x7f573c19df80 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573c1a5cb0 con 0x7f573c19df80 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f57337fe640 1 -- 172.21.15.181:0/1797803924 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57340076a0 con 0x7f573c19df80 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.386+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573c1a61a0 con 0x7f573c19df80 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.387+0000 7f57337fe640 1 -- 172.21.15.181:0/1797803924 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f573401c070 con 0x7f573c19df80 2024-09-10T10:53:29.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.387+0000 7f57337fe640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f57280394f0 0x7f572803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:29.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.387+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573c196bc0 con 0x7f573c19df80 2024-09-10T10:53:29.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.387+0000 7f57337fe640 1 -- 172.21.15.181:0/1797803924 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f573404bb80 con 0x7f573c19df80 2024-09-10T10:53:29.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.387+0000 7f574253d640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f57280394f0 0x7f572803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:29.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.388+0000 7f574253d640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f57280394f0 0x7f572803b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5738005ab0 tx=0x7f57380315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:29.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.392+0000 7f57337fe640 1 -- 172.21.15.181:0/1797803924 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f573400ce00 con 0x7f573c19df80 2024-09-10T10:53:29.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:29 smithi115 ceph-mon[34719]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T10:53:29.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:29 smithi115 ceph-mon[34719]: Reconfiguring daemon mon.a on smithi059 2024-09-10T10:53:29.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:29 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:53:29.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:29 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:29.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.569+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi115=y;smithi181=z", "target": ["mon-mgr", ""]}) -- 0x7f573c0626c0 con 0x7f57280394f0 2024-09-10T10:53:29.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.574+0000 7f57337fe640 1 -- 172.21.15.181:0/1797803924 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f573c0626c0 con 0x7f57280394f0 2024-09-10T10:53:29.576 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mgr update... 2024-09-10T10:53:29.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.576+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f57280394f0 msgr2=0x7f572803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:29.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.576+0000 7f57447a1640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f57280394f0 0x7f572803b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5738005ab0 tx=0x7f57380315d0 comp rx=0 tx=0).stop 2024-09-10T10:53:29.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.576+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c19df80 msgr2=0x7f573c1a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:29.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.576+0000 7f57447a1640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c19df80 0x7f573c1a5100 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f573400ba50 tx=0x7f573400bf10 comp rx=0 tx=0).stop 2024-09-10T10:53:29.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.576+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 shutdown_connections 2024-09-10T10:53:29.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.576+0000 7f57447a1640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f57280394f0 0x7f572803b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:29.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.576+0000 7f57447a1640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f573c19df80 0x7f573c1a5100 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:29.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.576+0000 7f57447a1640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f573c19db00 0x7f573c1a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:29.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.577+0000 7f57447a1640 1 --2- 172.21.15.181:0/1797803924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f573c076220 0x7f573c19d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:29.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.577+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 >> 172.21.15.181:0/1797803924 conn(0x7f573c0fce90 msgr2=0x7f573c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:29.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.577+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 shutdown_connections 2024-09-10T10:53:29.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:53:29.577+0000 7f57447a1640 1 -- 172.21.15.181:0/1797803924 wait complete. 2024-09-10T10:53:30.175 DEBUG:teuthology.orchestra.run.smithi115:mgr.y> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T10:53:30.178 DEBUG:teuthology.orchestra.run.smithi181:mgr.z> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T10:53:30.182 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T10:53:30.182 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T10:53:30.182 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T10:53:30.204 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T10:53:30.204 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-09-10T10:53:30.263 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T10:53:30.263 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:30.263 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-10T10:53:30.263 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:30.263 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:30.264 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 10:52:47.034125774 +0000 2024-09-10T10:53:30.264 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 10:48:30.055961888 +0000 2024-09-10T10:53:30.264 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 10:48:30.055961888 +0000 2024-09-10T10:53:30.264 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 10:48:30.055961888 +0000 2024-09-10T10:53:30.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T10:53:30.335 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-10T10:53:30.335 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-10T10:53:30.335 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000231749 s, 2.2 MB/s 2024-09-10T10:53:30.336 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T10:53:30.397 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-09-10T10:53:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: Reconfiguring mon.b (monmap changed)... 2024-09-10T10:53:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:53:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: Reconfiguring daemon mon.b on smithi115 2024-09-10T10:53:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi115=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:53:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: Saving service mgr spec with placement smithi059=x;smithi115=y;smithi181=z;count:3 2024-09-10T10:53:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:30 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:30.455 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T10:53:30.456 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:30.456 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T10:53:30.456 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:30.456 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:30.456 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 10:52:47.068125340 +0000 2024-09-10T10:53:30.456 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 10:48:30.399957464 +0000 2024-09-10T10:53:30.456 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 10:48:30.399957464 +0000 2024-09-10T10:53:30.456 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 10:48:30.399957464 +0000 2024-09-10T10:53:30.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T10:53:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:30.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: Reconfiguring mon.b (monmap changed)... 2024-09-10T10:53:30.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:30.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:53:30.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:30.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: Reconfiguring daemon mon.b on smithi115 2024-09-10T10:53:30.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi115=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:53:30.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: Saving service mgr spec with placement smithi059=x;smithi115=y;smithi181=z;count:3 2024-09-10T10:53:30.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:30 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:30.524 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-10T10:53:30.525 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-10T10:53:30.525 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000272875 s, 1.9 MB/s 2024-09-10T10:53:30.526 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T10:53:30.586 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-09-10T10:53:30.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:30.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:30.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:30.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: Reconfiguring mon.b (monmap changed)... 2024-09-10T10:53:30.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:30.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:53:30.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:30.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: Reconfiguring daemon mon.b on smithi115 2024-09-10T10:53:30.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi115=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:53:30.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: Saving service mgr spec with placement smithi059=x;smithi115=y;smithi181=z;count:3 2024-09-10T10:53:30.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:30 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T10:53:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:30.646 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T10:53:30.646 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:30.646 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:30.646 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 10:52:47.105124867 +0000 2024-09-10T10:53:30.646 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 10:48:30.725953272 +0000 2024-09-10T10:53:30.646 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 10:48:30.725953272 +0000 2024-09-10T10:53:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 10:48:30.725953272 +0000 2024-09-10T10:53:30.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T10:53:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-10T10:53:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-10T10:53:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000207987 s, 2.5 MB/s 2024-09-10T10:53:30.713 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T10:53:30.771 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-09-10T10:53:30.828 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T10:53:30.828 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:30.828 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T10:53:30.828 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:30.829 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:30.829 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 10:52:47.144124369 +0000 2024-09-10T10:53:30.829 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 10:48:31.060948964 +0000 2024-09-10T10:53:30.829 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 10:48:31.060948964 +0000 2024-09-10T10:53:30.829 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 10:48:31.060948964 +0000 2024-09-10T10:53:30.829 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T10:53:30.894 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-10T10:53:30.894 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-10T10:53:30.894 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000206359 s, 2.5 MB/s 2024-09-10T10:53:30.896 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T10:53:30.953 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-10T10:53:30.953 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T10:53:30.970 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T10:53:30.971 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-09-10T10:53:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T10:53:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:31.027 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T10:53:31.027 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:31.027 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:31.027 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-10 10:53:19.860797407 +0000 2024-09-10T10:53:31.027 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-10 10:48:39.471552365 +0000 2024-09-10T10:53:31.027 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-10 10:48:39.471552365 +0000 2024-09-10T10:53:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-10 10:48:39.471552365 +0000 2024-09-10T10:53:31.028 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T10:53:31.091 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-10T10:53:31.092 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-10T10:53:31.092 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.00027082 s, 1.9 MB/s 2024-09-10T10:53:31.093 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T10:53:31.149 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-09-10T10:53:31.205 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T10:53:31.206 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:31.206 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T10:53:31.206 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:31.206 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:31.206 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-10 10:53:19.860797407 +0000 2024-09-10T10:53:31.206 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-10 10:48:39.795546011 +0000 2024-09-10T10:53:31.206 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-10 10:48:39.795546011 +0000 2024-09-10T10:53:31.206 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-10 10:48:39.795546011 +0000 2024-09-10T10:53:31.206 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T10:53:31.269 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-10T10:53:31.269 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-10T10:53:31.269 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000234735 s, 2.2 MB/s 2024-09-10T10:53:31.270 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T10:53:31.327 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-09-10T10:53:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T10:53:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:31.382 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T10:53:31.382 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:31.382 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:31.382 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-10 10:53:19.860797407 +0000 2024-09-10T10:53:31.382 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-10 10:48:40.124539560 +0000 2024-09-10T10:53:31.382 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-10 10:48:40.124539560 +0000 2024-09-10T10:53:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-10 10:48:40.124539560 +0000 2024-09-10T10:53:31.383 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T10:53:31.445 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-10T10:53:31.445 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-10T10:53:31.445 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.0002128 s, 2.4 MB/s 2024-09-10T10:53:31.447 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T10:53:31.503 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-09-10T10:53:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T10:53:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:31.558 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T10:53:31.558 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:31.559 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:31.559 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-10 10:53:19.861797387 +0000 2024-09-10T10:53:31.559 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-10 10:48:40.448533206 +0000 2024-09-10T10:53:31.559 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-10 10:48:40.448533206 +0000 2024-09-10T10:53:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-10 10:48:40.448533206 +0000 2024-09-10T10:53:31.559 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T10:53:31.623 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-10T10:53:31.623 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-10T10:53:31.623 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000180327 s, 2.8 MB/s 2024-09-10T10:53:31.625 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T10:53:31.681 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-10T10:53:31.681 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T10:53:31.699 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T10:53:31.699 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-09-10T10:53:31.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:31 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:31.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:31 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:31.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:31 smithi115 ceph-mon[34719]: Reconfiguring mon.c (monmap changed)... 2024-09-10T10:53:31.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:31 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:31.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:31 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:53:31.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:31 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:31.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:31 smithi115 ceph-mon[34719]: Reconfiguring daemon mon.c on smithi181 2024-09-10T10:53:31.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:31 smithi115 ceph-mon[34719]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:31.754 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T10:53:31.755 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:31.755 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T10:53:31.755 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:31.755 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:31.755 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-10 10:53:10.991365074 +0000 2024-09-10T10:53:31.755 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-10 10:48:42.164193570 +0000 2024-09-10T10:53:31.755 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-10 10:48:42.164193570 +0000 2024-09-10T10:53:31.755 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-10 10:48:42.164193570 +0000 2024-09-10T10:53:31.755 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T10:53:31.821 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-10T10:53:31.821 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-10T10:53:31.821 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000275234 s, 1.9 MB/s 2024-09-10T10:53:31.823 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T10:53:31.878 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-09-10T10:53:31.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:31 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:31.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:31 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:31.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:31 smithi059 ceph-mon[30978]: Reconfiguring mon.c (monmap changed)... 2024-09-10T10:53:31.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:31 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:31.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:31 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:53:31.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:31 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:31.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:31 smithi059 ceph-mon[30978]: Reconfiguring daemon mon.c on smithi181 2024-09-10T10:53:31.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:31 smithi059 ceph-mon[30978]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:31.934 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T10:53:31.934 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:31.934 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T10:53:31.934 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:31.934 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:31.934 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-10 10:53:10.991365074 +0000 2024-09-10T10:53:31.934 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-10 10:48:42.494186951 +0000 2024-09-10T10:53:31.934 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-10 10:48:42.494186951 +0000 2024-09-10T10:53:31.934 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-10 10:48:42.494186951 +0000 2024-09-10T10:53:31.935 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T10:53:31.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:31 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:31.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:31 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:31.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:31 smithi181 ceph-mon[35409]: Reconfiguring mon.c (monmap changed)... 2024-09-10T10:53:31.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:31 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:53:31.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:31 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:53:31.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:31 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:31.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:31 smithi181 ceph-mon[35409]: Reconfiguring daemon mon.c on smithi181 2024-09-10T10:53:31.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:31 smithi181 ceph-mon[35409]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-10T10:53:31.960 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-10T10:53:31.960 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000203801 s, 2.5 MB/s 2024-09-10T10:53:31.961 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T10:53:32.018 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-09-10T10:53:32.073 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T10:53:32.074 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:32.074 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T10:53:32.074 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:32.074 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:32.074 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-10 10:53:10.992365054 +0000 2024-09-10T10:53:32.074 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-10 10:48:42.842179972 +0000 2024-09-10T10:53:32.074 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-10 10:48:42.842179972 +0000 2024-09-10T10:53:32.074 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-10 10:48:42.842179972 +0000 2024-09-10T10:53:32.074 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T10:53:32.138 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-10T10:53:32.139 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-10T10:53:32.139 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000206221 s, 2.5 MB/s 2024-09-10T10:53:32.140 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T10:53:32.197 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-09-10T10:53:32.256 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T10:53:32.256 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:53:32.256 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T10:53:32.256 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:53:32.256 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:53:32.257 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-10 10:53:10.992365054 +0000 2024-09-10T10:53:32.257 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-10 10:48:43.185173093 +0000 2024-09-10T10:53:32.257 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-10 10:48:43.185173093 +0000 2024-09-10T10:53:32.257 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-10 10:48:43.185173093 +0000 2024-09-10T10:53:32.257 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T10:53:32.319 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-10T10:53:32.319 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-10T10:53:32.319 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000202917 s, 2.5 MB/s 2024-09-10T10:53:32.320 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T10:53:32.377 INFO:tasks.cephadm:Deploying osd.0 on smithi059 with /dev/vg_nvme/lv_4... 2024-09-10T10:53:32.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T10:53:32.639 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:53:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:53:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:53:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:53:32.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:32.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:32 smithi181 ceph-mon[35409]: Deploying daemon mgr.z on smithi181 2024-09-10T10:53:33.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:33.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:33.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:33.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:33.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:33.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:33.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:53:33.070 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:53:33.071 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:53:33.071 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:33.071 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:32 smithi059 ceph-mon[30978]: Deploying daemon mgr.z on smithi181 2024-09-10T10:53:33.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:33.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:32 smithi115 ceph-mon[34719]: Deploying daemon mgr.z on smithi181 2024-09-10T10:53:33.846 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:33 smithi181 systemd[1]: Starting Ceph mgr.z for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:53:34.011 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:33 smithi059 ceph-mon[30978]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:34.115 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:33 smithi181 ceph-mon[35409]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:34.116 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:33 smithi181 podman[37191]: 2024-09-10 10:53:33.845473506 +0000 UTC m=+0.098585515 container create 5186d3b5526b8807c58a7e984c3c41a49ffe27f42c57b8cdb448a535348498cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T10:53:34.116 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:33 smithi181 podman[37191]: 2024-09-10 10:53:33.762609752 +0000 UTC m=+0.015721773 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:53:34.116 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 podman[37191]: 2024-09-10 10:53:34.01521422 +0000 UTC m=+0.268326231 container init 5186d3b5526b8807c58a7e984c3c41a49ffe27f42c57b8cdb448a535348498cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T10:53:34.116 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 podman[37191]: 2024-09-10 10:53:34.017942349 +0000 UTC m=+0.271054364 container start 5186d3b5526b8807c58a7e984c3c41a49ffe27f42c57b8cdb448a535348498cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T10:53:34.116 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 ceph-mgr[37211]: -- 172.21.15.181:0/1975874056 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5614a6d110e0 con 0x5614a6cee800 2024-09-10T10:53:34.116 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 bash[37191]: 5186d3b5526b8807c58a7e984c3c41a49ffe27f42c57b8cdb448a535348498cb 2024-09-10T10:53:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:33 smithi115 ceph-mon[34719]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:34.416 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 systemd[1]: Started Ceph mgr.z for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:53:34.416 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:34.139+0000 7fbe9c8f4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:53:34.416 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:34.202+0000 7fbe9c8f4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:53:34.416 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:34.348+0000 7fbe9c8f4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:53:34.416 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:34.413+0000 7fbe9c8f4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:53:34.686 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:34.560+0000 7fbe9c8f4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:53:35.016 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:34.700+0000 7fbe9c8f4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:53:35.016 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:35.013+0000 7fbe9c8f4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:53:35.160 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:53:35.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_4 2024-09-10T10:53:35.436 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:35.074+0000 7fbe9c8f4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:53:35.436 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:35.258+0000 7fbe9c8f4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:53:35.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:35.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:35.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:35.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:53:35.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:53:35.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:53:35.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:35.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:35 smithi181 ceph-mon[35409]: Deploying daemon mgr.y on smithi115 2024-09-10T10:53:35.451 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:53:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:35 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:35 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:35 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:35 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:53:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:35 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:53:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:35 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:53:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:35 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:35.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:35 smithi115 ceph-mon[34719]: Deploying daemon mgr.y on smithi115 2024-09-10T10:53:35.572 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:35 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:35.572 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:35 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:35.573 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:35 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:35.573 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:35 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:53:35.573 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:35 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:53:35.573 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:35 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:53:35.573 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:35 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:35.573 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:35 smithi059 ceph-mon[30978]: Deploying daemon mgr.y on smithi115 2024-09-10T10:53:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.961+0000 7fa7e6622640 1 -- 172.21.15.59:0/1270720266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 msgr2=0x7fa7e0103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.961+0000 7fa7e6622640 1 --2- 172.21.15.59:0/1270720266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 0x7fa7e0103280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009900 tx=0x7fa7d402a410 comp rx=0 tx=0).stop 2024-09-10T10:53:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.961+0000 7fa7e6622640 1 -- 172.21.15.59:0/1270720266 shutdown_connections 2024-09-10T10:53:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.961+0000 7fa7e6622640 1 --2- 172.21.15.59:0/1270720266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e01037c0 0x7fa7e010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.961+0000 7fa7e6622640 1 --2- 172.21.15.59:0/1270720266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 0x7fa7e0103280 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.961+0000 7fa7e6622640 1 --2- 172.21.15.59:0/1270720266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e0101c00 0x7fa7e0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.961+0000 7fa7e6622640 1 -- 172.21.15.59:0/1270720266 >> 172.21.15.59:0/1270720266 conn(0x7fa7e00fd390 msgr2=0x7fa7e00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.961+0000 7fa7e6622640 1 -- 172.21.15.59:0/1270720266 shutdown_connections 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.961+0000 7fa7e6622640 1 -- 172.21.15.59:0/1270720266 wait complete. 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.962+0000 7fa7e6622640 1 Processor -- start 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.962+0000 7fa7e6622640 1 -- start start 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.962+0000 7fa7e6622640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e0101c00 0x7fa7e0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.962+0000 7fa7e6622640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 0x7fa7e00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.962+0000 7fa7e6622640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e01037c0 0x7fa7e0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.962+0000 7fa7e6622640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e010d860 con 0x7fa7e0102e00 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.962+0000 7fa7e6622640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e010d6e0 con 0x7fa7e0101c00 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.962+0000 7fa7e6622640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e010d9e0 con 0x7fa7e01037c0 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7df7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 0x7fa7e00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7df7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 0x7fa7e00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51768/0 (socket says 172.21.15.59:51768) 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7dffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e0101c00 0x7fa7e0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7df7fe640 1 -- 172.21.15.59:0/3696788040 learned_addr learned my addr 172.21.15.59:0/3696788040 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7e4bbf640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e01037c0 0x7fa7e0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7df7fe640 1 -- 172.21.15.59:0/3696788040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e01037c0 msgr2=0x7fa7e0074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7df7fe640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e01037c0 0x7fa7e0074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7df7fe640 1 -- 172.21.15.59:0/3696788040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e0101c00 msgr2=0x7fa7e0075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7df7fe640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e0101c00 0x7fa7e0075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7df7fe640 1 -- 172.21.15.59:0/3696788040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e00753e0 con 0x7fa7e0102e00 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7dffff640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e0101c00 0x7fa7e0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7df7fe640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 0x7fa7e00745e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009230 tx=0x7fa7d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7dd7fa640 1 -- 172.21.15.59:0/3696788040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d403f030 con 0x7fa7e0102e00 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7dd7fa640 1 -- 172.21.15.59:0/3696788040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7d4003ce0 con 0x7fa7e0102e00 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e01a1fd0 con 0x7fa7e0102e00 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7dd7fa640 1 -- 172.21.15.59:0/3696788040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4035070 con 0x7fa7e0102e00 2024-09-10T10:53:35.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.963+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e01a23c0 con 0x7fa7e0102e00 2024-09-10T10:53:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.964+0000 7fa7dd7fa640 1 -- 172.21.15.59:0/3696788040 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa7d4042030 con 0x7fa7e0102e00 2024-09-10T10:53:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.965+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e0108fa0 con 0x7fa7e0102e00 2024-09-10T10:53:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.965+0000 7fa7dd7fa640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7c8039290 0x7fa7c803b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:53:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.965+0000 7fa7dd7fa640 1 -- 172.21.15.59:0/3696788040 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa7d406c8f0 con 0x7fa7e0102e00 2024-09-10T10:53:35.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.965+0000 7fa7dffff640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7c8039290 0x7fa7c803b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:53:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.965+0000 7fa7dffff640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7c8039290 0x7fa7c803b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0102c60 tx=0x7fa7d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:53:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:35.970+0000 7fa7dd7fa640 1 -- 172.21.15.59:0/3696788040 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7d40309f0 con 0x7fa7e0102e00 2024-09-10T10:53:36.125 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:35 smithi115 systemd[1]: Starting Ceph mgr.y for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:53:36.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:36.155+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa7e0062630 con 0x7fa7c8039290 2024-09-10T10:53:36.395 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-mon[34719]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:36.395 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:53:36.395 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:53:36.396 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:36.396 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 podman[36069]: 2024-09-10 10:53:36.027026211 +0000 UTC m=+0.015861129 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:53:36.396 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 podman[36069]: 2024-09-10 10:53:36.126149176 +0000 UTC m=+0.114984129 container create f81e8474541826aeccffb6c9a8d2060eaeb06c71abf268de78a0f7d0e0480767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T10:53:36.396 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 podman[36069]: 2024-09-10 10:53:36.319974494 +0000 UTC m=+0.308809403 container init f81e8474541826aeccffb6c9a8d2060eaeb06c71abf268de78a0f7d0e0480767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T10:53:36.396 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 podman[36069]: 2024-09-10 10:53:36.323621043 +0000 UTC m=+0.312455953 container start f81e8474541826aeccffb6c9a8d2060eaeb06c71abf268de78a0f7d0e0480767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T10:53:36.396 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-mgr[36088]: -- 172.21.15.115:0/1171525736 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563e9594d0e0 con 0x563e9592a800 2024-09-10T10:53:36.396 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 bash[36069]: f81e8474541826aeccffb6c9a8d2060eaeb06c71abf268de78a0f7d0e0480767 2024-09-10T10:53:36.436 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:36.134+0000 7fbe9c8f4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:53:36.436 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:36.201+0000 7fbe9c8f4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:53:36.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:36 smithi181 ceph-mon[35409]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:36.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:36 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:53:36.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:36 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:53:36.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:36 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:36.569 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:36 smithi059 ceph-mon[30978]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:36.569 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:36 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:53:36.569 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:36 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:53:36.569 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:36 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:36.669 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 systemd[1]: Started Ceph mgr.y for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:53:36.669 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:36.452+0000 7fd0f8033040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:53:36.669 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:36.512+0000 7fd0f8033040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:53:36.669 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:36.668+0000 7fd0f8033040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:53:36.958 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:36.735+0000 7fd0f8033040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:53:36.958 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:36.902+0000 7fd0f8033040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:53:37.225 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:36.957+0000 7fbe9c8f4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:53:37.225 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.075+0000 7fbe9c8f4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:53:37.225 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.222+0000 7fbe9c8f4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:53:37.383 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:37.057+0000 7fd0f8033040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:53:37.384 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:37.382+0000 7fd0f8033040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:53:37.512 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.288+0000 7fbe9c8f4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:53:37.512 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.440+0000 7fbe9c8f4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:53:37.513 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.510+0000 7fbe9c8f4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:53:37.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-mon[35409]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:53:37.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.513 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:37.641 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:37.446+0000 7fd0f8033040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:53:37.641 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-mon[34719]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:53:37.641 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.642 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.642 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.642 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.642 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:37.807 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.571+0000 7fbe9c8f4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:53:37.808 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.739+0000 7fbe9c8f4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:53:37.808 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.806+0000 7fbe9c8f4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:53:37.809 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:37 smithi059 ceph-mon[30978]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:53:37.810 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:37 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.810 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:37 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.810 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:37 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.810 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:37 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:37.810 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:37 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:37.958 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:37.640+0000 7fd0f8033040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:53:38.075 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.873+0000 7fbe9c8f4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:53:38.075 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:37.955+0000 7fbe9c8f4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:53:38.075 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:38.014+0000 7fbe9c8f4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:53:38.076 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:38.073+0000 7fbe9c8f4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:53:38.864 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:38.864 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.864 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.864 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3042554587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17d70faa-a04c-428f-ae18-c14cdf3c0b59"}]: dispatch 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3042554587' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17d70faa-a04c-428f-ae18-c14cdf3c0b59"}]': finished 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T10:53:38.865 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:53:38.868 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:38.868 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.868 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.868 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.868 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3042554587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17d70faa-a04c-428f-ae18-c14cdf3c0b59"}]: dispatch 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3042554587' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17d70faa-a04c-428f-ae18-c14cdf3c0b59"}]': finished 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T10:53:38.869 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:53:38.958 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:38.528+0000 7fd0f8033040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:53:38.958 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:38.596+0000 7fd0f8033040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3042554587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17d70faa-a04c-428f-ae18-c14cdf3c0b59"}]: dispatch 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3042554587' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17d70faa-a04c-428f-ae18-c14cdf3c0b59"}]': finished 2024-09-10T10:53:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T10:53:38.960 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:53:39.186 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 10:53:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T10:53:38.862+0000 7fbe9c8f4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:53:39.570 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:39.312+0000 7fd0f8033040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:53:39.570 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:39.426+0000 7fd0f8033040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:53:39.570 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:39.568+0000 7fd0f8033040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:53:39.570 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-mon[34719]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T10:53:39.571 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-mon[34719]: Reconfiguring daemon mgr.x on smithi059 2024-09-10T10:53:39.571 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:39.571 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-mon[34719]: Standby manager daemon z started 2024-09-10T10:53:39.571 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:53:39.571 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:53:39.571 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:53:39.571 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:53:39.571 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1697453398' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:53:39.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:39.676+0000 7fa7dd7fa640 1 -- 172.21.15.59:0/3696788040 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7fa7d403a8e0 con 0x7fa7e0102e00 2024-09-10T10:53:39.679 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:39 smithi059 ceph-mon[30978]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T10:53:39.679 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:39 smithi059 ceph-mon[30978]: Reconfiguring daemon mgr.x on smithi059 2024-09-10T10:53:39.679 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:39.679 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:39 smithi059 ceph-mon[30978]: Standby manager daemon z started 2024-09-10T10:53:39.679 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:39 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:53:39.679 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:39 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:53:39.679 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:39 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:53:39.679 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:39 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:53:39.679 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:39 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1697453398' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:53:39.850 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:39.630+0000 7fd0f8033040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:53:39.850 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:39.781+0000 7fd0f8033040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:53:39.850 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:39.848+0000 7fd0f8033040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:53:39.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:39 smithi181 ceph-mon[35409]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T10:53:39.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:39 smithi181 ceph-mon[35409]: Reconfiguring daemon mgr.x on smithi059 2024-09-10T10:53:39.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:39.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:39 smithi181 ceph-mon[35409]: Standby manager daemon z started 2024-09-10T10:53:39.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:39 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:53:39.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:39 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:53:39.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:39 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:53:39.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:39 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.181:0/2506231956' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:53:39.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:39 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1697453398' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:53:40.133 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:39.908+0000 7fd0f8033040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:53:40.133 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:40.067+0000 7fd0f8033040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:53:40.133 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:40.132+0000 7fd0f8033040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:53:40.400 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:40.199+0000 7fd0f8033040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:53:40.401 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:40.280+0000 7fd0f8033040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:53:40.401 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:40.340+0000 7fd0f8033040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:53:40.401 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:40.399+0000 7fd0f8033040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:53:40.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:40 smithi115 ceph-mon[34719]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:40.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:40 smithi115 ceph-mon[34719]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-10T10:53:40.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:53:40.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:40 smithi059 ceph-mon[30978]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:40.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:40 smithi059 ceph-mon[30978]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-10T10:53:40.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:53:40.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:40 smithi181 ceph-mon[35409]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:40.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:40 smithi181 ceph-mon[35409]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-10T10:53:40.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:53:41.458 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 10:53:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T10:53:41.179+0000 7fd0f8033040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:53:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:41.533+0000 7fa7dd7fa640 1 -- 172.21.15.59:0/3696788040 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fa7d403b460 con 0x7fa7e0102e00 2024-09-10T10:53:41.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:41 smithi059 ceph-mon[30978]: Standby manager daemon y started 2024-09-10T10:53:41.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:41 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:53:41.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:41 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:53:41.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:41 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:53:41.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:41 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:53:41.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:41 smithi181 ceph-mon[35409]: Standby manager daemon y started 2024-09-10T10:53:41.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:41 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:53:41.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:41 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:53:41.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:41 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:53:41.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:41 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:53:41.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:41 smithi115 ceph-mon[34719]: Standby manager daemon y started 2024-09-10T10:53:41.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:41 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:53:41.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:41 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:53:41.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:41 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:53:41.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:41 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.115:0/2025587054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:53:42.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:42 smithi059 ceph-mon[30978]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:42.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:42 smithi059 ceph-mon[30978]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-10T10:53:42.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:42 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:53:42.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:42 smithi181 ceph-mon[35409]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:42.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:42 smithi181 ceph-mon[35409]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-10T10:53:42.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:42 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:53:42.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:42 smithi115 ceph-mon[34719]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:42.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:42 smithi115 ceph-mon[34719]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-10T10:53:42.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:42 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:53:44.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:44 smithi059 ceph-mon[30978]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:44.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:44 smithi181 ceph-mon[35409]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:44.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:44 smithi115 ceph-mon[34719]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:46.003 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:45 smithi059 ceph-mon[30978]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:46.003 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:46.003 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:46.003 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:46.003 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:46.003 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:46.003 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:46.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:45 smithi181 ceph-mon[35409]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:46.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:46.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:46.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:46.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:46.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:46.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:45 smithi115 ceph-mon[34719]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:47 smithi115 ceph-mon[34719]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:53:48.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:48.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:47 smithi115 ceph-mon[34719]: Deploying daemon osd.0 on smithi059 2024-09-10T10:53:48.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:47 smithi059 ceph-mon[30978]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:48.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:53:48.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:48.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:47 smithi059 ceph-mon[30978]: Deploying daemon osd.0 on smithi059 2024-09-10T10:53:48.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:47 smithi181 ceph-mon[35409]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:48.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:53:48.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:48.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:47 smithi181 ceph-mon[35409]: Deploying daemon osd.0 on smithi059 2024-09-10T10:53:50.280 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:49 smithi059 ceph-mon[30978]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:50.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:49 smithi181 ceph-mon[35409]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:50.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:49 smithi115 ceph-mon[34719]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:52.215 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:51 smithi059 ceph-mon[30978]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:52.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:51 smithi181 ceph-mon[35409]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:52.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:51 smithi115 ceph-mon[34719]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:54.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:53 smithi059 ceph-mon[30978]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:54.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:54.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:54.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:54.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:53 smithi181 ceph-mon[35409]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:54.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:54.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:54.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:53 smithi115 ceph-mon[34719]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:55 smithi059 ceph-mon[30978]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:55 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:55 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:55 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:55 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:55 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:56.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:55 smithi181 ceph-mon[35409]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:56.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:55 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:56.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:55 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:56.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:55 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:56.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:55 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:56.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:55 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:56.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:55 smithi115 ceph-mon[34719]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:56.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:55 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:55 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:55 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:53:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:55 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:53:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:55 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:57.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.365+0000 7fa7dd7fa640 1 -- 172.21.15.59:0/3696788040 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa7e0062630 con 0x7fa7c8039290 2024-09-10T10:53:57.366 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 0 on host 'smithi059' 2024-09-10T10:53:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.367+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7c8039290 msgr2=0x7fa7c803b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7c8039290 0x7fa7c803b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0102c60 tx=0x7fa7d0005f90 comp rx=0 tx=0).stop 2024-09-10T10:53:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 msgr2=0x7fa7e00745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:53:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 0x7fa7e00745e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009230 tx=0x7fa7d40042f0 comp rx=0 tx=0).stop 2024-09-10T10:53:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 shutdown_connections 2024-09-10T10:53:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7c8039290 0x7fa7c803b750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7e01037c0 0x7fa7e0074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7e0102e00 0x7fa7e00745e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 --2- 172.21.15.59:0/3696788040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7e0101c00 0x7fa7e0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:53:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 >> 172.21.15.59:0/3696788040 conn(0x7fa7e00fd390 msgr2=0x7fa7e0106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:53:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 shutdown_connections 2024-09-10T10:53:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:53:57.368+0000 7fa7e6622640 1 -- 172.21.15.59:0/3696788040 wait complete. 2024-09-10T10:53:57.948 DEBUG:teuthology.orchestra.run.smithi059:osd.0> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T10:53:57.951 INFO:tasks.cephadm:Deploying osd.1 on smithi115 with /dev/vg_nvme/lv_4... 2024-09-10T10:53:57.951 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T10:53:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:53:58.255 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:57 smithi059 ceph-mon[30978]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:58.256 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:58.256 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:58.256 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:58.314 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:57 smithi115 ceph-mon[34719]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:58.314 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:57 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:58.314 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:57 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:58.314 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:57 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:58.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:57 smithi181 ceph-mon[35409]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:53:58.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:53:58.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:58.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:53:59.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:53:59 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0[42445]: 2024-09-10T10:53:59.478+0000 7f408bc8e640 -1 osd.0 0 log_to_monitors true 2024-09-10T10:54:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:59 smithi115 ceph-mon[34719]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:54:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:53:59 smithi115 ceph-mon[34719]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:54:00.355 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:59 smithi059 ceph-mon[30978]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:54:00.355 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:53:59 smithi059 ceph-mon[30978]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:54:00.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:59 smithi181 ceph-mon[35409]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:54:00.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:53:59 smithi181 ceph-mon[35409]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:54:00.477 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:54:00.502 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_4 2024-09-10T10:54:00.814 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:54:01.086 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:54:01.086 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T10:54:01.086 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:54:01.087 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:01.087 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.087 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.087 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:54:01.087 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.087 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:01.087 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:01.087 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:00 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:54:01.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T10:54:01.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:54:01.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:01.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:54:01.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:01.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:01.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 -- 172.21.15.115:0/1262036608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0101cd0 msgr2=0x7f3ff0102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:01.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 --2- 172.21.15.115:0/1262036608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0101cd0 0x7f3ff0102150 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009900 tx=0x7f3fd802a410 comp rx=0 tx=0).stop 2024-09-10T10:54:01.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 -- 172.21.15.115:0/1262036608 shutdown_connections 2024-09-10T10:54:01.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 --2- 172.21.15.115:0/1262036608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0102690 0x7f3ff0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:01.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 --2- 172.21.15.115:0/1262036608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0101cd0 0x7f3ff0102150 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:01.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 --2- 172.21.15.115:0/1262036608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff0100ad0 0x7f3ff0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:01.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 -- 172.21.15.115:0/1262036608 >> 172.21.15.115:0/1262036608 conn(0x7f3ff00fc280 msgr2=0x7f3ff00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 -- 172.21.15.115:0/1262036608 shutdown_connections 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 -- 172.21.15.115:0/1262036608 wait complete. 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 Processor -- start 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.287+0000 7f3ff5276640 1 -- start start 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3ff5276640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0100ad0 0x7f3ff0104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3ff5276640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff0101cd0 0x7f3ff01030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3ff5276640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0102690 0x7f3ff01035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3ff5276640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff010c730 con 0x7f3ff0100ad0 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3ff5276640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff010c5b0 con 0x7f3ff0102690 2024-09-10T10:54:01.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3ff5276640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff010c8b0 con 0x7f3ff0101cd0 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fef7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0102690 0x7f3ff01035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3feeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0100ad0 0x7f3ff0104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fef7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0102690 0x7f3ff01035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41492/0 (socket says 172.21.15.115:41492) 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fef7fe640 1 -- 172.21.15.115:0/3647379475 learned_addr learned my addr 172.21.15.115:0/3647379475 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fe7fff640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff0101cd0 0x7f3ff01030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fef7fe640 1 -- 172.21.15.115:0/3647379475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff0101cd0 msgr2=0x7f3ff01030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fef7fe640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff0101cd0 0x7f3ff01030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fef7fe640 1 -- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0100ad0 msgr2=0x7f3ff0104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fef7fe640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0100ad0 0x7f3ff0104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fef7fe640 1 -- 172.21.15.115:0/3647379475 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff0103eb0 con 0x7f3ff0102690 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3feeffd640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0100ad0 0x7f3ff0104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:54:01.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fef7fe640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0102690 0x7f3ff01035f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800d950 tx=0x7f3fe800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:54:01.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fecff9640 1 -- 172.21.15.115:0/3647379475 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8017030 con 0x7f3ff0102690 2024-09-10T10:54:01.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff01a20d0 con 0x7f3ff0102690 2024-09-10T10:54:01.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fecff9640 1 -- 172.21.15.115:0/3647379475 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fe8004020 con 0x7f3ff0102690 2024-09-10T10:54:01.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3fecff9640 1 -- 172.21.15.115:0/3647379475 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8003c00 con 0x7f3ff0102690 2024-09-10T10:54:01.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.288+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff01a25e0 con 0x7f3ff0102690 2024-09-10T10:54:01.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.290+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff0100ed0 con 0x7f3ff0102690 2024-09-10T10:54:01.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.290+0000 7f3fecff9640 1 -- 172.21.15.115:0/3647379475 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f3fe801a070 con 0x7f3ff0102690 2024-09-10T10:54:01.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.291+0000 7f3fecff9640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3fdc0a2af0 0x7f3fdc0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:01.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.292+0000 7f3feeffd640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3fdc0a2af0 0x7f3fdc0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:01.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.292+0000 7f3fecff9640 1 -- 172.21.15.115:0/3647379475 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f3fe80ccca0 con 0x7f3ff0102690 2024-09-10T10:54:01.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.292+0000 7f3feeffd640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3fdc0a2af0 0x7f3fdc0a4fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0101b30 tx=0x7f3fe0007600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:54:01.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.296+0000 7f3fecff9640 1 -- 172.21.15.115:0/3647379475 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fe8021070 con 0x7f3ff0102690 2024-09-10T10:54:01.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:01.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:00 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:01.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:01.484+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3ff01a2870 con 0x7f3fdc0a2af0 2024-09-10T10:54:01.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0[42445]: 2024-09-10T10:54:01.384+0000 7f4088425640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T10:54:01.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0[42445]: 2024-09-10T10:54:01.388+0000 7f407fa31640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:54:02.072 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi059 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi059 to 17092M 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:54:02.073 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:01 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi059 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi059 to 17092M 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:54:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:54:02.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:01 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:02.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi059 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi059 to 17092M 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: from='osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067]' entity='osd.0' 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:54:02.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:01 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:03.060 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:02 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:54:03.060 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:02 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:54:03.060 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:03.060 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:02 smithi115 ceph-mon[34719]: osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] boot 2024-09-10T10:54:03.060 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:02 smithi115 ceph-mon[34719]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T10:54:03.060 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:03.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:02 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:54:03.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:02 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:54:03.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:03.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:02 smithi059 ceph-mon[30978]: osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] boot 2024-09-10T10:54:03.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:02 smithi059 ceph-mon[30978]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T10:54:03.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:03.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:02 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:54:03.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:02 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:54:03.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:03.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:02 smithi181 ceph-mon[35409]: osd.0 [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] boot 2024-09-10T10:54:03.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:02 smithi181 ceph-mon[35409]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T10:54:03.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:54:04.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:04 smithi181 ceph-mon[35409]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:54:04.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:04 smithi181 ceph-mon[35409]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T10:54:04.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:04 smithi181 ceph-mon[35409]: from='client.? 172.21.15.115:0/1675008546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c24fb3f-6b90-4376-8c91-898c13e55505"}]: dispatch 2024-09-10T10:54:04.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:04 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c24fb3f-6b90-4376-8c91-898c13e55505"}]: dispatch 2024-09-10T10:54:04.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:04 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c24fb3f-6b90-4376-8c91-898c13e55505"}]': finished 2024-09-10T10:54:04.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:04 smithi181 ceph-mon[35409]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T10:54:04.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:04 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:04.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:04 smithi181 ceph-mon[35409]: from='client.? 172.21.15.115:0/16391964' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:54:04.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:04 smithi115 ceph-mon[34719]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:54:04.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:04 smithi115 ceph-mon[34719]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T10:54:04.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:04 smithi115 ceph-mon[34719]: from='client.? 172.21.15.115:0/1675008546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c24fb3f-6b90-4376-8c91-898c13e55505"}]: dispatch 2024-09-10T10:54:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:04 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c24fb3f-6b90-4376-8c91-898c13e55505"}]: dispatch 2024-09-10T10:54:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:04 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c24fb3f-6b90-4376-8c91-898c13e55505"}]': finished 2024-09-10T10:54:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:04 smithi115 ceph-mon[34719]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T10:54:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:04 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:04 smithi115 ceph-mon[34719]: from='client.? 172.21.15.115:0/16391964' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:54:04.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:04 smithi059 ceph-mon[30978]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:54:04.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:04 smithi059 ceph-mon[30978]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T10:54:04.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:04 smithi059 ceph-mon[30978]: from='client.? 172.21.15.115:0/1675008546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c24fb3f-6b90-4376-8c91-898c13e55505"}]: dispatch 2024-09-10T10:54:04.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:04 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c24fb3f-6b90-4376-8c91-898c13e55505"}]: dispatch 2024-09-10T10:54:04.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:04 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c24fb3f-6b90-4376-8c91-898c13e55505"}]': finished 2024-09-10T10:54:04.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:04 smithi059 ceph-mon[30978]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T10:54:04.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:04 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:04.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:04 smithi059 ceph-mon[30978]: from='client.? 172.21.15.115:0/16391964' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:54:06.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:06 smithi181 ceph-mon[35409]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:06.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:06 smithi115 ceph-mon[34719]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:06.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:06 smithi059 ceph-mon[30978]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:08.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:08 smithi181 ceph-mon[35409]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:08.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:08 smithi115 ceph-mon[34719]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:08.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:08 smithi059 ceph-mon[30978]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:10.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:10 smithi181 ceph-mon[35409]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:10.690 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:10 smithi059 ceph-mon[30978]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:10.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:10 smithi115 ceph-mon[34719]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:12.539 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:12 smithi115 ceph-mon[34719]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:12.539 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:54:12.539 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:12.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:12 smithi181 ceph-mon[35409]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:12.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:54:12.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:12 smithi059 ceph-mon[30978]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:54:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:13.674 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:13 smithi115 ceph-mon[34719]: Deploying daemon osd.1 on smithi115 2024-09-10T10:54:13.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:13 smithi181 ceph-mon[35409]: Deploying daemon osd.1 on smithi115 2024-09-10T10:54:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:13 smithi059 ceph-mon[30978]: Deploying daemon osd.1 on smithi115 2024-09-10T10:54:14.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:14 smithi181 ceph-mon[35409]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:14.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:14 smithi115 ceph-mon[34719]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:14.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:14 smithi059 ceph-mon[30978]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:16.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:16 smithi181 ceph-mon[35409]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:16.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:16 smithi115 ceph-mon[34719]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:16.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:16 smithi059 ceph-mon[30978]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:18.661 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:18 smithi115 ceph-mon[34719]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:18.661 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:18.661 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:18.661 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:18.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:18 smithi181 ceph-mon[35409]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:18.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:18.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:18.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:18.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:18 smithi059 ceph-mon[30978]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:18.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:18.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:18.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:20.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:20 smithi181 ceph-mon[35409]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:20.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:20 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:20.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:20 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:20.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:20 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:20.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:20 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:20.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:20 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:20.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:20 smithi115 ceph-mon[34719]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:20.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:20 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:20.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:20 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:20.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:20 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:20.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:20 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:20.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:20 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:20.742 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:20 smithi059 ceph-mon[30978]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:20.742 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:20 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:20.742 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:20 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:20.742 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:20 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:20.742 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:20 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:20.743 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:20 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:22.170 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 1 on host 'smithi115' 2024-09-10T10:54:22.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.169+0000 7f3fecff9640 1 -- 172.21.15.115:0/3647379475 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3ff01a2870 con 0x7f3fdc0a2af0 2024-09-10T10:54:22.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3fdc0a2af0 msgr2=0x7f3fdc0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:22.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3fdc0a2af0 0x7f3fdc0a4fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0101b30 tx=0x7f3fe0007600 comp rx=0 tx=0).stop 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0102690 msgr2=0x7f3ff01035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0102690 0x7f3ff01035f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800d950 tx=0x7f3fe800de10 comp rx=0 tx=0).stop 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 shutdown_connections 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3fdc0a2af0 0x7f3fdc0a4fb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ff0102690 0x7f3ff01035f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ff0101cd0 0x7f3ff01030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 --2- 172.21.15.115:0/3647379475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0100ad0 0x7f3ff0104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 >> 172.21.15.115:0/3647379475 conn(0x7f3ff00fc280 msgr2=0x7f3ff006a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 shutdown_connections 2024-09-10T10:54:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:54:22.171+0000 7f3ff5276640 1 -- 172.21.15.115:0/3647379475 wait complete. 2024-09-10T10:54:22.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:22 smithi181 ceph-mon[35409]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:22.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:22.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:22.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:22.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:22 smithi115 ceph-mon[34719]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:22.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:22.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:22.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:22.753 DEBUG:teuthology.orchestra.run.smithi115:osd.1> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T10:54:22.756 INFO:tasks.cephadm:Deploying osd.2 on smithi181 with /dev/vg_nvme/lv_4... 2024-09-10T10:54:22.756 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T10:54:22.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:22 smithi059 ceph-mon[30978]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:22.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:22.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:22.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:54:24.189 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:23 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1[39181]: 2024-09-10T10:54:23.943+0000 7f47e81ff640 -1 osd.1 0 log_to_monitors true 2024-09-10T10:54:24.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:24 smithi115 ceph-mon[34719]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:24.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:24 smithi115 ceph-mon[34719]: from='osd.1 [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:54:24.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:24 smithi115 ceph-mon[34719]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:54:24.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:24 smithi181 ceph-mon[35409]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:24.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:24 smithi181 ceph-mon[35409]: from='osd.1 [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:54:24.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:24 smithi181 ceph-mon[35409]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:54:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:24 smithi059 ceph-mon[30978]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:24 smithi059 ceph-mon[30978]: from='osd.1 [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:54:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:24 smithi059 ceph-mon[30978]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:54:25.407 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:54:25.434 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi181:vg_nvme/lv_4 2024-09-10T10:54:25.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:25 smithi115 ceph-mon[34719]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:54:25.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:25 smithi115 ceph-mon[34719]: from='osd.1 [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:54:25.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:25 smithi115 ceph-mon[34719]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T10:54:25.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:25 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:25.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:25 smithi115 ceph-mon[34719]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:54:25.523 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:25 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1[39181]: 2024-09-10T10:54:25.440+0000 7f47e4182640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T10:54:25.523 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:25 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1[39181]: 2024-09-10T10:54:25.443+0000 7f47dffaa640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:54:25.684 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:54:25.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:25 smithi181 ceph-mon[35409]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:54:25.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:25 smithi181 ceph-mon[35409]: from='osd.1 [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:54:25.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:25 smithi181 ceph-mon[35409]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T10:54:25.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:25.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:25 smithi181 ceph-mon[35409]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:54:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:25 smithi059 ceph-mon[30978]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:54:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:25 smithi059 ceph-mon[30978]: from='osd.1 [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:54:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:25 smithi059 ceph-mon[30978]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T10:54:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:25.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:25 smithi059 ceph-mon[30978]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:54:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.131+0000 7f018fc83640 1 -- 172.21.15.181:0/1210975013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188101cd0 msgr2=0x7f0188102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.131+0000 7f018fc83640 1 --2- 172.21.15.181:0/1210975013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188101cd0 0x7f0188102150 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0178009900 tx=0x7f017802a410 comp rx=0 tx=0).stop 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.131+0000 7f018fc83640 1 -- 172.21.15.181:0/1210975013 shutdown_connections 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.131+0000 7f018fc83640 1 --2- 172.21.15.181:0/1210975013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0188102690 0x7f0188108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.131+0000 7f018fc83640 1 --2- 172.21.15.181:0/1210975013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188101cd0 0x7f0188102150 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.131+0000 7f018fc83640 1 --2- 172.21.15.181:0/1210975013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188100ad0 0x7f0188100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.131+0000 7f018fc83640 1 -- 172.21.15.181:0/1210975013 >> 172.21.15.181:0/1210975013 conn(0x7f01880fc280 msgr2=0x7f01880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.131+0000 7f018fc83640 1 -- 172.21.15.181:0/1210975013 shutdown_connections 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.131+0000 7f018fc83640 1 -- 172.21.15.181:0/1210975013 wait complete. 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018fc83640 1 Processor -- start 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018fc83640 1 -- start start 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018fc83640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188100ad0 0x7f018806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018fc83640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0188101cd0 0x7f018819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018fc83640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188102690 0x7f018819f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018fc83640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f018810c7b0 con 0x7f0188101cd0 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018fc83640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f018810c630 con 0x7f0188100ad0 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018fc83640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f018810c930 con 0x7f0188102690 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018e220640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188102690 0x7f018819f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018e220640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188102690 0x7f018819f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40858/0 (socket says 172.21.15.181:40858) 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018e220640 1 -- 172.21.15.181:0/2913681992 learned_addr learned my addr 172.21.15.181:0/2913681992 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018da1f640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188100ad0 0x7f018806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.132+0000 7f018d21e640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0188101cd0 0x7f018819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f018e220640 1 -- 172.21.15.181:0/2913681992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188100ad0 msgr2=0x7f018806aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f018e220640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188100ad0 0x7f018806aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f018e220640 1 -- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0188101cd0 msgr2=0x7f018819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f018e220640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0188101cd0 0x7f018819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f018e220640 1 -- 172.21.15.181:0/2913681992 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018819fb60 con 0x7f0188102690 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f018e220640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188102690 0x7f018819f250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f018000b970 tx=0x7f018000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f017effd640 1 -- 172.21.15.181:0/2913681992 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180019070 con 0x7f0188102690 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f017effd640 1 -- 172.21.15.181:0/2913681992 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f018000cb40 con 0x7f0188102690 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0188196a60 con 0x7f0188102690 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f017effd640 1 -- 172.21.15.181:0/2913681992 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180007650 con 0x7f0188102690 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.133+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0188196ff0 con 0x7f0188102690 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.134+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0188107f20 con 0x7f0188102690 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.136+0000 7f017effd640 1 -- 172.21.15.181:0/2913681992 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f018001c070 con 0x7f0188102690 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.137+0000 7f017effd640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f01740a2b70 0x7f01740a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.137+0000 7f017effd640 1 -- 172.21.15.181:0/2913681992 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f01800ccc20 con 0x7f0188102690 2024-09-10T10:54:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.137+0000 7f018da1f640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f01740a2b70 0x7f01740a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.138+0000 7f018da1f640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f01740a2b70 0x7f01740a5030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0188101b30 tx=0x7f0184005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:54:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.145+0000 7f017effd640 1 -- 172.21.15.181:0/2913681992 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f018009aea0 con 0x7f0188102690 2024-09-10T10:54:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:26.323+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0188198470 con 0x7f01740a2b70 2024-09-10T10:54:26.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:26.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:54:26.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T10:54:26.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:26.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi115 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi115 to 17088M 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:54:26.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:26.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi115 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi115 to 17088M 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:26.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:54:26.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:54:26.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:54:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:54:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T10:54:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi115 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi115 to 17088M 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:54:26.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:27.698 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:27 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:54:27.698 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:27 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:54:27.698 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:27 smithi181 ceph-mon[35409]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:54:27.699 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:27 smithi181 ceph-mon[35409]: osd.1 [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] boot 2024-09-10T10:54:27.699 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:27 smithi181 ceph-mon[35409]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T10:54:27.699 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:27 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:27.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:27 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:54:27.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:27 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:54:27.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:27 smithi115 ceph-mon[34719]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:54:27.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:27 smithi115 ceph-mon[34719]: osd.1 [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] boot 2024-09-10T10:54:27.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:27 smithi115 ceph-mon[34719]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T10:54:27.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:27.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:27 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:54:27.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:27 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:54:27.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:27 smithi059 ceph-mon[30978]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:54:27.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:27 smithi059 ceph-mon[30978]: osd.1 [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] boot 2024-09-10T10:54:27.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:27 smithi059 ceph-mon[30978]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T10:54:27.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:27 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:54:28.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:28 smithi115 ceph-mon[34719]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:28.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:28 smithi115 ceph-mon[34719]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T10:54:28.712 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:28 smithi181 ceph-mon[35409]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:28.712 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:28 smithi181 ceph-mon[35409]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T10:54:28.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:28 smithi059 ceph-mon[30978]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:28.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:28 smithi059 ceph-mon[30978]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T10:54:29.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:29 smithi115 ceph-mon[34719]: from='client.? 172.21.15.181:0/367825990' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fedd246c-4643-4cd5-85be-47b00e3c5660"}]: dispatch 2024-09-10T10:54:29.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:29 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fedd246c-4643-4cd5-85be-47b00e3c5660"}]: dispatch 2024-09-10T10:54:29.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:29 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fedd246c-4643-4cd5-85be-47b00e3c5660"}]': finished 2024-09-10T10:54:29.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:29 smithi115 ceph-mon[34719]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T10:54:29.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:29 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:29.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:29 smithi115 ceph-mon[34719]: from='client.? 172.21.15.181:0/2725668947' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:54:29.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:29 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/367825990' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fedd246c-4643-4cd5-85be-47b00e3c5660"}]: dispatch 2024-09-10T10:54:29.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:29 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fedd246c-4643-4cd5-85be-47b00e3c5660"}]: dispatch 2024-09-10T10:54:29.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:29 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fedd246c-4643-4cd5-85be-47b00e3c5660"}]': finished 2024-09-10T10:54:29.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:29 smithi059 ceph-mon[30978]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T10:54:29.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:29 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:29.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:29 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/2725668947' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:54:29.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:29 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/367825990' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fedd246c-4643-4cd5-85be-47b00e3c5660"}]: dispatch 2024-09-10T10:54:29.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:29 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fedd246c-4643-4cd5-85be-47b00e3c5660"}]: dispatch 2024-09-10T10:54:29.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:29 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fedd246c-4643-4cd5-85be-47b00e3c5660"}]': finished 2024-09-10T10:54:29.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:29 smithi181 ceph-mon[35409]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T10:54:29.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:29 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:29.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:29 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/2725668947' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:54:30.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:30 smithi059 ceph-mon[30978]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:30.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:30 smithi181 ceph-mon[35409]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:30.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:30 smithi115 ceph-mon[34719]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:32.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:32 smithi059 ceph-mon[30978]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:32.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:32 smithi181 ceph-mon[35409]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:32.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:32 smithi115 ceph-mon[34719]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:34.799 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:34 smithi181 ceph-mon[35409]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:34.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:34 smithi059 ceph-mon[30978]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:34.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:34 smithi115 ceph-mon[34719]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:36.778 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:36 smithi181 ceph-mon[35409]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:36.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:36 smithi059 ceph-mon[30978]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:36.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:36 smithi115 ceph-mon[34719]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:37.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:37 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:54:37.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:37 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:37.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:37 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:54:37.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:37 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:37.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:37 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:54:37.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:37 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:38.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:38 smithi181 ceph-mon[35409]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:38.651 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:38 smithi181 ceph-mon[35409]: Deploying daemon osd.2 on smithi181 2024-09-10T10:54:38.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:38 smithi059 ceph-mon[30978]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:38.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:38 smithi059 ceph-mon[30978]: Deploying daemon osd.2 on smithi181 2024-09-10T10:54:38.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:38 smithi115 ceph-mon[34719]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:38.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:38 smithi115 ceph-mon[34719]: Deploying daemon osd.2 on smithi181 2024-09-10T10:54:40.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:40 smithi059 ceph-mon[30978]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:40.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:40 smithi181 ceph-mon[35409]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:40.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:40 smithi115 ceph-mon[34719]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:42.834 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:42 smithi181 ceph-mon[35409]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:42.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:42 smithi059 ceph-mon[30978]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:42.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:42 smithi115 ceph-mon[34719]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:43.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:43.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:43.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:43.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:43.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:43.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:43.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:43.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:43.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:44.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:44 smithi181 ceph-mon[35409]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:44.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:44 smithi059 ceph-mon[30978]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:44.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:44 smithi115 ceph-mon[34719]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:45 smithi059 ceph-mon[30978]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:45 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:45 smithi181 ceph-mon[35409]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:46.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:46.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:46.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:45 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:45 smithi115 ceph-mon[34719]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:46.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:46.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:46.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:45 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.352+0000 7f017effd640 1 -- 172.21.15.181:0/2913681992 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0188198470 con 0x7f01740a2b70 2024-09-10T10:54:47.354 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 2 on host 'smithi181' 2024-09-10T10:54:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.354+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f01740a2b70 msgr2=0x7f01740a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.354+0000 7f018fc83640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f01740a2b70 0x7f01740a5030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0188101b30 tx=0x7f0184005f90 comp rx=0 tx=0).stop 2024-09-10T10:54:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.354+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188102690 msgr2=0x7f018819f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.354+0000 7f018fc83640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188102690 0x7f018819f250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f018000b970 tx=0x7f018000be30 comp rx=0 tx=0).stop 2024-09-10T10:54:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.355+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 shutdown_connections 2024-09-10T10:54:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.355+0000 7f018fc83640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f01740a2b70 0x7f01740a5030 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.355+0000 7f018fc83640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0188102690 0x7f018819f250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.355+0000 7f018fc83640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0188101cd0 0x7f018819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.355+0000 7f018fc83640 1 --2- 172.21.15.181:0/2913681992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0188100ad0 0x7f018806aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.355+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 >> 172.21.15.181:0/2913681992 conn(0x7f01880fc280 msgr2=0x7f01881050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:54:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.355+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 shutdown_connections 2024-09-10T10:54:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:54:47.355+0000 7f018fc83640 1 -- 172.21.15.181:0/2913681992 wait complete. 2024-09-10T10:54:47.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:47 smithi181 ceph-mon[35409]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:48.021 DEBUG:teuthology.orchestra.run.smithi181:osd.2> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T10:54:48.023 INFO:tasks.cephadm:Deploying osd.3 on smithi059 with /dev/vg_nvme/lv_3... 2024-09-10T10:54:48.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T10:54:48.048 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:47 smithi059 ceph-mon[30978]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:48.048 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:48.048 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:48.048 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:47 smithi115 ceph-mon[34719]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:54:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:48.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:48.277 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:54:49.255 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-10T10:54:48.953+0000 7f6410b06640 -1 osd.2 0 log_to_monitors true 2024-09-10T10:54:49.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:49 smithi181 ceph-mon[35409]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:49.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:49 smithi181 ceph-mon[35409]: from='osd.2 [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:54:49.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:49 smithi181 ceph-mon[35409]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:54:50.062 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:49 smithi059 ceph-mon[30978]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:50.063 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:49 smithi059 ceph-mon[30978]: from='osd.2 [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:54:50.063 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:49 smithi059 ceph-mon[30978]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:54:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:49 smithi115 ceph-mon[34719]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:49 smithi115 ceph-mon[34719]: from='osd.2 [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:54:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:49 smithi115 ceph-mon[34719]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:54:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:54:50.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_3 2024-09-10T10:54:51.034 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:54:51.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:50 smithi059 ceph-mon[30978]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:54:51.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:50 smithi059 ceph-mon[30978]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T10:54:51.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:51.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:50 smithi059 ceph-mon[30978]: from='osd.2 [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:54:51.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:50 smithi059 ceph-mon[30978]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:54:51.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:51.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:51.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:54:51.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:51.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:50 smithi181 ceph-mon[35409]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:54:51.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:50 smithi181 ceph-mon[35409]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T10:54:51.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:51.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:50 smithi181 ceph-mon[35409]: from='osd.2 [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:54:51.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:50 smithi181 ceph-mon[35409]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:54:51.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:51.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:51.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:54:51.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:51.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:50 smithi115 ceph-mon[34719]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:54:51.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:50 smithi115 ceph-mon[34719]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T10:54:51.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:51.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:50 smithi115 ceph-mon[34719]: from='osd.2 [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:54:51.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:50 smithi115 ceph-mon[34719]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:54:51.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:51.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:51.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:54:51.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.644+0000 7f82fe592640 1 -- 172.21.15.59:0/2610568256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 msgr2=0x7f82f8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.644+0000 7f82fe592640 1 --2- 172.21.15.59:0/2610568256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 0x7f82f8103280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009900 tx=0x7f82ec02a410 comp rx=0 tx=0).stop 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.644+0000 7f82fe592640 1 -- 172.21.15.59:0/2610568256 shutdown_connections 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.644+0000 7f82fe592640 1 --2- 172.21.15.59:0/2610568256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f81037c0 0x7f82f810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.644+0000 7f82fe592640 1 --2- 172.21.15.59:0/2610568256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 0x7f82f8103280 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.644+0000 7f82fe592640 1 --2- 172.21.15.59:0/2610568256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82f8101c00 0x7f82f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.644+0000 7f82fe592640 1 -- 172.21.15.59:0/2610568256 >> 172.21.15.59:0/2610568256 conn(0x7f82f80fd390 msgr2=0x7f82f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.644+0000 7f82fe592640 1 -- 172.21.15.59:0/2610568256 shutdown_connections 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.644+0000 7f82fe592640 1 -- 172.21.15.59:0/2610568256 wait complete. 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.645+0000 7f82fe592640 1 Processor -- start 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.645+0000 7f82fe592640 1 -- start start 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.645+0000 7f82fe592640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82f8101c00 0x7f82f8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.645+0000 7f82fe592640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 0x7f82f80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.645+0000 7f82fe592640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f81037c0 0x7f82f8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.645+0000 7f82fe592640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82f810d880 con 0x7f82f8102e00 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.645+0000 7f82fe592640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f82f810d700 con 0x7f82f81037c0 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.645+0000 7f82fe592640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f82f810da00 con 0x7f82f8101c00 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 0x7f82f80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 0x7f82f80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49260/0 (socket says 172.21.15.59:49260) 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f77fe640 1 -- 172.21.15.59:0/1879794318 learned_addr learned my addr 172.21.15.59:0/1879794318 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f7fff640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82f8101c00 0x7f82f8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82fcb2f640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f81037c0 0x7f82f8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f77fe640 1 -- 172.21.15.59:0/1879794318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82f8101c00 msgr2=0x7f82f8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f77fe640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82f8101c00 0x7f82f8075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f77fe640 1 -- 172.21.15.59:0/1879794318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f81037c0 msgr2=0x7f82f8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:54:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f77fe640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f81037c0 0x7f82f8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f77fe640 1 -- 172.21.15.59:0/1879794318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f80753e0 con 0x7f82f8102e00 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f77fe640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 0x7f82f80745e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009230 tx=0x7f82ec031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f57fa640 1 -- 172.21.15.59:0/1879794318 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec03f030 con 0x7f82f8102e00 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f57fa640 1 -- 172.21.15.59:0/1879794318 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82ec003ad0 con 0x7f82f8102e00 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f81a2060 con 0x7f82f8102e00 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82f57fa640 1 -- 172.21.15.59:0/1879794318 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec035070 con 0x7f82f8102e00 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.646+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f81a2560 con 0x7f82f8102e00 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.647+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f8109050 con 0x7f82f8102e00 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.649+0000 7f82f57fa640 1 -- 172.21.15.59:0/1879794318 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f82ec042030 con 0x7f82f8102e00 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.649+0000 7f82f57fa640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f82e00a2b70 0x7f82e00a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.649+0000 7f82f7fff640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f82e00a2b70 0x7f82e00a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.649+0000 7f82f57fa640 1 -- 172.21.15.59:0/1879794318 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f82ec0edd90 con 0x7f82f8102e00 2024-09-10T10:54:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.650+0000 7f82f7fff640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f82e00a2b70 0x7f82e00a5030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82f8102c60 tx=0x7f82e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:54:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.653+0000 7f82f57fa640 1 -- 172.21.15.59:0/1879794318 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82ec0f1030 con 0x7f82f8102e00 2024-09-10T10:54:51.686 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-10T10:54:51.213+0000 7f640ca89640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T10:54:51.686 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-10T10:54:51.220+0000 7f64048a9640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:54:51.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:51.838+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f82f8062630 con 0x7f82e00a2b70 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi181 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi181 to 17088M 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:52.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:51 smithi059 ceph-mon[30978]: from='osd.2 ' entity='osd.2' 2024-09-10T10:54:52.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:52.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi181 2024-09-10T10:54:52.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi181 to 17088M 2024-09-10T10:54:52.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:52.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:52.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:54:52.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T10:54:52.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:52.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:52.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:52.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:51 smithi181 ceph-mon[35409]: from='osd.2 ' entity='osd.2' 2024-09-10T10:54:52.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi181 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi181 to 17088M 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:52.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:51 smithi115 ceph-mon[34719]: from='osd.2 ' entity='osd.2' 2024-09-10T10:54:53.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:54:53.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:54:53.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:53.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:54:53.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:54:53.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:54:53.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:53.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: osd.2 [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] boot 2024-09-10T10:54:53.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T10:54:53.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:53.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:54:53.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:54:53.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:54:53.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:53.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:54:53.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:54:53.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:54:53.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:53.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: osd.2 [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] boot 2024-09-10T10:54:53.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T10:54:53.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:53.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:54:53.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:54:53.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:54:53.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:53.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:54:53.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:54:53.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:54:53.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:54:53.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: osd.2 [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] boot 2024-09-10T10:54:53.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T10:54:53.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:54:53.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:54:54.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:54 smithi059 ceph-mon[30978]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:54.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:54 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T10:54:54.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:54 smithi059 ceph-mon[30978]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T10:54:54.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:54 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:54:54.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:54 smithi181 ceph-mon[35409]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:54.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:54 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T10:54:54.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:54 smithi181 ceph-mon[35409]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T10:54:54.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:54 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:54:54.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:54 smithi115 ceph-mon[34719]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:54:54.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:54 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T10:54:54.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:54 smithi115 ceph-mon[34719]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T10:54:54.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:54 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:54:54.888 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:54 smithi059 sudo[47313]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:54:54.888 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:54 smithi059 sudo[47313]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:54.888 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:54 smithi059 sudo[47313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:54.888 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:54 smithi059 sudo[47313]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:55.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:54:55.359+0000 7f82f57fa640 1 -- 172.21.15.59:0/1879794318 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f82ec03b460 con 0x7f82f8102e00 2024-09-10T10:54:55.505 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:55 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:54:55.505 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:55 smithi115 ceph-mon[34719]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T10:54:55.505 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:55 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1903207639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22cc5420-33ee-4291-a301-5e6ff7511d91"}]: dispatch 2024-09-10T10:54:55.505 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:55 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1903207639' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22cc5420-33ee-4291-a301-5e6ff7511d91"}]': finished 2024-09-10T10:54:55.505 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:55 smithi115 ceph-mon[34719]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T10:54:55.505 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:55 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:54:55.505 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:55 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/112636401' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:54:55.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:55 smithi059 sudo[47338]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:54:55.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:55 smithi059 sudo[47338]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:55.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:55 smithi059 sudo[47338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:55.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 10:54:55 smithi059 sudo[47338]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:55.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:55 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:54:55.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:55 smithi059 ceph-mon[30978]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T10:54:55.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:55 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1903207639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22cc5420-33ee-4291-a301-5e6ff7511d91"}]: dispatch 2024-09-10T10:54:55.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:55 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1903207639' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22cc5420-33ee-4291-a301-5e6ff7511d91"}]': finished 2024-09-10T10:54:55.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:55 smithi059 ceph-mon[30978]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T10:54:55.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:55 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:54:55.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:55 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/112636401' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:54:55.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:55 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:54:55.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:55 smithi181 ceph-mon[35409]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T10:54:55.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:55 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1903207639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22cc5420-33ee-4291-a301-5e6ff7511d91"}]: dispatch 2024-09-10T10:54:55.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:55 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1903207639' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22cc5420-33ee-4291-a301-5e6ff7511d91"}]': finished 2024-09-10T10:54:55.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:55 smithi181 ceph-mon[35409]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T10:54:55.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:55 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:54:55.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:55 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/112636401' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:54:55.759 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:55 smithi115 sudo[43320]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:54:55.759 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:55 smithi115 sudo[43320]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:55.759 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:55 smithi115 sudo[43320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:55.759 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:55 smithi115 sudo[43320]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:56.208 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:55 smithi115 sudo[43323]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:54:56.208 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:55 smithi115 sudo[43323]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:56.208 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:55 smithi115 sudo[43323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:56.209 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 10:54:55 smithi115 sudo[43323]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:56.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:56 smithi181 ceph-mon[35409]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:54:56.285 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:56.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:56 smithi181 ceph-mon[35409]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T10:54:56.286 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:56.286 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:56 smithi181 sudo[44453]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:54:56.286 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:56 smithi181 sudo[44453]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:56.286 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:56 smithi181 sudo[44453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:56.286 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:56 smithi181 sudo[44453]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:56.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:56 smithi059 ceph-mon[30978]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:54:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:56 smithi059 ceph-mon[30978]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T10:54:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:56.686 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:56 smithi181 sudo[44456]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:54:56.686 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:56 smithi181 sudo[44456]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:56.686 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:56 smithi181 sudo[44456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:56.687 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 10:54:56 smithi181 sudo[44456]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:56 smithi115 ceph-mon[34719]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:54:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:56 smithi115 ceph-mon[34719]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T10:54:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:57.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:56 smithi059 sudo[47737]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:54:57.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:56 smithi059 sudo[47737]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:57.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:56 smithi059 sudo[47737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:57.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:56 smithi059 sudo[47737]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:57.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 sudo[47748]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:54:57.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 sudo[47748]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:57.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 sudo[47748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:57.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 sudo[47748]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:57.724 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 sudo[44459]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:54:57.724 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 sudo[44459]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:57.724 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 sudo[44459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:57.724 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 sudo[44459]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 ceph-mon[30978]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:54:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 ceph-mon[30978]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:54:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:54:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:54:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:54:58.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:54:58.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:54:58.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:54:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 sudo[44462]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 sudo[44462]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 sudo[44462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 sudo[44462]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 ceph-mon[35409]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 ceph-mon[35409]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:54:58.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:54:58.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:54:58.224 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:57 smithi115 sudo[43326]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:54:58.224 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:57 smithi115 sudo[43326]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:58.224 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:57 smithi115 sudo[43326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:58.224 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:57 smithi115 sudo[43326]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:58.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 sudo[43329]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:54:58.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 sudo[43329]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:54:58.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 sudo[43329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:54:58.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 sudo[43329]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:54:58.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:54:58.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:54:58.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:54:58.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:54:58.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:54:58.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:54:58.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:54:58.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:54:58.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:54:59.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:58 smithi059 ceph-mon[30978]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:54:59.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:58 smithi059 ceph-mon[30978]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:54:59.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:58 smithi059 ceph-mon[30978]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:54:59.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:58 smithi059 ceph-mon[30978]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:54:59.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:58 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:54:59.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:58 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:54:59.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:58 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:54:59.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:58 smithi059 ceph-mon[30978]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:54:59.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:58 smithi181 ceph-mon[35409]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:54:59.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:58 smithi181 ceph-mon[35409]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:54:59.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:58 smithi181 ceph-mon[35409]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:54:59.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:58 smithi181 ceph-mon[35409]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:54:59.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:58 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:54:59.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:58 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:54:59.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:58 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:54:59.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:58 smithi181 ceph-mon[35409]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:54:59.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:54:59.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:54:59.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:54:59.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:54:59.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:54:59.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:54:59.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:54:59.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:58 smithi115 ceph-mon[34719]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:54:59.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:54:59 smithi059 ceph-mon[30978]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:54:59 smithi181 ceph-mon[35409]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:54:59 smithi115 ceph-mon[34719]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:01.953 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:01 smithi059 ceph-mon[30978]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:01 smithi181 ceph-mon[35409]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:01 smithi115 ceph-mon[34719]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:04.056 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:03 smithi059 ceph-mon[30978]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-10T10:55:04.057 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:03 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:55:04.057 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:03 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:04.057 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:03 smithi059 ceph-mon[30978]: Deploying daemon osd.3 on smithi059 2024-09-10T10:55:04.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:03 smithi181 ceph-mon[35409]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-10T10:55:04.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:03 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:55:04.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:03 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:04.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:03 smithi181 ceph-mon[35409]: Deploying daemon osd.3 on smithi059 2024-09-10T10:55:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:03 smithi115 ceph-mon[34719]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-10T10:55:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:03 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:55:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:03 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:03 smithi115 ceph-mon[34719]: Deploying daemon osd.3 on smithi059 2024-09-10T10:55:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:05 smithi059 ceph-mon[30978]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-10T10:55:06.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:05 smithi181 ceph-mon[35409]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-10T10:55:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:05 smithi115 ceph-mon[34719]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-10T10:55:08.041 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:07 smithi059 ceph-mon[30978]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-10T10:55:08.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:07 smithi181 ceph-mon[35409]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-10T10:55:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:07 smithi115 ceph-mon[34719]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-10T10:55:09.988 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:09 smithi059 ceph-mon[30978]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T10:55:09.988 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:09 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:09.988 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:09 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:09.988 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:09 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:10.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:09 smithi181 ceph-mon[35409]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T10:55:10.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:09 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:10.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:09 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:10.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:09 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:09 smithi115 ceph-mon[34719]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T10:55:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:09 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:09 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:09 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:12.126 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:11 smithi059 ceph-mon[30978]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T10:55:12.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:11 smithi181 ceph-mon[35409]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T10:55:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:11 smithi115 ceph-mon[34719]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T10:55:13.119 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:13.119 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:13.119 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:13.119 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:13.119 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:13.161 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 3 on host 'smithi059' 2024-09-10T10:55:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.160+0000 7f82f57fa640 1 -- 172.21.15.59:0/1879794318 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f82f8062630 con 0x7f82e00a2b70 2024-09-10T10:55:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.162+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f82e00a2b70 msgr2=0x7f82e00a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.162+0000 7f82fe592640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f82e00a2b70 0x7f82e00a5030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82f8102c60 tx=0x7f82e8005f90 comp rx=0 tx=0).stop 2024-09-10T10:55:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.162+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 msgr2=0x7f82f80745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.162+0000 7f82fe592640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 0x7f82f80745e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009230 tx=0x7f82ec031b60 comp rx=0 tx=0).stop 2024-09-10T10:55:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.163+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 shutdown_connections 2024-09-10T10:55:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.163+0000 7f82fe592640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f82e00a2b70 0x7f82e00a5030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.163+0000 7f82fe592640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f81037c0 0x7f82f8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.163+0000 7f82fe592640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82f8102e00 0x7f82f80745e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.163+0000 7f82fe592640 1 --2- 172.21.15.59:0/1879794318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82f8101c00 0x7f82f8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.163+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 >> 172.21.15.59:0/1879794318 conn(0x7f82f80fd390 msgr2=0x7f82f8106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:55:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.163+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 shutdown_connections 2024-09-10T10:55:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:55:13.163+0000 7f82fe592640 1 -- 172.21.15.59:0/1879794318 wait complete. 2024-09-10T10:55:13.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:13.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:13.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:13.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:13.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:13.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:13.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:13.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:13.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:13.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:13.841 DEBUG:teuthology.orchestra.run.smithi059:osd.3> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T10:55:13.844 INFO:tasks.cephadm:Deploying osd.4 on smithi115 with /dev/vg_nvme/lv_3... 2024-09-10T10:55:13.844 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T10:55:14.095 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:55:14.132 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:13 smithi059 ceph-mon[30978]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T10:55:14.132 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:14.133 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:14.133 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:13 smithi181 ceph-mon[35409]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T10:55:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:14.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:14.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:13 smithi115 ceph-mon[34719]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T10:55:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:15.342 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 10:55:15 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3[49330]: 2024-09-10T10:55:15.075+0000 7f343eb74640 -1 osd.3 0 log_to_monitors true 2024-09-10T10:55:16.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:15 smithi059 ceph-mon[30978]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:16.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:15 smithi059 ceph-mon[30978]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:55:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:15 smithi181 ceph-mon[35409]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:15 smithi181 ceph-mon[35409]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:55:16.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:15 smithi115 ceph-mon[34719]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:16.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:15 smithi115 ceph-mon[34719]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:55:16.532 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:55:16.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_3 2024-09-10T10:55:16.807 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:55:17.099 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:55:17.099 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T10:55:17.099 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:55:17.100 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:17.100 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.100 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.100 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:17.100 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:17.100 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.100 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:17.100 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:17.100 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.138 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3[49330]: 2024-09-10T10:55:16.893+0000 7f343aaf7640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T10:55:17.138 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3[49330]: 2024-09-10T10:55:16.897+0000 7f343691f640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:55:17.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:55:17.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T10:55:17.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:55:17.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:17.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:17.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:17.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:17.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:17.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:55:17.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T10:55:17.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:55:17.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:17.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:17.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:17.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:17.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:17.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.294+0000 7f202b106640 1 -- 172.21.15.115:0/3891709261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024100ad0 msgr2=0x7f2024100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.294+0000 7f202b106640 1 --2- 172.21.15.115:0/3891709261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024100ad0 0x7f2024100ed0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2018009900 tx=0x7f201802a410 comp rx=0 tx=0).stop 2024-09-10T10:55:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.294+0000 7f202b106640 1 -- 172.21.15.115:0/3891709261 shutdown_connections 2024-09-10T10:55:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.294+0000 7f202b106640 1 --2- 172.21.15.115:0/3891709261 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2024102690 0x7f2024108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.294+0000 7f202b106640 1 --2- 172.21.15.115:0/3891709261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2024101cd0 0x7f2024102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.294+0000 7f202b106640 1 --2- 172.21.15.115:0/3891709261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024100ad0 0x7f2024100ed0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.294+0000 7f202b106640 1 -- 172.21.15.115:0/3891709261 >> 172.21.15.115:0/3891709261 conn(0x7f20240fc280 msgr2=0x7f20240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.294+0000 7f202b106640 1 -- 172.21.15.115:0/3891709261 shutdown_connections 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.294+0000 7f202b106640 1 -- 172.21.15.115:0/3891709261 wait complete. 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f202b106640 1 Processor -- start 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f202b106640 1 -- start start 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f202b106640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2024100ad0 0x7f202406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f202b106640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2024101cd0 0x7f202419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f202b106640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024102690 0x7f202419f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f202b106640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f202410c760 con 0x7f2024100ad0 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f202b106640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f202410c5e0 con 0x7f2024102690 2024-09-10T10:55:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f202b106640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f202410c8e0 con 0x7f2024101cd0 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f20296a3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024102690 0x7f202419f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f20296a3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024102690 0x7f202419f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49994/0 (socket says 172.21.15.115:49994) 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f20296a3640 1 -- 172.21.15.115:0/2152760203 learned_addr learned my addr 172.21.15.115:0/2152760203 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f2023fff640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2024101cd0 0x7f202419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f2028ea2640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2024100ad0 0x7f202406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f20296a3640 1 -- 172.21.15.115:0/2152760203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2024101cd0 msgr2=0x7f202419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f20296a3640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2024101cd0 0x7f202419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f20296a3640 1 -- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2024100ad0 msgr2=0x7f202406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f20296a3640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2024100ad0 0x7f202406ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f20296a3640 1 -- 172.21.15.115:0/2152760203 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202419fb30 con 0x7f2024102690 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f2028ea2640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2024100ad0 0x7f202406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:55:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.295+0000 7f20296a3640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024102690 0x7f202419f270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f201c00eb10 tx=0x7f201c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.296+0000 7f2021ffb640 1 -- 172.21.15.115:0/2152760203 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c004b20 con 0x7f2024102690 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.296+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202419fe20 con 0x7f2024102690 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.296+0000 7f2021ffb640 1 -- 172.21.15.115:0/2152760203 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f201c004cc0 con 0x7f2024102690 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.296+0000 7f2021ffb640 1 -- 172.21.15.115:0/2152760203 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c010760 con 0x7f2024102690 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.296+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20241a02d0 con 0x7f2024102690 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.297+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2024107ed0 con 0x7f2024102690 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.298+0000 7f2021ffb640 1 -- 172.21.15.115:0/2152760203 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f201c005020 con 0x7f2024102690 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.299+0000 7f2021ffb640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20140a2b80 0x7f20140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.299+0000 7f2021ffb640 1 -- 172.21.15.115:0/2152760203 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7f201c0ce3e0 con 0x7f2024102690 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.299+0000 7f2028ea2640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20140a2b80 0x7f20140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.300+0000 7f2028ea2640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20140a2b80 0x7f20140a5040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20180314e0 tx=0x7f2018032cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:55:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.303+0000 7f2021ffb640 1 -- 172.21.15.115:0/2152760203 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f201c09c680 con 0x7f2024102690 2024-09-10T10:55:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:17.485+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2024062630 con 0x7f20140a2b80 2024-09-10T10:55:18.121 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:18.121 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi059 2024-09-10T10:55:18.121 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi059 to 8546M 2024-09-10T10:55:18.121 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:55:18.121 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T10:55:18.122 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:18.122 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:18.122 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:55:18.122 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:55:18.122 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:55:18.122 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:17 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi059 2024-09-10T10:55:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi059 to 8546M 2024-09-10T10:55:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:55:18.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T10:55:18.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:18.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:18.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:55:18.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:55:18.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:55:18.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:17 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:18.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:55:18.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi059 2024-09-10T10:55:18.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi059 to 8546M 2024-09-10T10:55:18.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: from='osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:55:18.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T10:55:18.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:18.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:18.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:55:18.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:55:18.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:55:18.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:17 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:19.185 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:18 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:55:19.185 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:18 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:18 smithi115 ceph-mon[34719]: osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] boot 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:18 smithi115 ceph-mon[34719]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:18 smithi115 ceph-mon[34719]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:18 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:18 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:18 smithi181 ceph-mon[35409]: osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] boot 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:18 smithi181 ceph-mon[35409]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:19.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:18 smithi181 ceph-mon[35409]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T10:55:19.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:18 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:55:19.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:18 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:55:19.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:18 smithi059 ceph-mon[30978]: osd.3 [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] boot 2024-09-10T10:55:19.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:18 smithi059 ceph-mon[30978]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T10:55:19.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:55:19.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:18 smithi059 ceph-mon[30978]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T10:55:20.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:20 smithi115 ceph-mon[34719]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:20.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:20 smithi115 ceph-mon[34719]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T10:55:20.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:20 smithi115 ceph-mon[34719]: from='client.? 172.21.15.115:0/236694633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1a99b0b-8b83-41b7-b6f9-400eabf3ea39"}]: dispatch 2024-09-10T10:55:20.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:20 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1a99b0b-8b83-41b7-b6f9-400eabf3ea39"}]: dispatch 2024-09-10T10:55:20.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:20 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1a99b0b-8b83-41b7-b6f9-400eabf3ea39"}]': finished 2024-09-10T10:55:20.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:20 smithi115 ceph-mon[34719]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T10:55:20.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:20 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:20.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:20 smithi115 ceph-mon[34719]: from='client.? 172.21.15.115:0/106313817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:55:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:20 smithi059 ceph-mon[30978]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:20 smithi059 ceph-mon[30978]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T10:55:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:20 smithi059 ceph-mon[30978]: from='client.? 172.21.15.115:0/236694633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1a99b0b-8b83-41b7-b6f9-400eabf3ea39"}]: dispatch 2024-09-10T10:55:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:20 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1a99b0b-8b83-41b7-b6f9-400eabf3ea39"}]: dispatch 2024-09-10T10:55:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:20 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1a99b0b-8b83-41b7-b6f9-400eabf3ea39"}]': finished 2024-09-10T10:55:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:20 smithi059 ceph-mon[30978]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T10:55:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:20 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:20 smithi059 ceph-mon[30978]: from='client.? 172.21.15.115:0/106313817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:55:20.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:20 smithi181 ceph-mon[35409]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:20.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:20 smithi181 ceph-mon[35409]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T10:55:20.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:20 smithi181 ceph-mon[35409]: from='client.? 172.21.15.115:0/236694633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1a99b0b-8b83-41b7-b6f9-400eabf3ea39"}]: dispatch 2024-09-10T10:55:20.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:20 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1a99b0b-8b83-41b7-b6f9-400eabf3ea39"}]: dispatch 2024-09-10T10:55:20.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:20 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1a99b0b-8b83-41b7-b6f9-400eabf3ea39"}]': finished 2024-09-10T10:55:20.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:20 smithi181 ceph-mon[35409]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T10:55:20.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:20 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:20.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:20 smithi181 ceph-mon[35409]: from='client.? 172.21.15.115:0/106313817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:55:22.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:21 smithi181 ceph-mon[35409]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:22.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:21 smithi181 ceph-mon[35409]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T10:55:22.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:21 smithi115 ceph-mon[34719]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:21 smithi115 ceph-mon[34719]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T10:55:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:22.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:21 smithi059 ceph-mon[30978]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:22.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:21 smithi059 ceph-mon[30978]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T10:55:22.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:23.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:22 smithi181 ceph-mon[35409]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T10:55:23.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:23.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:22 smithi115 ceph-mon[34719]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T10:55:23.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:23.218 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:22 smithi059 ceph-mon[30978]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T10:55:23.219 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:24.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:23 smithi181 ceph-mon[35409]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T10:55:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:23 smithi115 ceph-mon[34719]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T10:55:24.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:23 smithi059 ceph-mon[30978]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T10:55:26.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:25 smithi181 ceph-mon[35409]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-10T10:55:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:25 smithi115 ceph-mon[34719]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-10T10:55:26.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:25 smithi059 ceph-mon[30978]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-10T10:55:28.038 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:27 smithi115 ceph-mon[34719]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-10T10:55:28.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:27 smithi181 ceph-mon[35409]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-10T10:55:28.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:27 smithi059 ceph-mon[30978]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-10T10:55:29.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:55:29.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:29.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:28 smithi181 ceph-mon[35409]: Deploying daemon osd.4 on smithi115 2024-09-10T10:55:29.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:55:29.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:29.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:28 smithi115 ceph-mon[34719]: Deploying daemon osd.4 on smithi115 2024-09-10T10:55:29.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:55:29.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:29.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:28 smithi059 ceph-mon[30978]: Deploying daemon osd.4 on smithi115 2024-09-10T10:55:29.956 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:29 smithi115 ceph-mon[34719]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:55:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:29 smithi181 ceph-mon[35409]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:55:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:29 smithi059 ceph-mon[30978]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:55:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:31 smithi181 ceph-mon[35409]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T10:55:32.237 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:31 smithi115 ceph-mon[34719]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T10:55:32.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:31 smithi059 ceph-mon[30978]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T10:55:34.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:33 smithi181 ceph-mon[35409]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:33 smithi115 ceph-mon[34719]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:33 smithi059 ceph-mon[30978]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:35.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:34 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:35.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:34 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:35.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:34 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:35.203 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:34 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:35.203 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:34 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:35.203 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:34 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:35.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:34 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:35.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:34 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:35.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:34 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:36.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:36 smithi059 ceph-mon[30978]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:36.426 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:36 smithi115 ceph-mon[34719]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:36.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:36 smithi181 ceph-mon[35409]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:37.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.303+0000 7f2021ffb640 1 -- 172.21.15.115:0/2152760203 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2024062630 con 0x7f20140a2b80 2024-09-10T10:55:37.305 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 4 on host 'smithi115' 2024-09-10T10:55:37.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20140a2b80 msgr2=0x7f20140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:37.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20140a2b80 0x7f20140a5040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20180314e0 tx=0x7f2018032cf0 comp rx=0 tx=0).stop 2024-09-10T10:55:37.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024102690 msgr2=0x7f202419f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:37.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024102690 0x7f202419f270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f201c00eb10 tx=0x7f201c00c2d0 comp rx=0 tx=0).stop 2024-09-10T10:55:37.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 shutdown_connections 2024-09-10T10:55:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20140a2b80 0x7f20140a5040 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2024102690 0x7f202419f270 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2024101cd0 0x7f202419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 --2- 172.21.15.115:0/2152760203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2024100ad0 0x7f202406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 >> 172.21.15.115:0/2152760203 conn(0x7f20240fc280 msgr2=0x7f20241050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:55:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 shutdown_connections 2024-09-10T10:55:37.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:55:37.306+0000 7f202b106640 1 -- 172.21.15.115:0/2152760203 wait complete. 2024-09-10T10:55:37.985 DEBUG:teuthology.orchestra.run.smithi115:osd.4> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T10:55:37.987 INFO:tasks.cephadm:Deploying osd.5 on smithi181 with /dev/vg_nvme/lv_3... 2024-09-10T10:55:37.987 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T10:55:38.238 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:55:38.529 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:38 smithi115 ceph-mon[34719]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:38.529 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.529 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.529 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.529 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:38 smithi181 ceph-mon[35409]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:38.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:38 smithi059 ceph-mon[30978]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:38.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:38.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:40.306 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 10:55:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4[46078]: 2024-09-10T10:55:40.198+0000 7f88cad65640 -1 osd.4 0 log_to_monitors true 2024-09-10T10:55:40.593 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:40 smithi181 ceph-mon[35409]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:40.593 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:40 smithi181 ceph-mon[35409]: from='osd.4 [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:55:40.594 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:40 smithi181 ceph-mon[35409]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:55:40.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:40 smithi059 ceph-mon[30978]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:40.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:40 smithi059 ceph-mon[30978]: from='osd.4 [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:55:40.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:40 smithi059 ceph-mon[30978]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:55:40.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:40 smithi115 ceph-mon[34719]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:40.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:40 smithi115 ceph-mon[34719]: from='osd.4 [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:55:40.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:40 smithi115 ceph-mon[34719]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:55:40.738 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:55:40.765 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi181:vg_nvme/lv_3 2024-09-10T10:55:41.016 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='osd.4 [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:41.422 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.423 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:41.423 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:41.423 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.423 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:41.423 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:41.423 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:41.423 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.423 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:41 smithi181 ceph-mon[35409]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:55:41.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 -- 172.21.15.181:0/4231183253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0100ad0 msgr2=0x7fc1c0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:41.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/4231183253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0100ad0 0x7fc1c0100ed0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009900 tx=0x7fc1bc02a410 comp rx=0 tx=0).stop 2024-09-10T10:55:41.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 -- 172.21.15.181:0/4231183253 shutdown_connections 2024-09-10T10:55:41.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/4231183253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c0102690 0x7fc1c0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/4231183253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0101cd0 0x7fc1c0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/4231183253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0100ad0 0x7fc1c0100ed0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 -- 172.21.15.181:0/4231183253 >> 172.21.15.181:0/4231183253 conn(0x7fc1c00fc280 msgr2=0x7fc1c00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 -- 172.21.15.181:0/4231183253 shutdown_connections 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 -- 172.21.15.181:0/4231183253 wait complete. 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 Processor -- start 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.505+0000 7fc1c80ea640 1 -- start start 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c80ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c0100ad0 0x7fc1c0197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c80ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0101cd0 0x7fc1c0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c80ea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0102690 0x7fc1c019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:55:41.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c80ea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c010c750 con 0x7fc1c0100ad0 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c80ea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c010c5d0 con 0x7fc1c0101cd0 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c80ea640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c010c8d0 con 0x7fc1c0102690 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c6687640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0102690 0x7fc1c019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c6687640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0102690 0x7fc1c019f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:58544/0 (socket says 172.21.15.181:58544) 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c5685640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0101cd0 0x7fc1c0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c6687640 1 -- 172.21.15.181:0/3946291648 learned_addr learned my addr 172.21.15.181:0/3946291648 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c5e86640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c0100ad0 0x7fc1c0197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c6687640 1 -- 172.21.15.181:0/3946291648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0101cd0 msgr2=0x7fc1c0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c6687640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0101cd0 0x7fc1c0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c6687640 1 -- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c0100ad0 msgr2=0x7fc1c0197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c6687640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c0100ad0 0x7fc1c0197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:55:41.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c6687640 1 -- 172.21.15.181:0/3946291648 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c019fb30 con 0x7fc1c0102690 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c6687640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0102690 0x7fc1c019f4c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800eb10 tx=0x7fc1b800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1b6ffd640 1 -- 172.21.15.181:0/3946291648 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8004b20 con 0x7fc1c0102690 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1b6ffd640 1 -- 172.21.15.181:0/3946291648 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b8004cc0 con 0x7fc1c0102690 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c019fe20 con 0x7fc1c0102690 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1b6ffd640 1 -- 172.21.15.181:0/3946291648 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8010760 con 0x7fc1c0102690 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.506+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c01a02d0 con 0x7fc1c0102690 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.507+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c01a0560 con 0x7fc1c0102690 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.508+0000 7fc1b6ffd640 1 -- 172.21.15.181:0/3946291648 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc1b8004fe0 con 0x7fc1c0102690 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.509+0000 7fc1b6ffd640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc1ac0a2bb0 0x7fc1ac0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.509+0000 7fc1c5e86640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc1ac0a2bb0 0x7fc1ac0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.509+0000 7fc1b6ffd640 1 -- 172.21.15.181:0/3946291648 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7fc1b80ce410 con 0x7fc1c0102690 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.510+0000 7fc1c5e86640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc1ac0a2bb0 0x7fc1ac0a5070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc005ab0 tx=0x7fc1bc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:55:41.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.513+0000 7fc1b6ffd640 1 -- 172.21.15.181:0/3946291648 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1b809c500 con 0x7fc1c0102690 2024-09-10T10:55:41.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:55:41.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T10:55:41.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='osd.4 [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:55:41.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:41.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:55:41.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:41 smithi059 ceph-mon[30978]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:55:41.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:55:41.686+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc1c01a0730 con 0x7fc1ac0a2bb0 2024-09-10T10:55:41.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:55:41.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T10:55:41.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='osd.4 [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:55:41.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:55:41.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:41.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-mon[34719]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:55:42.208 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4[46078]: 2024-09-10T10:55:41.718+0000 7f88c6ce8640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T10:55:42.208 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 10:55:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4[46078]: 2024-09-10T10:55:41.724+0000 7f88beb08640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi115 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi115 to 8544M 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:42 smithi181 ceph-mon[35409]: from='osd.4 ' entity='osd.4' 2024-09-10T10:55:42.640 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:42.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi115 2024-09-10T10:55:42.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi115 to 8544M 2024-09-10T10:55:42.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T10:55:42.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:42.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:42.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:55:42.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:55:42.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:42.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:42 smithi059 ceph-mon[30978]: from='osd.4 ' entity='osd.4' 2024-09-10T10:55:42.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:42.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi115 2024-09-10T10:55:42.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi115 to 8544M 2024-09-10T10:55:42.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T10:55:42.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:42.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:42.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:55:42.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:55:42.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:42.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:42 smithi115 ceph-mon[34719]: from='osd.4 ' entity='osd.4' 2024-09-10T10:55:43.353 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:43 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:55:43.353 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:43 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:55:43.354 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:43 smithi181 ceph-mon[35409]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:55:43.354 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:43.354 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:43 smithi181 ceph-mon[35409]: osd.4 [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] boot 2024-09-10T10:55:43.354 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:43 smithi181 ceph-mon[35409]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T10:55:43.354 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:43.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:43 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:55:43.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:43 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:55:43.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:43 smithi059 ceph-mon[30978]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:55:43.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:43.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:43 smithi059 ceph-mon[30978]: osd.4 [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] boot 2024-09-10T10:55:43.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:43 smithi059 ceph-mon[30978]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T10:55:43.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:43.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:43 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:55:43.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:43 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:55:43.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:43 smithi115 ceph-mon[34719]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:55:43.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:43.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:43 smithi115 ceph-mon[34719]: osd.4 [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] boot 2024-09-10T10:55:43.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:43 smithi115 ceph-mon[34719]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T10:55:43.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:55:44.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:44 smithi181 ceph-mon[35409]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:44.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:44 smithi181 ceph-mon[35409]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T10:55:44.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:44 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/2010004595' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48"}]: dispatch 2024-09-10T10:55:44.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:44 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48"}]: dispatch 2024-09-10T10:55:44.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:44 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48"}]': finished 2024-09-10T10:55:44.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:44 smithi181 ceph-mon[35409]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T10:55:44.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:44 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:55:44.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:44 smithi059 ceph-mon[30978]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:44.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:44 smithi059 ceph-mon[30978]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T10:55:44.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:44 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/2010004595' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48"}]: dispatch 2024-09-10T10:55:44.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:44 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48"}]: dispatch 2024-09-10T10:55:44.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:44 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48"}]': finished 2024-09-10T10:55:44.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:44 smithi059 ceph-mon[30978]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T10:55:44.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:44 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:55:44.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:44 smithi115 ceph-mon[34719]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-10T10:55:44.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:44 smithi115 ceph-mon[34719]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T10:55:44.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:44 smithi115 ceph-mon[34719]: from='client.? 172.21.15.181:0/2010004595' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48"}]: dispatch 2024-09-10T10:55:44.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:44 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48"}]: dispatch 2024-09-10T10:55:44.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:44 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48"}]': finished 2024-09-10T10:55:44.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:44 smithi115 ceph-mon[34719]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T10:55:44.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:44 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:55:45.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:45 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/3385384084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:55:45.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:45 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/3385384084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:55:45.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:45 smithi115 ceph-mon[34719]: from='client.? 172.21.15.181:0/3385384084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:55:46.588 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:46 smithi181 ceph-mon[35409]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:46.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:46 smithi059 ceph-mon[30978]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:46.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:46 smithi115 ceph-mon[34719]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:48.612 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:48 smithi181 ceph-mon[35409]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:48.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:48 smithi059 ceph-mon[30978]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:48.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:48 smithi115 ceph-mon[34719]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:50.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:50 smithi059 ceph-mon[30978]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:50.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:50 smithi181 ceph-mon[35409]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:50.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:50 smithi115 ceph-mon[34719]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:52.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:52 smithi059 ceph-mon[30978]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:52.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:52 smithi181 ceph-mon[35409]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:52.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:52 smithi115 ceph-mon[34719]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:53.562 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:55:53.563 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:53.563 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:53 smithi181 ceph-mon[35409]: Deploying daemon osd.5 on smithi181 2024-09-10T10:55:53.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:55:53.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:53.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:53 smithi059 ceph-mon[30978]: Deploying daemon osd.5 on smithi181 2024-09-10T10:55:53.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:55:53.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:55:53.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:53 smithi115 ceph-mon[34719]: Deploying daemon osd.5 on smithi181 2024-09-10T10:55:54.523 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:54 smithi181 ceph-mon[35409]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:54.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:54 smithi059 ceph-mon[30978]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:54.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:54 smithi115 ceph-mon[34719]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:56.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:56 smithi181 ceph-mon[35409]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:56 smithi059 ceph-mon[30978]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:56 smithi115 ceph-mon[34719]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:58.615 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:58 smithi181 ceph-mon[35409]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:58.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:58 smithi059 ceph-mon[30978]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:58.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:58 smithi115 ceph-mon[34719]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:55:59.418 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:59.418 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:59.418 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:55:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:59.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:59.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:59.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:55:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:59.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:55:59.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:55:59.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:55:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:00.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:00 smithi059 ceph-mon[30978]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:00.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:00 smithi181 ceph-mon[35409]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:00.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:00 smithi115 ceph-mon[34719]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:02.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:02 smithi059 ceph-mon[30978]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:02.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:02.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:02.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:02.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:02.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:02.665 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:02 smithi181 ceph-mon[35409]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:02.665 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:02.665 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:02.665 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:02.665 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:02.665 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:02.706 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 5 on host 'smithi181' 2024-09-10T10:56:02.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.704+0000 7fc1b6ffd640 1 -- 172.21.15.181:0/3946291648 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc1c01a0730 con 0x7fc1ac0a2bb0 2024-09-10T10:56:02.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc1ac0a2bb0 msgr2=0x7fc1ac0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:02.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc1ac0a2bb0 0x7fc1ac0a5070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc005ab0 tx=0x7fc1bc000bc0 comp rx=0 tx=0).stop 2024-09-10T10:56:02.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0102690 msgr2=0x7fc1c019f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:02.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0102690 0x7fc1c019f4c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800eb10 tx=0x7fc1b800c2d0 comp rx=0 tx=0).stop 2024-09-10T10:56:02.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 shutdown_connections 2024-09-10T10:56:02.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc1ac0a2bb0 0x7fc1ac0a5070 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:02.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1c0102690 0x7fc1c019f4c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:02.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0101cd0 0x7fc1c0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:02.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 --2- 172.21.15.181:0/3946291648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c0100ad0 0x7fc1c0197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:02.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 >> 172.21.15.181:0/3946291648 conn(0x7fc1c00fc280 msgr2=0x7fc1c00fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:56:02.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 shutdown_connections 2024-09-10T10:56:02.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:02.706+0000 7fc1c80ea640 1 -- 172.21.15.181:0/3946291648 wait complete. 2024-09-10T10:56:02.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:02 smithi115 ceph-mon[34719]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:02.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:02.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:02.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:02.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:02.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:03.346 DEBUG:teuthology.orchestra.run.smithi181:osd.5> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T10:56:03.348 INFO:tasks.cephadm:Deploying osd.6 on smithi059 with /dev/vg_nvme/lv_2... 2024-09-10T10:56:03.348 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T10:56:03.615 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:56:03.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:03 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:03.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:03 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:03.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:03 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:03.679 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:03 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:03.679 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:03 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:03.679 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:03 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:03.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:03 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:03.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:03 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:03.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:03 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:04.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:04 smithi181 ceph-mon[35409]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:04.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:04 smithi059 ceph-mon[30978]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:04.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:04 smithi115 ceph-mon[34719]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:04.835 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 10:56:04 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T10:56:04.496+0000 7f407a87b640 -1 osd.5 0 log_to_monitors true 2024-09-10T10:56:05.556 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:05 smithi059 ceph-mon[30978]: from='osd.5 [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:56:05.557 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:05 smithi059 ceph-mon[30978]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:56:05.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:05 smithi181 ceph-mon[35409]: from='osd.5 [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:56:05.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:05 smithi181 ceph-mon[35409]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:56:05.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:05 smithi115 ceph-mon[34719]: from='osd.5 [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:56:05.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:05 smithi115 ceph-mon[34719]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:56:06.280 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:56:06.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_2 2024-09-10T10:56:06.581 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='osd.5 [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:06.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:06.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:06.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:06 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:06.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:56:06.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='osd.5 [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:56:06.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:06.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:06.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:56:06.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='osd.5 [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:56:06.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T10:56:06.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:06.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:56:06.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:06.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:06.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:06.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:06.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:06.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:06 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.074+0000 7f50decd7640 1 -- 172.21.15.59:0/504744181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d81037c0 msgr2=0x7f50d810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.074+0000 7f50decd7640 1 --2- 172.21.15.59:0/504744181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d81037c0 0x7f50d810a050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009ca0 tx=0x7f50d002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:56:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.074+0000 7f50decd7640 1 -- 172.21.15.59:0/504744181 shutdown_connections 2024-09-10T10:56:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.074+0000 7f50decd7640 1 --2- 172.21.15.59:0/504744181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d81037c0 0x7f50d810a050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.074+0000 7f50decd7640 1 --2- 172.21.15.59:0/504744181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50d8102e00 0x7f50d8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.074+0000 7f50decd7640 1 --2- 172.21.15.59:0/504744181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50d8101c00 0x7f50d8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.074+0000 7f50decd7640 1 -- 172.21.15.59:0/504744181 >> 172.21.15.59:0/504744181 conn(0x7f50d80fd390 msgr2=0x7f50d80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.074+0000 7f50decd7640 1 -- 172.21.15.59:0/504744181 shutdown_connections 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.074+0000 7f50decd7640 1 -- 172.21.15.59:0/504744181 wait complete. 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50decd7640 1 Processor -- start 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50decd7640 1 -- start start 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50decd7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50d8101c00 0x7f50d8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50decd7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d8102e00 0x7f50d81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50decd7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50d81037c0 0x7f50d819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50decd7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f50d810d880 con 0x7f50d8102e00 2024-09-10T10:56:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50decd7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f50d810d700 con 0x7f50d81037c0 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50decd7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f50d810da00 con 0x7f50d8101c00 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50d7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d8102e00 0x7f50d81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50d7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d8102e00 0x7f50d81983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40812/0 (socket says 172.21.15.59:40812) 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50d7fff640 1 -- 172.21.15.59:0/3400681105 learned_addr learned my addr 172.21.15.59:0/3400681105 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50dca73640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50d8101c00 0x7f50d8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50dd274640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50d81037c0 0x7f50d819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50d7fff640 1 -- 172.21.15.59:0/3400681105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50d8101c00 msgr2=0x7f50d8197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50d7fff640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50d8101c00 0x7f50d8197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50d7fff640 1 -- 172.21.15.59:0/3400681105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50d81037c0 msgr2=0x7f50d819f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50d7fff640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50d81037c0 0x7f50d819f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.075+0000 7f50d7fff640 1 -- 172.21.15.59:0/3400681105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d819fad0 con 0x7f50d8102e00 2024-09-10T10:56:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.076+0000 7f50d7fff640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d8102e00 0x7f50d81983e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f50c400d770 tx=0x7f50c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:56:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.076+0000 7f50d5ffb640 1 -- 172.21.15.59:0/3400681105 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4017070 con 0x7f50d8102e00 2024-09-10T10:56:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.076+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d819fdc0 con 0x7f50d8102e00 2024-09-10T10:56:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.076+0000 7f50d5ffb640 1 -- 172.21.15.59:0/3400681105 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50c4005500 con 0x7f50d8102e00 2024-09-10T10:56:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.076+0000 7f50d5ffb640 1 -- 172.21.15.59:0/3400681105 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4004e00 con 0x7f50d8102e00 2024-09-10T10:56:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.076+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d81a0220 con 0x7f50d8102e00 2024-09-10T10:56:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.077+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d8108f80 con 0x7f50d8102e00 2024-09-10T10:56:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.078+0000 7f50d5ffb640 1 -- 172.21.15.59:0/3400681105 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f50c4004fa0 con 0x7f50d8102e00 2024-09-10T10:56:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.079+0000 7f50d5ffb640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f50c80a2bb0 0x7f50c80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.079+0000 7f50dca73640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f50c80a2bb0 0x7f50c80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.079+0000 7f50d5ffb640 1 -- 172.21.15.59:0/3400681105 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7f50c40cd980 con 0x7f50d8102e00 2024-09-10T10:56:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.079+0000 7f50dca73640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f50c80a2bb0 0x7f50c80a5070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f50d8102c60 tx=0x7f50cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:56:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.084+0000 7f50d5ffb640 1 -- 172.21.15.59:0/3400681105 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50c409b270 con 0x7f50d8102e00 2024-09-10T10:56:07.186 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T10:56:06.754+0000 7f40767fe640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T10:56:07.186 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 10:56:06 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T10:56:06.759+0000 7f406e61e640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:56:07.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:07.269+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f50d8062630 con 0x7f50c80a2bb0 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi181 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi181 to 8544M 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: from='osd.5 ' entity='osd.5' 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:56:07.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:07.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi181 2024-09-10T10:56:07.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi181 to 8544M 2024-09-10T10:56:07.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:56:07.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T10:56:07.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:07.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:07.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: from='osd.5 ' entity='osd.5' 2024-09-10T10:56:07.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:56:07.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:56:07.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:07.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi181 2024-09-10T10:56:07.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi181 to 8544M 2024-09-10T10:56:07.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:56:07.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T10:56:07.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:07.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:07.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: from='osd.5 ' entity='osd.5' 2024-09-10T10:56:07.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:56:07.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:56:07.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:08.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:08 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:56:08.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:08 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:56:08.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:08 smithi181 ceph-mon[35409]: pgmap v130: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:08.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:08 smithi181 ceph-mon[35409]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:56:08.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:08.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:08 smithi181 ceph-mon[35409]: osd.5 [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] boot 2024-09-10T10:56:08.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:08 smithi181 ceph-mon[35409]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T10:56:08.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:08.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:08 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:56:08.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:08 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:56:08.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:08 smithi115 ceph-mon[34719]: pgmap v130: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:08.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:08 smithi115 ceph-mon[34719]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:56:08.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:08.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:08 smithi115 ceph-mon[34719]: osd.5 [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] boot 2024-09-10T10:56:08.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:08 smithi115 ceph-mon[34719]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T10:56:08.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:08.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:08 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:56:08.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:08 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:56:08.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:08 smithi059 ceph-mon[30978]: pgmap v130: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:56:08.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:08 smithi059 ceph-mon[30978]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:56:08.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:08.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:08 smithi059 ceph-mon[30978]: osd.5 [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] boot 2024-09-10T10:56:08.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:08 smithi059 ceph-mon[30978]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T10:56:08.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:56:09.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:09 smithi181 ceph-mon[35409]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T10:56:09.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:09 smithi115 ceph-mon[34719]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T10:56:09.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:09 smithi059 ceph-mon[30978]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T10:56:10.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:10 smithi059 ceph-mon[30978]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:10.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:10 smithi059 ceph-mon[30978]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T10:56:10.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:10 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/4075613362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39256edb-3181-4fa3-95c6-edecfc3b605c"}]: dispatch 2024-09-10T10:56:10.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:10 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/4075613362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39256edb-3181-4fa3-95c6-edecfc3b605c"}]': finished 2024-09-10T10:56:10.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:10 smithi059 ceph-mon[30978]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T10:56:10.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:10 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:10.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:10 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/4015775657' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:56:10.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:10 smithi181 ceph-mon[35409]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:10.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:10 smithi181 ceph-mon[35409]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T10:56:10.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:10 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/4075613362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39256edb-3181-4fa3-95c6-edecfc3b605c"}]: dispatch 2024-09-10T10:56:10.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:10 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/4075613362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39256edb-3181-4fa3-95c6-edecfc3b605c"}]': finished 2024-09-10T10:56:10.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:10 smithi181 ceph-mon[35409]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T10:56:10.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:10 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:10.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:10 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/4015775657' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:56:10.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:10 smithi115 ceph-mon[34719]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:10.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:10 smithi115 ceph-mon[34719]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T10:56:10.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:10 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/4075613362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39256edb-3181-4fa3-95c6-edecfc3b605c"}]: dispatch 2024-09-10T10:56:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:10 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/4075613362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39256edb-3181-4fa3-95c6-edecfc3b605c"}]': finished 2024-09-10T10:56:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:10 smithi115 ceph-mon[34719]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T10:56:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:10 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:10 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/4015775657' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:56:12.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:11 smithi059 ceph-mon[30978]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:12.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:11 smithi059 ceph-mon[30978]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T10:56:12.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:11 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:12.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:11 smithi181 ceph-mon[35409]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:12.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:11 smithi181 ceph-mon[35409]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T10:56:12.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:11 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:11 smithi115 ceph-mon[34719]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:11 smithi115 ceph-mon[34719]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T10:56:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:11 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:14.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:13 smithi059 ceph-mon[30978]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-10T10:56:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:13 smithi181 ceph-mon[35409]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-10T10:56:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:13 smithi115 ceph-mon[34719]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-10T10:56:16.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:15 smithi059 ceph-mon[30978]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:56:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:15 smithi181 ceph-mon[35409]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:56:16.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:15 smithi115 ceph-mon[34719]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:56:18.006 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:17 smithi181 ceph-mon[35409]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T10:56:18.010 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:17 smithi115 ceph-mon[34719]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T10:56:18.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:17 smithi059 ceph-mon[30978]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T10:56:19.000 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T10:56:19.000 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:19.001 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:18 smithi059 ceph-mon[30978]: Deploying daemon osd.6 on smithi059 2024-09-10T10:56:19.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T10:56:19.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:19.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:18 smithi181 ceph-mon[35409]: Deploying daemon osd.6 on smithi059 2024-09-10T10:56:19.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T10:56:19.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:19.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:18 smithi115 ceph-mon[34719]: Deploying daemon osd.6 on smithi059 2024-09-10T10:56:20.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:19 smithi059 ceph-mon[30978]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-10T10:56:20.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:19 smithi181 ceph-mon[35409]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-10T10:56:20.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:19 smithi115 ceph-mon[34719]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-10T10:56:22.057 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:21 smithi059 ceph-mon[30978]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:56:22.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:21 smithi181 ceph-mon[35409]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:56:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:21 smithi115 ceph-mon[34719]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:56:23.886 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:23 smithi059 ceph-mon[30978]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:56:24.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:23 smithi181 ceph-mon[35409]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:56:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:23 smithi115 ceph-mon[34719]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:56:25.068 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:25.068 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:25.068 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:25.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:25.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:25.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:25.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:25.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:25.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:26 smithi059 ceph-mon[30978]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:26.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:26 smithi181 ceph-mon[35409]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:26 smithi115 ceph-mon[34719]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:28.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.414+0000 7f50d5ffb640 1 -- 172.21.15.59:0/3400681105 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f50d8062630 con 0x7f50c80a2bb0 2024-09-10T10:56:28.415 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 6 on host 'smithi059' 2024-09-10T10:56:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.416+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f50c80a2bb0 msgr2=0x7f50c80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.416+0000 7f50decd7640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f50c80a2bb0 0x7f50c80a5070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f50d8102c60 tx=0x7f50cc00a2d0 comp rx=0 tx=0).stop 2024-09-10T10:56:28.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.416+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d8102e00 msgr2=0x7f50d81983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.416+0000 7f50decd7640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d8102e00 0x7f50d81983e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f50c400d770 tx=0x7f50c400dc30 comp rx=0 tx=0).stop 2024-09-10T10:56:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.417+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 shutdown_connections 2024-09-10T10:56:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.417+0000 7f50decd7640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f50c80a2bb0 0x7f50c80a5070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.417+0000 7f50decd7640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50d81037c0 0x7f50d819f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.417+0000 7f50decd7640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50d8102e00 0x7f50d81983e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.417+0000 7f50decd7640 1 --2- 172.21.15.59:0/3400681105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50d8101c00 0x7f50d8197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.417+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 >> 172.21.15.59:0/3400681105 conn(0x7f50d80fd390 msgr2=0x7f50d8106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:56:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.417+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 shutdown_connections 2024-09-10T10:56:28.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:56:28.417+0000 7f50decd7640 1 -- 172.21.15.59:0/3400681105 wait complete. 2024-09-10T10:56:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:28 smithi059 ceph-mon[30978]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:28 smithi181 ceph-mon[35409]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:28.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:28.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:28.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:28.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:28 smithi115 ceph-mon[34719]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:28.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:28.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:28.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:28.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:28.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:29.058 DEBUG:teuthology.orchestra.run.smithi059:osd.6> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T10:56:29.061 INFO:tasks.cephadm:Deploying osd.7 on smithi115 with /dev/vg_nvme/lv_2... 2024-09-10T10:56:29.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T10:56:29.317 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:56:30.602 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:30 smithi059 ceph-mon[30978]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:30.602 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:30 smithi059 ceph-mon[30978]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:56:30.603 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 10:56:30 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T10:56:30.312+0000 7f184a04b640 -1 osd.6 0 log_to_monitors true 2024-09-10T10:56:30.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:30 smithi181 ceph-mon[35409]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:30.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:30 smithi181 ceph-mon[35409]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:56:30.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:30 smithi115 ceph-mon[34719]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:30.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:30 smithi115 ceph-mon[34719]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:56:31.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:31 smithi059 ceph-mon[30978]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T10:56:31.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:31 smithi059 ceph-mon[30978]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T10:56:31.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:31 smithi059 ceph-mon[30978]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:56:31.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:31 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:31.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:31 smithi181 ceph-mon[35409]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T10:56:31.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:31 smithi181 ceph-mon[35409]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T10:56:31.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:31 smithi181 ceph-mon[35409]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:56:31.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:31 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:31.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:31 smithi115 ceph-mon[34719]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T10:56:31.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:31 smithi115 ceph-mon[34719]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T10:56:31.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:31 smithi115 ceph-mon[34719]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:56:31.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:31 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:31.894 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:56:31.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_2 2024-09-10T10:56:31.981 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 10:56:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T10:56:31.830+0000 7f1845fce640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T10:56:31.981 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 10:56:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T10:56:31.839+0000 7f183ddee640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:56:32.178 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:56:32.611 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:32.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.613 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:32.613 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:32.613 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:32 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 -- 172.21.15.115:0/4016134903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4105030 msgr2=0x7f68a4107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/4016134903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4105030 0x7f68a4107420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6894009900 tx=0x7f689402a410 comp rx=0 tx=0).stop 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 -- 172.21.15.115:0/4016134903 shutdown_connections 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/4016134903 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68a4107960 0x7f68a4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/4016134903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4105030 0x7f68a4107420 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/4016134903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68a4102700 0x7f68a4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 -- 172.21.15.115:0/4016134903 >> 172.21.15.115:0/4016134903 conn(0x7f68a40fc280 msgr2=0x7f68a40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 -- 172.21.15.115:0/4016134903 shutdown_connections 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 -- 172.21.15.115:0/4016134903 wait complete. 2024-09-10T10:56:32.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 Processor -- start 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.693+0000 7f68ab5fb640 1 -- start start 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68ab5fb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4102700 0x7f68a4197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68ab5fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68a4105030 0x7f68a4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68ab5fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68a4107960 0x7f68a419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68ab5fb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f68a410d850 con 0x7f68a4105030 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68ab5fb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f68a410d6d0 con 0x7f68a4102700 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68ab5fb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f68a410d9d0 con 0x7f68a4107960 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9397640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4102700 0x7f68a4197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9397640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4102700 0x7f68a4197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34736/0 (socket says 172.21.15.115:34736) 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9397640 1 -- 172.21.15.115:0/200183175 learned_addr learned my addr 172.21.15.115:0/200183175 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9b98640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68a4107960 0x7f68a419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9397640 1 -- 172.21.15.115:0/200183175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68a4107960 msgr2=0x7f68a419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:32.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9397640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68a4107960 0x7f68a419f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9397640 1 -- 172.21.15.115:0/200183175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68a4105030 msgr2=0x7f68a4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9397640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68a4105030 0x7f68a4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9397640 1 -- 172.21.15.115:0/200183175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a419fb60 con 0x7f68a4102700 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68a9397640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4102700 0x7f68a4197f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f68a000e9f0 tx=0x7f68a000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f689a7fc640 1 -- 172.21.15.115:0/200183175 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a000cd80 con 0x7f68a4102700 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a419fe50 con 0x7f68a4102700 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f689a7fc640 1 -- 172.21.15.115:0/200183175 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68a0010910 con 0x7f68a4102700 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f689a7fc640 1 -- 172.21.15.115:0/200183175 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a00188f0 con 0x7f68a4102700 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.694+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a41a0350 con 0x7f68a4102700 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.695+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a40fdd70 con 0x7f68a4102700 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.697+0000 7f689a7fc640 1 -- 172.21.15.115:0/200183175 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f68a0010ac0 con 0x7f68a4102700 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.697+0000 7f689a7fc640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f68900a2bb0 0x7f68900a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:32.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.697+0000 7f689a7fc640 1 -- 172.21.15.115:0/200183175 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4685+0+0 (secure 0 0 0) 0x7f68a00cea30 con 0x7f68a4102700 2024-09-10T10:56:32.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.697+0000 7f68a8b96640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f68900a2bb0 0x7f68900a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:32.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.698+0000 7f68a8b96640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f68900a2bb0 0x7f68900a5070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68940096c0 tx=0x7f6894031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:56:32.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.701+0000 7f689a7fc640 1 -- 172.21.15.115:0/200183175 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68a009c7c0 con 0x7f68a4102700 2024-09-10T10:56:32.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:32.877+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f68a4062630 con 0x7f68900a2bb0 2024-09-10T10:56:32.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:32.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:56:32.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T10:56:32.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:32.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:32.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' 2024-09-10T10:56:32.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:32.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:32.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:32.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:32.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:32.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:32 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334]' entity='osd.6' 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:32.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:32.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:32.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:32.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:32 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi059 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi059 to 5697M 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] boot 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:56:33.565 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:33 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:33.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:56:33.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:56:33.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi059 2024-09-10T10:56:33.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi059 to 5697M 2024-09-10T10:56:33.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:33.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] boot 2024-09-10T10:56:33.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T10:56:33.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:33.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:56:33.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:56:33.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:33 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:33.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:56:33.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:56:33.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi059 2024-09-10T10:56:33.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi059 to 5697M 2024-09-10T10:56:33.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:33.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: osd.6 [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] boot 2024-09-10T10:56:33.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T10:56:33.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:56:33.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:56:33.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:56:33.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:33 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:34.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:34 smithi115 ceph-mon[34719]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:34.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:34 smithi115 ceph-mon[34719]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:56:34.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:34 smithi115 ceph-mon[34719]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T10:56:34.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:34 smithi059 ceph-mon[30978]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:34.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:34 smithi059 ceph-mon[30978]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:56:34.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:34 smithi059 ceph-mon[30978]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T10:56:34.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:34 smithi181 ceph-mon[35409]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:56:34.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:34 smithi181 ceph-mon[35409]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:56:34.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:34 smithi181 ceph-mon[35409]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T10:56:35.672 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:35 smithi115 ceph-mon[34719]: from='client.? 172.21.15.115:0/1035949012' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9149fe7e-5a85-4a89-b5f7-e8724e7a392b"}]: dispatch 2024-09-10T10:56:35.672 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:35 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9149fe7e-5a85-4a89-b5f7-e8724e7a392b"}]: dispatch 2024-09-10T10:56:35.672 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:35 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9149fe7e-5a85-4a89-b5f7-e8724e7a392b"}]': finished 2024-09-10T10:56:35.672 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:35 smithi115 ceph-mon[34719]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T10:56:35.673 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:35 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:35.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:35 smithi059 ceph-mon[30978]: from='client.? 172.21.15.115:0/1035949012' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9149fe7e-5a85-4a89-b5f7-e8724e7a392b"}]: dispatch 2024-09-10T10:56:35.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:35 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9149fe7e-5a85-4a89-b5f7-e8724e7a392b"}]: dispatch 2024-09-10T10:56:35.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:35 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9149fe7e-5a85-4a89-b5f7-e8724e7a392b"}]': finished 2024-09-10T10:56:35.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:35 smithi059 ceph-mon[30978]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T10:56:35.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:35 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:35.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:35 smithi181 ceph-mon[35409]: from='client.? 172.21.15.115:0/1035949012' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9149fe7e-5a85-4a89-b5f7-e8724e7a392b"}]: dispatch 2024-09-10T10:56:35.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:35 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9149fe7e-5a85-4a89-b5f7-e8724e7a392b"}]: dispatch 2024-09-10T10:56:35.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:35 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9149fe7e-5a85-4a89-b5f7-e8724e7a392b"}]': finished 2024-09-10T10:56:35.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:35 smithi181 ceph-mon[35409]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T10:56:35.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:35 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:36.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:36 smithi115 ceph-mon[34719]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:36.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:36 smithi115 ceph-mon[34719]: from='client.? 172.21.15.115:0/1622041025' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:56:36.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:36 smithi059 ceph-mon[30978]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:36.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:36 smithi059 ceph-mon[30978]: from='client.? 172.21.15.115:0/1622041025' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:56:36.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:36 smithi181 ceph-mon[35409]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:36.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:36 smithi181 ceph-mon[35409]: from='client.? 172.21.15.115:0/1622041025' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:56:38.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:38 smithi115 ceph-mon[34719]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:38.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:38 smithi059 ceph-mon[30978]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:38.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:38 smithi181 ceph-mon[35409]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:40.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:40 smithi115 ceph-mon[34719]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:40.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:40 smithi059 ceph-mon[30978]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:40.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:40 smithi181 ceph-mon[35409]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:42.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:42 smithi115 ceph-mon[34719]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:42.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:42 smithi059 ceph-mon[30978]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:42.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:42 smithi181 ceph-mon[35409]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:44.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:44 smithi115 ceph-mon[34719]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:44.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:44 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T10:56:44.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:44 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:44.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:44 smithi115 ceph-mon[34719]: Deploying daemon osd.7 on smithi115 2024-09-10T10:56:44.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:44 smithi059 ceph-mon[30978]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:44.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:44 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T10:56:44.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:44 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:44.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:44 smithi059 ceph-mon[30978]: Deploying daemon osd.7 on smithi115 2024-09-10T10:56:44.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:44 smithi181 ceph-mon[35409]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:44.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:44 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T10:56:44.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:44 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:44.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:44 smithi181 ceph-mon[35409]: Deploying daemon osd.7 on smithi115 2024-09-10T10:56:46.602 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:46 smithi115 ceph-mon[34719]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:46.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:46 smithi059 ceph-mon[30978]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:46.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:46 smithi181 ceph-mon[35409]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:48.548 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:48 smithi115 ceph-mon[34719]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:48.738 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:48 smithi181 ceph-mon[35409]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:48.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:48 smithi059 ceph-mon[30978]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:50.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:50 smithi115 ceph-mon[34719]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:50.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:50.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:50.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:50.733 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:50 smithi181 ceph-mon[35409]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:50.733 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:50.733 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:50.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:50.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:50 smithi059 ceph-mon[30978]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:50.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:50.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:50.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:52.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:52 smithi115 ceph-mon[34719]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:52.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:52.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:52.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:52.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:52.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:52.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.752+0000 7f689a7fc640 1 -- 172.21.15.115:0/200183175 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f68a4062630 con 0x7f68900a2bb0 2024-09-10T10:56:52.754 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 7 on host 'smithi115' 2024-09-10T10:56:52.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f68900a2bb0 msgr2=0x7f68900a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f68900a2bb0 0x7f68900a5070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68940096c0 tx=0x7f6894031400 comp rx=0 tx=0).stop 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4102700 msgr2=0x7f68a4197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4102700 0x7f68a4197f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f68a000e9f0 tx=0x7f68a000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 shutdown_connections 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f68900a2bb0 0x7f68900a5070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68a4107960 0x7f68a419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68a4105030 0x7f68a4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 --2- 172.21.15.115:0/200183175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68a4102700 0x7f68a4197f30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 >> 172.21.15.115:0/200183175 conn(0x7f68a40fc280 msgr2=0x7f68a4102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 shutdown_connections 2024-09-10T10:56:52.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:56:52.754+0000 7f68ab5fb640 1 -- 172.21.15.115:0/200183175 wait complete. 2024-09-10T10:56:52.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:52 smithi059 ceph-mon[30978]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:52.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:52.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:52.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:52.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:52.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:52.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:52 smithi181 ceph-mon[35409]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:52.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:52.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:52.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:52.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:52.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:53.443 DEBUG:teuthology.orchestra.run.smithi115:osd.7> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T10:56:53.445 INFO:tasks.cephadm:Deploying osd.8 on smithi181 with /dev/vg_nvme/lv_2... 2024-09-10T10:56:53.446 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T10:56:53.699 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:56:53.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:53.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:53.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:53.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:53.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:53.820 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:53.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:56:53.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:53.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:54.582 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:54 smithi115 ceph-mon[34719]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:54.842 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:54 smithi181 ceph-mon[35409]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:54.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:54 smithi059 ceph-mon[30978]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:55.602 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:55 smithi115 ceph-mon[34719]: from='osd.7 [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:56:55.602 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:55 smithi115 ceph-mon[34719]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:56:55.602 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 10:56:55 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T10:56:55.257+0000 7f30e68fc640 -1 osd.7 0 log_to_monitors true 2024-09-10T10:56:55.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:55 smithi181 ceph-mon[35409]: from='osd.7 [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:56:55.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:55 smithi181 ceph-mon[35409]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:56:55.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:55 smithi059 ceph-mon[30978]: from='osd.7 [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:56:55.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:55 smithi059 ceph-mon[30978]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:56:56.390 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:56:56.414 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi181:vg_nvme/lv_2 2024-09-10T10:56:56.661 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:56:56.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:56.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T10:56:56.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='osd.7 [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T10:56:56.500+0000 7f30e287f640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T10:56:56.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T10:56:56.513+0000 7f30de6a7640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:56:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T10:56:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='osd.7 [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:56.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='osd.7 [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:56.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:56.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:56:56.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:56.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:56.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:56:56.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:56:57.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 -- 172.21.15.181:0/3854170392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118102690 msgr2=0x7f9118108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:57.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 --2- 172.21.15.181:0/3854170392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118102690 0x7f9118108f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9110009ca0 tx=0x7f911002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:56:57.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 -- 172.21.15.181:0/3854170392 shutdown_connections 2024-09-10T10:56:57.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 --2- 172.21.15.181:0/3854170392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118102690 0x7f9118108f20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:57.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 --2- 172.21.15.181:0/3854170392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9118101cd0 0x7f9118102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:57.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 --2- 172.21.15.181:0/3854170392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118100ad0 0x7f9118100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:57.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 -- 172.21.15.181:0/3854170392 >> 172.21.15.181:0/3854170392 conn(0x7f91180fc280 msgr2=0x7f91180fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:56:57.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 -- 172.21.15.181:0/3854170392 shutdown_connections 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 -- 172.21.15.181:0/3854170392 wait complete. 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.154+0000 7f911ca98640 1 Processor -- start 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911ca98640 1 -- start start 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911ca98640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118100ad0 0x7f9118196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911ca98640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9118101cd0 0x7f91181971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911ca98640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118102690 0x7f911819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911ca98640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f911810c730 con 0x7f9118101cd0 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911ca98640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f911810c5b0 con 0x7f9118102690 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911ca98640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f911810c8b0 con 0x7f9118100ad0 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118100ad0 0x7f9118196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118100ad0 0x7f9118196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:40056/0 (socket says 172.21.15.181:40056) 2024-09-10T10:56:57.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911659c640 1 -- 172.21.15.181:0/1234591685 learned_addr learned my addr 172.21.15.181:0/1234591685 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f9115d9b640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9118101cd0 0x7f91181971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f9116d9d640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118102690 0x7f911819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911659c640 1 -- 172.21.15.181:0/1234591685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118102690 msgr2=0x7f911819e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911659c640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118102690 0x7f911819e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911659c640 1 -- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9118101cd0 msgr2=0x7f91181971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911659c640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9118101cd0 0x7f91181971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911659c640 1 -- 172.21.15.181:0/1234591685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911819e880 con 0x7f9118100ad0 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f9115d9b640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9118101cd0 0x7f91181971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911659c640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118100ad0 0x7f9118196c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f910800c970 tx=0x7f910800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f91077fe640 1 -- 172.21.15.181:0/1234591685 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108007c10 con 0x7f9118100ad0 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f91077fe640 1 -- 172.21.15.181:0/1234591685 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9108007db0 con 0x7f9118100ad0 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f911819eb70 con 0x7f9118100ad0 2024-09-10T10:56:57.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.155+0000 7f91077fe640 1 -- 172.21.15.181:0/1234591685 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910800f940 con 0x7f9118100ad0 2024-09-10T10:56:57.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.156+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f911819f0b0 con 0x7f9118100ad0 2024-09-10T10:56:57.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.157+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9118107e00 con 0x7f9118100ad0 2024-09-10T10:56:57.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.158+0000 7f91077fe640 1 -- 172.21.15.181:0/1234591685 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f910800fae0 con 0x7f9118100ad0 2024-09-10T10:56:57.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.158+0000 7f91077fe640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f91000a2b80 0x7f91000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:56:57.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.158+0000 7f91077fe640 1 -- 172.21.15.181:0/1234591685 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5117+0+0 (secure 0 0 0) 0x7f91080ceb20 con 0x7f9118100ad0 2024-09-10T10:56:57.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.158+0000 7f9115d9b640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f91000a2b80 0x7f91000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:56:57.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.159+0000 7f9115d9b640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f91000a2b80 0x7f91000a5040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f910c00abe0 tx=0x7f910c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:56:57.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.161+0000 7f91077fe640 1 -- 172.21.15.181:0/1234591685 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f910809c820 con 0x7f9118100ad0 2024-09-10T10:56:57.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:56:57.335+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9118062630 con 0x7f91000a2b80 2024-09-10T10:56:57.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:57 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi115 2024-09-10T10:56:57.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:57 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi115 to 5696M 2024-09-10T10:56:57.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:57 smithi181 ceph-mon[35409]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:56:57.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:57 smithi181 ceph-mon[35409]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T10:56:57.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:57.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:57.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:56:57.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:56:57.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:57 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:57.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:57 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi115 2024-09-10T10:56:57.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:57 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi115 to 5696M 2024-09-10T10:56:57.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:57 smithi059 ceph-mon[30978]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:56:57.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:57 smithi059 ceph-mon[30978]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T10:56:57.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:57.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:57.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:56:57.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:56:57.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:57 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:57.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:57 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi115 2024-09-10T10:56:57.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:57 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi115 to 5696M 2024-09-10T10:56:57.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:57 smithi115 ceph-mon[34719]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:56:57.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:57 smithi115 ceph-mon[34719]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T10:56:57.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:57 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:57.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:57 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:57.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:57 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:56:57.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:57 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:56:57.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:57 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:56:58.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:58 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:56:58.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:58 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:56:58.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:58 smithi059 ceph-mon[30978]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:58.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:58 smithi059 ceph-mon[30978]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:56:58.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:58 smithi059 ceph-mon[30978]: osd.7 [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] boot 2024-09-10T10:56:58.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:58 smithi059 ceph-mon[30978]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T10:56:58.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:58 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:58.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:56:58 smithi059 ceph-mon[30978]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T10:56:58.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:58 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:56:58.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:58 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:56:58.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:58 smithi181 ceph-mon[35409]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:58.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:58 smithi181 ceph-mon[35409]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:56:58.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:58 smithi181 ceph-mon[35409]: osd.7 [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] boot 2024-09-10T10:56:58.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:58 smithi181 ceph-mon[35409]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T10:56:58.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:58 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:58.916 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:56:58 smithi181 ceph-mon[35409]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T10:56:58.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:58 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:56:58.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:58 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:56:58.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:58 smithi115 ceph-mon[34719]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:56:58.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:58 smithi115 ceph-mon[34719]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:56:58.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:58 smithi115 ceph-mon[34719]: osd.7 [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] boot 2024-09-10T10:56:58.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:58 smithi115 ceph-mon[34719]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T10:56:58.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:58 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:56:58.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:56:58 smithi115 ceph-mon[34719]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T10:57:00.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:00 smithi181 ceph-mon[35409]: pgmap v170: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:00.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:00 smithi181 ceph-mon[35409]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T10:57:00.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:00 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/1230366639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4860b6b-96d8-4cae-9ee5-53b84fc6be7c"}]: dispatch 2024-09-10T10:57:00.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:00 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4860b6b-96d8-4cae-9ee5-53b84fc6be7c"}]: dispatch 2024-09-10T10:57:00.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:00 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4860b6b-96d8-4cae-9ee5-53b84fc6be7c"}]': finished 2024-09-10T10:57:00.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:00 smithi181 ceph-mon[35409]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T10:57:00.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:00 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:00.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:00 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/2908213662' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:57:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:00 smithi059 ceph-mon[30978]: pgmap v170: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:00 smithi059 ceph-mon[30978]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T10:57:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:00 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/1230366639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4860b6b-96d8-4cae-9ee5-53b84fc6be7c"}]: dispatch 2024-09-10T10:57:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:00 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4860b6b-96d8-4cae-9ee5-53b84fc6be7c"}]: dispatch 2024-09-10T10:57:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:00 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4860b6b-96d8-4cae-9ee5-53b84fc6be7c"}]': finished 2024-09-10T10:57:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:00 smithi059 ceph-mon[30978]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T10:57:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:00 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:00 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/2908213662' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:57:00.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:00 smithi115 ceph-mon[34719]: pgmap v170: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:00.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:00 smithi115 ceph-mon[34719]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T10:57:00.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:00 smithi115 ceph-mon[34719]: from='client.? 172.21.15.181:0/1230366639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4860b6b-96d8-4cae-9ee5-53b84fc6be7c"}]: dispatch 2024-09-10T10:57:00.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:00 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4860b6b-96d8-4cae-9ee5-53b84fc6be7c"}]: dispatch 2024-09-10T10:57:00.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:00 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4860b6b-96d8-4cae-9ee5-53b84fc6be7c"}]': finished 2024-09-10T10:57:00.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:00 smithi115 ceph-mon[34719]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T10:57:00.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:00 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:00.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:00 smithi115 ceph-mon[34719]: from='client.? 172.21.15.181:0/2908213662' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:57:02.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:01 smithi059 ceph-mon[30978]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:02.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:01 smithi059 ceph-mon[30978]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T10:57:02.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:01 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:01 smithi181 ceph-mon[35409]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:01 smithi181 ceph-mon[35409]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T10:57:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:01 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:01 smithi115 ceph-mon[34719]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:01 smithi115 ceph-mon[34719]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T10:57:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:01 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:04.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:03 smithi059 ceph-mon[30978]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:04.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:03 smithi181 ceph-mon[35409]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:03 smithi115 ceph-mon[34719]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:06.076 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:05 smithi181 ceph-mon[35409]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:06.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:05 smithi059 ceph-mon[30978]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:05 smithi115 ceph-mon[34719]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:08.096 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:07 smithi181 ceph-mon[35409]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:08.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:07 smithi059 ceph-mon[30978]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:07 smithi115 ceph-mon[34719]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:08.857 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T10:57:08.857 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:08.857 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:08 smithi181 ceph-mon[35409]: Deploying daemon osd.8 on smithi181 2024-09-10T10:57:09.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T10:57:09.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:09.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:08 smithi059 ceph-mon[30978]: Deploying daemon osd.8 on smithi181 2024-09-10T10:57:09.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T10:57:09.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:09.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:08 smithi115 ceph-mon[34719]: Deploying daemon osd.8 on smithi181 2024-09-10T10:57:09.931 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:09 smithi181 ceph-mon[35409]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:10.039 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:09 smithi059 ceph-mon[30978]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:09 smithi115 ceph-mon[34719]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:11.889 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:11 smithi181 ceph-mon[35409]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:12.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:11 smithi059 ceph-mon[30978]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:11 smithi115 ceph-mon[34719]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:13.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:13 smithi181 ceph-mon[35409]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:14.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:13 smithi059 ceph-mon[30978]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:13 smithi115 ceph-mon[34719]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:14.888 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:14 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:14.888 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:14 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:14.888 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:14 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:15.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:14 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:15.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:14 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:15.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:14 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:15.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:14 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:15.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:14 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:15.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:14 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:16.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:16 smithi115 ceph-mon[34719]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:16.479 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:16 smithi181 ceph-mon[35409]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:16.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:16 smithi059 ceph-mon[30978]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:17.490 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 8 on host 'smithi181' 2024-09-10T10:57:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.488+0000 7f91077fe640 1 -- 172.21.15.181:0/1234591685 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9118062630 con 0x7f91000a2b80 2024-09-10T10:57:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f91000a2b80 msgr2=0x7f91000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f91000a2b80 0x7f91000a5040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f910c00abe0 tx=0x7f910c00a5c0 comp rx=0 tx=0).stop 2024-09-10T10:57:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118100ad0 msgr2=0x7f9118196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118100ad0 0x7f9118196c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f910800c970 tx=0x7f910800ce30 comp rx=0 tx=0).stop 2024-09-10T10:57:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 shutdown_connections 2024-09-10T10:57:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f91000a2b80 0x7f91000a5040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9118102690 0x7f911819e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9118101cd0 0x7f91181971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 --2- 172.21.15.181:0/1234591685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9118100ad0 0x7f9118196c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 >> 172.21.15.181:0/1234591685 conn(0x7f91180fc280 msgr2=0x7f9118104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:57:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 shutdown_connections 2024-09-10T10:57:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:57:17.491+0000 7f911ca98640 1 -- 172.21.15.181:0/1234591685 wait complete. 2024-09-10T10:57:18.290 DEBUG:teuthology.orchestra.run.smithi181:osd.8> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T10:57:18.293 INFO:tasks.cephadm:Deploying osd.9 on smithi059 with /dev/vg_nvme/lv_1... 2024-09-10T10:57:18.293 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T10:57:18.528 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:18 smithi181 ceph-mon[35409]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:18.528 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.528 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.529 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.529 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.560 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:57:18.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:18 smithi059 ceph-mon[30978]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:18.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:18 smithi115 ceph-mon[34719]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:18.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:18.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:20.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:20 smithi181 ceph-mon[35409]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:20.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:20 smithi181 ceph-mon[35409]: from='osd.8 [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:57:20.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:20 smithi181 ceph-mon[35409]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:57:20.687 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 10:57:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T10:57:20.302+0000 7f39598a6640 -1 osd.8 0 log_to_monitors true 2024-09-10T10:57:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:20 smithi059 ceph-mon[30978]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:20 smithi059 ceph-mon[30978]: from='osd.8 [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:57:20.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:20 smithi059 ceph-mon[30978]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:57:20.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:20 smithi115 ceph-mon[34719]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:20.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:20 smithi115 ceph-mon[34719]: from='osd.8 [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:57:20.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:20 smithi115 ceph-mon[34719]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:57:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:57:21.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_1 2024-09-10T10:57:21.605 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:57:21.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T10:57:21.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T10:57:21.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:21.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='osd.8 [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:57:21.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:57:21.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:21.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:21.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:21.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:21.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:21.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:21.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:21.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:21.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:21 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.936 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T10:57:21.495+0000 7f3955829640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T10:57:21.937 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T10:57:21.503+0000 7f3951651640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:57:21.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T10:57:21.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T10:57:21.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:21.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='osd.8 [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:57:21.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:57:21.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:21.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:21.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:21.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:21.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:21.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:21.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:21.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:21.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:21 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T10:57:21.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T10:57:21.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='osd.8 [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:21.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:21.960 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:21 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:22.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.150+0000 7fa951407640 1 -- 172.21.15.59:0/3565193858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 msgr2=0x7fa94c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.150+0000 7fa951407640 1 --2- 172.21.15.59:0/3565193858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 0x7fa94c102190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa934009900 tx=0x7fa93402a410 comp rx=0 tx=0).stop 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.150+0000 7fa951407640 1 -- 172.21.15.59:0/3565193858 shutdown_connections 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.150+0000 7fa951407640 1 --2- 172.21.15.59:0/3565193858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94c1026d0 0x7fa94c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.150+0000 7fa951407640 1 --2- 172.21.15.59:0/3565193858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 0x7fa94c102190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.150+0000 7fa951407640 1 --2- 172.21.15.59:0/3565193858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa94c100b10 0x7fa94c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.150+0000 7fa951407640 1 -- 172.21.15.59:0/3565193858 >> 172.21.15.59:0/3565193858 conn(0x7fa94c0fc2a0 msgr2=0x7fa94c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.150+0000 7fa951407640 1 -- 172.21.15.59:0/3565193858 shutdown_connections 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.150+0000 7fa951407640 1 -- 172.21.15.59:0/3565193858 wait complete. 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa951407640 1 Processor -- start 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa951407640 1 -- start start 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa951407640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa94c100b10 0x7fa94c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:57:22.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa951407640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 0x7fa94c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa951407640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94c1026d0 0x7fa94c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa951407640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c10d8c0 con 0x7fa94c101d10 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa951407640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c10d740 con 0x7fa94c100b10 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa951407640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c10da40 con 0x7fa94c1026d0 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa943fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 0x7fa94c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa943fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 0x7fa94c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46300/0 (socket says 172.21.15.59:46300) 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa94affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa94c100b10 0x7fa94c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa943fff640 1 -- 172.21.15.59:0/1587897198 learned_addr learned my addr 172.21.15.59:0/1587897198 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa94b7fe640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94c1026d0 0x7fa94c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa943fff640 1 -- 172.21.15.59:0/1587897198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94c1026d0 msgr2=0x7fa94c19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa943fff640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94c1026d0 0x7fa94c19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:22.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa943fff640 1 -- 172.21.15.59:0/1587897198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa94c100b10 msgr2=0x7fa94c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.151+0000 7fa943fff640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa94c100b10 0x7fa94c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.152+0000 7fa943fff640 1 -- 172.21.15.59:0/1587897198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94c19fb10 con 0x7fa94c101d10 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.152+0000 7fa94affd640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa94c100b10 0x7fa94c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.152+0000 7fa943fff640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 0x7fa94c198420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa934009230 tx=0x7fa934031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.152+0000 7fa948ff9640 1 -- 172.21.15.59:0/1587897198 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93403f030 con 0x7fa94c101d10 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.152+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94c19fda0 con 0x7fa94c101d10 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.152+0000 7fa948ff9640 1 -- 172.21.15.59:0/1587897198 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa934003ad0 con 0x7fa94c101d10 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.152+0000 7fa948ff9640 1 -- 172.21.15.59:0/1587897198 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934035070 con 0x7fa94c101d10 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.152+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa94c1a0220 con 0x7fa94c101d10 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.153+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94c107eb0 con 0x7fa94c101d10 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.154+0000 7fa948ff9640 1 -- 172.21.15.59:0/1587897198 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa934042030 con 0x7fa94c101d10 2024-09-10T10:57:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.155+0000 7fa948ff9640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa9380a2bb0 0x7fa9380a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:57:22.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.155+0000 7fa94affd640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa9380a2bb0 0x7fa9380a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:57:22.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.155+0000 7fa948ff9640 1 -- 172.21.15.59:0/1587897198 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5549+0+0 (secure 0 0 0) 0x7fa9340eeaf0 con 0x7fa94c101d10 2024-09-10T10:57:22.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.155+0000 7fa94affd640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa9380a2bb0 0x7fa9380a5070 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa94c101b70 tx=0x7fa93c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:57:22.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.160+0000 7fa948ff9640 1 -- 172.21.15.59:0/1587897198 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa9340bbe30 con 0x7fa94c101d10 2024-09-10T10:57:22.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:22.344+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa94c062630 con 0x7fa9380a2bb0 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi181 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi181 to 5696M 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:57:22.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:22.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:22.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi181 2024-09-10T10:57:22.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi181 to 5696M 2024-09-10T10:57:22.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:57:22.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T10:57:22.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:22.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:22.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:57:22.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:57:22.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:22.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:22.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi181 2024-09-10T10:57:22.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi181 to 5696M 2024-09-10T10:57:22.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:57:22.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T10:57:22.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:22.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:22.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:57:22.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:57:22.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:23.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:23 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:57:23.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:23 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:57:23.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:23 smithi059 ceph-mon[30978]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:57:23.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:23 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:23.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:23 smithi059 ceph-mon[30978]: osd.8 [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] boot 2024-09-10T10:57:23.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:23 smithi059 ceph-mon[30978]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T10:57:23.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:23 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:23.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:23 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:57:23.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:23 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:57:23.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:23 smithi181 ceph-mon[35409]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:57:23.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:23 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:23.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:23 smithi181 ceph-mon[35409]: osd.8 [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] boot 2024-09-10T10:57:23.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:23 smithi181 ceph-mon[35409]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T10:57:23.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:23 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:23.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:23 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:57:23.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:23 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:57:23.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:23 smithi115 ceph-mon[34719]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:57:23.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:23 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:23.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:23 smithi115 ceph-mon[34719]: osd.8 [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] boot 2024-09-10T10:57:23.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:23 smithi115 ceph-mon[34719]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T10:57:23.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:23 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:57:24.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:24 smithi059 ceph-mon[30978]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:24.516 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:24 smithi059 ceph-mon[30978]: osdmap e57: 9 total, 9 up, 9 in 2024-09-10T10:57:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:24 smithi181 ceph-mon[35409]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:24 smithi181 ceph-mon[35409]: osdmap e57: 9 total, 9 up, 9 in 2024-09-10T10:57:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:24 smithi115 ceph-mon[34719]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:57:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:24 smithi115 ceph-mon[34719]: osdmap e57: 9 total, 9 up, 9 in 2024-09-10T10:57:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:25 smithi059 ceph-mon[30978]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T10:57:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:25 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1793343982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a48ed7c2-30e4-479c-a001-2da89d462ccc"}]: dispatch 2024-09-10T10:57:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:25 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1793343982' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a48ed7c2-30e4-479c-a001-2da89d462ccc"}]': finished 2024-09-10T10:57:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:25 smithi059 ceph-mon[30978]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T10:57:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:25 smithi181 ceph-mon[35409]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T10:57:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:25 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1793343982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a48ed7c2-30e4-479c-a001-2da89d462ccc"}]: dispatch 2024-09-10T10:57:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:25 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1793343982' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a48ed7c2-30e4-479c-a001-2da89d462ccc"}]': finished 2024-09-10T10:57:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:25 smithi181 ceph-mon[35409]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T10:57:25.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:25 smithi115 ceph-mon[34719]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T10:57:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:25 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1793343982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a48ed7c2-30e4-479c-a001-2da89d462ccc"}]: dispatch 2024-09-10T10:57:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:25 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1793343982' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a48ed7c2-30e4-479c-a001-2da89d462ccc"}]': finished 2024-09-10T10:57:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:25 smithi115 ceph-mon[34719]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T10:57:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:25 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:26 smithi059 ceph-mon[30978]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:26 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2583131967' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:57:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:26 smithi059 ceph-mon[30978]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T10:57:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:26 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:26.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:26 smithi181 ceph-mon[35409]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:26.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:26 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2583131967' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:57:26.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:26 smithi181 ceph-mon[35409]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T10:57:26.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:26 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:26 smithi115 ceph-mon[34719]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:26 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2583131967' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:57:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:26 smithi115 ceph-mon[34719]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T10:57:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:26 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:28.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:28 smithi059 ceph-mon[30978]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:28.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:28 smithi181 ceph-mon[35409]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:28.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:28 smithi115 ceph-mon[34719]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:30.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:30 smithi181 ceph-mon[35409]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-10T10:57:30.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:30 smithi059 ceph-mon[30978]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-10T10:57:30.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:30 smithi115 ceph-mon[34719]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-10T10:57:32.705 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:32 smithi059 ceph-mon[30978]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T10:57:32.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:32 smithi181 ceph-mon[35409]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T10:57:32.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:32 smithi115 ceph-mon[34719]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T10:57:34.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:34 smithi059 ceph-mon[30978]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:57:34.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:34 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T10:57:34.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:34 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:34.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:34 smithi181 ceph-mon[35409]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:57:34.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:34 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T10:57:34.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:34 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:34.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:34 smithi115 ceph-mon[34719]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:57:34.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:34 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T10:57:34.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:34 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:35.739 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:35 smithi059 ceph-mon[30978]: Deploying daemon osd.9 on smithi059 2024-09-10T10:57:35.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:35 smithi181 ceph-mon[35409]: Deploying daemon osd.9 on smithi059 2024-09-10T10:57:35.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:35 smithi115 ceph-mon[34719]: Deploying daemon osd.9 on smithi059 2024-09-10T10:57:36.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:36 smithi059 ceph-mon[30978]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T10:57:36.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:36 smithi181 ceph-mon[35409]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T10:57:36.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:36 smithi115 ceph-mon[34719]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T10:57:38.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:38 smithi059 ceph-mon[30978]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T10:57:38.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:38 smithi181 ceph-mon[35409]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T10:57:38.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:38 smithi115 ceph-mon[34719]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T10:57:40.622 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:40 smithi059 ceph-mon[30978]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:57:40.622 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:40.622 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:40.622 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:40.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:40 smithi181 ceph-mon[35409]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:57:40.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:40.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:40.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:40.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:40 smithi115 ceph-mon[34719]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:57:40.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:40.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:40.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:42.709 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:42 smithi059 ceph-mon[30978]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:42.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:42 smithi181 ceph-mon[35409]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:42.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:42 smithi115 ceph-mon[34719]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.450+0000 7fa948ff9640 1 -- 172.21.15.59:0/1587897198 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa94c062630 con 0x7fa9380a2bb0 2024-09-10T10:57:43.451 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 9 on host 'smithi059' 2024-09-10T10:57:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa9380a2bb0 msgr2=0x7fa9380a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa9380a2bb0 0x7fa9380a5070 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa94c101b70 tx=0x7fa93c005f90 comp rx=0 tx=0).stop 2024-09-10T10:57:43.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 msgr2=0x7fa94c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 0x7fa94c198420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa934009230 tx=0x7fa934031b60 comp rx=0 tx=0).stop 2024-09-10T10:57:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 shutdown_connections 2024-09-10T10:57:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa9380a2bb0 0x7fa9380a5070 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa94c1026d0 0x7fa94c19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa94c101d10 0x7fa94c198420 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 --2- 172.21.15.59:0/1587897198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa94c100b10 0x7fa94c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.453+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 >> 172.21.15.59:0/1587897198 conn(0x7fa94c0fc2a0 msgr2=0x7fa94c105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:57:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.454+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 shutdown_connections 2024-09-10T10:57:43.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:57:43.454+0000 7fa951407640 1 -- 172.21.15.59:0/1587897198 wait complete. 2024-09-10T10:57:43.815 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.816 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.816 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:43.816 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:43.816 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.816 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:43.816 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.816 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:43 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:43.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:43.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:43.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:43 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:43.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:43.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:57:43.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:43.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:43 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:44.145 DEBUG:teuthology.orchestra.run.smithi059:osd.9> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T10:57:44.148 INFO:tasks.cephadm:Deploying osd.10 on smithi115 with /dev/vg_nvme/lv_1... 2024-09-10T10:57:44.148 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T10:57:44.404 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:57:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:44 smithi115 ceph-mon[34719]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:44.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:44 smithi059 ceph-mon[30978]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:44.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:44 smithi181 ceph-mon[35409]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:45.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 10:57:45 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T10:57:45.486+0000 7f68935c7640 -1 osd.9 0 log_to_monitors true 2024-09-10T10:57:45.809 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:45 smithi115 ceph-mon[34719]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:57:45.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:45 smithi181 ceph-mon[35409]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:57:45.961 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:45 smithi059 ceph-mon[30978]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:57:46.909 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:46 smithi115 ceph-mon[34719]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:46.909 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:46 smithi115 ceph-mon[34719]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T10:57:46.909 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:46 smithi115 ceph-mon[34719]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T10:57:46.909 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:46 smithi115 ceph-mon[34719]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:57:46.909 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:46 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-10T10:57:46.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:46 smithi181 ceph-mon[35409]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:46.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:46 smithi181 ceph-mon[35409]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T10:57:46.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:46 smithi181 ceph-mon[35409]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T10:57:46.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:46 smithi181 ceph-mon[35409]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:57:46.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:46 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:46.938 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_1 2024-09-10T10:57:47.050 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:46 smithi059 ceph-mon[30978]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:47.050 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:46 smithi059 ceph-mon[30978]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T10:57:47.050 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:46 smithi059 ceph-mon[30978]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T10:57:47.050 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:46 smithi059 ceph-mon[30978]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-10T10:57:47.050 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:46 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:47.050 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 10:57:46 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T10:57:46.655+0000 7f688f54a640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T10:57:47.050 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 10:57:46 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T10:57:46.665+0000 7f688b372640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:57:47.193 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:57:47.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 -- 172.21.15.115:0/2837823651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 msgr2=0x7f7ecc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/2837823651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 0x7f7ecc100ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009900 tx=0x7f7ebc02a410 comp rx=0 tx=0).stop 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 -- 172.21.15.115:0/2837823651 shutdown_connections 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/2837823651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ecc102690 0x7f7ecc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/2837823651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc101cd0 0x7f7ecc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/2837823651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 0x7f7ecc100ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 -- 172.21.15.115:0/2837823651 >> 172.21.15.115:0/2837823651 conn(0x7f7ecc0fc280 msgr2=0x7f7ecc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 -- 172.21.15.115:0/2837823651 shutdown_connections 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 -- 172.21.15.115:0/2837823651 wait complete. 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.714+0000 7f7ed1db1640 1 Processor -- start 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ed1db1640 1 -- start start 2024-09-10T10:57:47.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ed1db1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 0x7f7ecc1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ed1db1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc101cd0 0x7f7ecc198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ed1db1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ecc102690 0x7f7ecc19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ed1db1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc10c830 con 0x7f7ecc101cd0 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ed1db1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc10c6b0 con 0x7f7ecc100ad0 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ed1db1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc10c9b0 con 0x7f7ecc102690 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 0x7f7ecc1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 0x7f7ecc1980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35920/0 (socket says 172.21.15.115:35920) 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecb7fe640 1 -- 172.21.15.115:0/1364360547 learned_addr learned my addr 172.21.15.115:0/1364360547 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecbfff640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ecc102690 0x7f7ecc19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ec3fff640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc101cd0 0x7f7ecc198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecb7fe640 1 -- 172.21.15.115:0/1364360547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ecc102690 msgr2=0x7f7ecc19f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:47.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecb7fe640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ecc102690 0x7f7ecc19f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecb7fe640 1 -- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc101cd0 msgr2=0x7f7ecc198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecb7fe640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc101cd0 0x7f7ecc198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecb7fe640 1 -- 172.21.15.115:0/1364360547 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc19fd10 con 0x7f7ecc100ad0 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ec3fff640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc101cd0 0x7f7ecc198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ecb7fe640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 0x7f7ecc1980e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc031610 tx=0x7f7ebc0043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ec97fa640 1 -- 172.21.15.115:0/1364360547 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc03f030 con 0x7f7ecc100ad0 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ec97fa640 1 -- 172.21.15.115:0/1364360547 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ebc003ce0 con 0x7f7ecc100ad0 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ecc19ffa0 con 0x7f7ecc100ad0 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.715+0000 7f7ec97fa640 1 -- 172.21.15.115:0/1364360547 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc035070 con 0x7f7ecc100ad0 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.716+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ecc1a0470 con 0x7f7ecc100ad0 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.717+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ecc1a06a0 con 0x7f7ecc100ad0 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.718+0000 7f7ec97fa640 1 -- 172.21.15.115:0/1364360547 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7ebc042030 con 0x7f7ecc100ad0 2024-09-10T10:57:47.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.718+0000 7f7ec97fa640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7eb80a2c30 0x7f7eb80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:57:47.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.718+0000 7f7ec97fa640 1 -- 172.21.15.115:0/1364360547 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6261+0+0 (secure 0 0 0) 0x7f7ebc0ef1c0 con 0x7f7ecc100ad0 2024-09-10T10:57:47.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.718+0000 7f7ec3fff640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7eb80a2c30 0x7f7eb80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:57:47.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.719+0000 7f7ec3fff640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7eb80a2c30 0x7f7eb80a50f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4006fd0 tx=0x7f7eb4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:57:47.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.722+0000 7f7ec97fa640 1 -- 172.21.15.115:0/1364360547 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ebc0bc880 con 0x7f7ecc100ad0 2024-09-10T10:57:47.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:57:47.896+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7ecc06a730 con 0x7f7eb80a2c30 2024-09-10T10:57:47.897 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:47.898 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:47.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:57:47.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T10:57:47.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:47.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:47.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:57:48.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:48.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:48.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:57:48.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:57:48.919 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:57:48.919 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:57:48.919 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:48.919 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi059 2024-09-10T10:57:48.920 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi059 to 4273M 2024-09-10T10:57:48.920 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] boot 2024-09-10T10:57:48.920 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T10:57:48.920 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:48.920 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:57:48.920 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:57:48.920 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:57:48.920 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:48 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:48.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:57:48.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:57:48.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:48.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi059 2024-09-10T10:57:48.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi059 to 4273M 2024-09-10T10:57:48.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] boot 2024-09-10T10:57:48.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T10:57:48.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:48.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:57:48.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:57:48.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:57:48.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:48 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:49.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:57:49.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:57:49.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:57:49.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi059 2024-09-10T10:57:49.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi059 to 4273M 2024-09-10T10:57:49.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: osd.9 [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] boot 2024-09-10T10:57:49.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T10:57:49.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:57:49.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:57:49.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:57:49.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:57:49.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:48 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:49.899 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:49 smithi115 ceph-mon[34719]: osdmap e64: 10 total, 10 up, 10 in 2024-09-10T10:57:49.899 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:49 smithi115 ceph-mon[34719]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:49.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:49 smithi181 ceph-mon[35409]: osdmap e64: 10 total, 10 up, 10 in 2024-09-10T10:57:49.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:49 smithi181 ceph-mon[35409]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:50.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:49 smithi059 ceph-mon[30978]: osdmap e64: 10 total, 10 up, 10 in 2024-09-10T10:57:50.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:49 smithi059 ceph-mon[30978]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:50.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:50 smithi115 ceph-mon[34719]: from='client.? 172.21.15.115:0/1362936359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5553312e-2251-488e-b97a-1d203ecd2403"}]: dispatch 2024-09-10T10:57:50.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:50 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5553312e-2251-488e-b97a-1d203ecd2403"}]: dispatch 2024-09-10T10:57:50.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:50 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5553312e-2251-488e-b97a-1d203ecd2403"}]': finished 2024-09-10T10:57:50.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:50 smithi115 ceph-mon[34719]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T10:57:50.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:57:50.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:50 smithi181 ceph-mon[35409]: from='client.? 172.21.15.115:0/1362936359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5553312e-2251-488e-b97a-1d203ecd2403"}]: dispatch 2024-09-10T10:57:50.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:50 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5553312e-2251-488e-b97a-1d203ecd2403"}]: dispatch 2024-09-10T10:57:50.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:50 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5553312e-2251-488e-b97a-1d203ecd2403"}]': finished 2024-09-10T10:57:50.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:50 smithi181 ceph-mon[35409]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T10:57:50.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:57:51.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:50 smithi059 ceph-mon[30978]: from='client.? 172.21.15.115:0/1362936359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5553312e-2251-488e-b97a-1d203ecd2403"}]: dispatch 2024-09-10T10:57:51.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:50 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5553312e-2251-488e-b97a-1d203ecd2403"}]: dispatch 2024-09-10T10:57:51.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:50 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5553312e-2251-488e-b97a-1d203ecd2403"}]': finished 2024-09-10T10:57:51.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:50 smithi059 ceph-mon[30978]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T10:57:51.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:57:51.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:51 smithi181 ceph-mon[35409]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:51.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:51 smithi181 ceph-mon[35409]: from='client.? 172.21.15.115:0/3984564621' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:57:51.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:51 smithi115 ceph-mon[34719]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:51.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:51 smithi115 ceph-mon[34719]: from='client.? 172.21.15.115:0/3984564621' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:57:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:51 smithi059 ceph-mon[30978]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:51 smithi059 ceph-mon[30978]: from='client.? 172.21.15.115:0/3984564621' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:57:54.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:53 smithi059 ceph-mon[30978]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:54.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:53 smithi181 ceph-mon[35409]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:54.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:53 smithi115 ceph-mon[34719]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:56.021 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:55 smithi115 ceph-mon[34719]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:56.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:55 smithi059 ceph-mon[30978]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:55 smithi181 ceph-mon[35409]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:57.847 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:57 smithi115 ceph-mon[34719]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:57 smithi059 ceph-mon[30978]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:57 smithi181 ceph-mon[35409]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:59.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:59 smithi181 ceph-mon[35409]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:59.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T10:57:59.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:59.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:57:59 smithi181 ceph-mon[35409]: Deploying daemon osd.10 on smithi115 2024-09-10T10:57:59.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:59 smithi115 ceph-mon[34719]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:57:59.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T10:57:59.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:57:59.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:57:59 smithi115 ceph-mon[34719]: Deploying daemon osd.10 on smithi115 2024-09-10T10:58:00.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:59 smithi059 ceph-mon[30978]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:00.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T10:58:00.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:00.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:57:59 smithi059 ceph-mon[30978]: Deploying daemon osd.10 on smithi115 2024-09-10T10:58:01.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:01 smithi115 ceph-mon[34719]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:02.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:01 smithi059 ceph-mon[30978]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:01 smithi181 ceph-mon[35409]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:03.872 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:03 smithi115 ceph-mon[34719]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:04.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:03 smithi059 ceph-mon[30978]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:04.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:03 smithi181 ceph-mon[35409]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:05.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:05 smithi115 ceph-mon[34719]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:05.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:05 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:05.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:05 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:05.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:05 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:06.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:05 smithi059 ceph-mon[30978]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:06.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:05 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:06.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:05 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:06.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:05 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:06.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:05 smithi181 ceph-mon[35409]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:06.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:05 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:06.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:05 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:06.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:05 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.227+0000 7f7ec97fa640 1 -- 172.21.15.115:0/1364360547 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f7ecc06a730 con 0x7f7eb80a2c30 2024-09-10T10:58:08.228 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 10 on host 'smithi115' 2024-09-10T10:58:08.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7eb80a2c30 msgr2=0x7f7eb80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:08.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7eb80a2c30 0x7f7eb80a50f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4006fd0 tx=0x7f7eb4008040 comp rx=0 tx=0).stop 2024-09-10T10:58:08.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 msgr2=0x7f7ecc1980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:08.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 0x7f7ecc1980e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc031610 tx=0x7f7ebc0043b0 comp rx=0 tx=0).stop 2024-09-10T10:58:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 shutdown_connections 2024-09-10T10:58:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7eb80a2c30 0x7f7eb80a50f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ecc102690 0x7f7ecc19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc101cd0 0x7f7ecc198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 --2- 172.21.15.115:0/1364360547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ecc100ad0 0x7f7ecc1980e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 >> 172.21.15.115:0/1364360547 conn(0x7f7ecc0fc280 msgr2=0x7f7ecc06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 shutdown_connections 2024-09-10T10:58:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-10T10:58:08.229+0000 7f7ed1db1640 1 -- 172.21.15.115:0/1364360547 wait complete. 2024-09-10T10:58:08.850 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:08 smithi115 ceph-mon[34719]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:08.850 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.850 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.850 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:08.850 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:08.850 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.850 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:08.851 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.851 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:08 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.876 DEBUG:teuthology.orchestra.run.smithi115:osd.10> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T10:58:08.879 INFO:tasks.cephadm:Deploying osd.11 on smithi181 with /dev/vg_nvme/lv_1... 2024-09-10T10:58:08.879 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T10:58:08.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:08 smithi059 ceph-mon[30978]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:08.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:08.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:08.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:08.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:08 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.906 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:08 smithi181 ceph-mon[35409]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:08.906 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.906 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:08.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:08.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:08.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:08.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:08 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:09.134 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:58:10.804 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:10 smithi181 ceph-mon[35409]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:10.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:10 smithi059 ceph-mon[30978]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:10.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:10 smithi115 ceph-mon[34719]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:11.350 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 10:58:11 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T10:58:11.120+0000 7fdd45764640 -1 osd.10 0 log_to_monitors true 2024-09-10T10:58:11.658 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:11 smithi115 ceph-mon[34719]: from='osd.10 [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:58:11.722 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:11 smithi115 ceph-mon[34719]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:58:11.777 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:11 smithi181 ceph-mon[35409]: from='osd.10 [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:58:11.778 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:11 smithi181 ceph-mon[35409]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:58:11.779 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-10T10:58:11.804 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi181:vg_nvme/lv_1 2024-09-10T10:58:11.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:11 smithi059 ceph-mon[30978]: from='osd.10 [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:58:11.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:11 smithi059 ceph-mon[30978]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:58:12.095 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:58:12.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 -- 172.21.15.181:0/2045546691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 msgr2=0x7f19e0107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:12.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 --2- 172.21.15.181:0/2045546691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 0x7f19e0107380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009900 tx=0x7f19c802a410 comp rx=0 tx=0).stop 2024-09-10T10:58:12.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 -- 172.21.15.181:0/2045546691 shutdown_connections 2024-09-10T10:58:12.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 --2- 172.21.15.181:0/2045546691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e01078c0 0x7f19e0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:12.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 --2- 172.21.15.181:0/2045546691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 0x7f19e0107380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:12.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 --2- 172.21.15.181:0/2045546691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19e0102660 0x7f19e0104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:12.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 -- 172.21.15.181:0/2045546691 >> 172.21.15.181:0/2045546691 conn(0x7f19e00fc280 msgr2=0x7f19e00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:12.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 -- 172.21.15.181:0/2045546691 shutdown_connections 2024-09-10T10:58:12.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 -- 172.21.15.181:0/2045546691 wait complete. 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.613+0000 7f19e5979640 1 Processor -- start 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19e5979640 1 -- start start 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19e5979640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19e0102660 0x7f19e0197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19e5979640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 0x7f19e0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19e5979640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e01078c0 0x7f19e019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19e5979640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f19e010d840 con 0x7f19e01078c0 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19e5979640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f19e010d6c0 con 0x7f19e0102660 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19e5979640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f19e010d9c0 con 0x7f19e0104f90 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19de7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 0x7f19e0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19de7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 0x7f19e0198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:32886/0 (socket says 172.21.15.181:32886) 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19de7fc640 1 -- 172.21.15.181:0/2638831823 learned_addr learned my addr 172.21.15.181:0/2638831823 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19df7fe640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e01078c0 0x7f19e019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:12.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19deffd640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19e0102660 0x7f19e0197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19de7fc640 1 -- 172.21.15.181:0/2638831823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19e0102660 msgr2=0x7f19e0197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19de7fc640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19e0102660 0x7f19e0197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19de7fc640 1 -- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e01078c0 msgr2=0x7f19e019f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19de7fc640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e01078c0 0x7f19e019f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19de7fc640 1 -- 172.21.15.181:0/2638831823 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e019fb50 con 0x7f19e0104f90 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19de7fc640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 0x7f19e0198460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19c8031610 tx=0x7f19c8004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19e4977640 1 -- 172.21.15.181:0/2638831823 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c803f030 con 0x7f19e0104f90 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.614+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e019fde0 con 0x7f19e0104f90 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.615+0000 7f19e4977640 1 -- 172.21.15.181:0/2638831823 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19c8003ad0 con 0x7f19e0104f90 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.615+0000 7f19e4977640 1 -- 172.21.15.181:0/2638831823 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8035070 con 0x7f19e0104f90 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.615+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e01a0240 con 0x7f19e0104f90 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.615+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e00fdd70 con 0x7f19e0104f90 2024-09-10T10:58:12.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.617+0000 7f19e4977640 1 -- 172.21.15.181:0/2638831823 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f19c8042030 con 0x7f19e0104f90 2024-09-10T10:58:12.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.617+0000 7f19e4977640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f19cc0a2bb0 0x7f19cc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:12.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.618+0000 7f19e4977640 1 -- 172.21.15.181:0/2638831823 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6414+0+0 (secure 0 0 0) 0x7f19c80ef140 con 0x7f19e0104f90 2024-09-10T10:58:12.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.618+0000 7f19deffd640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f19cc0a2bb0 0x7f19cc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:12.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.618+0000 7f19deffd640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f19cc0a2bb0 0x7f19cc0a5070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f19d8005fd0 tx=0x7f19d8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:12.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.621+0000 7f19e4977640 1 -- 172.21.15.181:0/2638831823 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19c80bc1c0 con 0x7f19e0104f90 2024-09-10T10:58:12.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:12.795+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f19e0062630 con 0x7f19cc0a2bb0 2024-09-10T10:58:12.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='osd.10 [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.797 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:12.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:12.798 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T10:58:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T10:58:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='osd.10 [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:58:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:58:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:12.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:12.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:12.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T10:58:12.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T10:58:12.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:12.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='osd.10 [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:58:12.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:12.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:13.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T10:58:13.006+0000 7fdd416e7640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T10:58:13.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T10:58:13.018+0000 7fdd39507640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:58:13.869 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi115 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi115 to 4272M 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: from='osd.10 ' entity='osd.10' 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: osd.10 [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] boot 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T10:58:13.870 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi115 2024-09-10T10:58:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi115 to 4272M 2024-09-10T10:58:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:58:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T10:58:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:58:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:58:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:13.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: from='osd.10 ' entity='osd.10' 2024-09-10T10:58:13.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: osd.10 [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] boot 2024-09-10T10:58:13.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T10:58:13.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:13.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi115 2024-09-10T10:58:13.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi115 to 4272M 2024-09-10T10:58:13.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-10T10:58:13.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T10:58:13.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:13.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:13.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:58:13.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:58:13.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:13.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: from='osd.10 ' entity='osd.10' 2024-09-10T10:58:13.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: osd.10 [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] boot 2024-09-10T10:58:13.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T10:58:13.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:58:14.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:14 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:58:14.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:14 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:58:14.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:14 smithi059 ceph-mon[30978]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:14.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:14 smithi059 ceph-mon[30978]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:58:14.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:14 smithi059 ceph-mon[30978]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T10:58:14.900 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:14 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:58:14.900 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:14 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:58:14.900 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:14 smithi181 ceph-mon[35409]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:14.901 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:14 smithi181 ceph-mon[35409]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:58:14.901 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:14 smithi181 ceph-mon[35409]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T10:58:14.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:14 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:58:14.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:14 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:58:14.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:14 smithi115 ceph-mon[34719]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:58:14.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:14 smithi115 ceph-mon[34719]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:58:14.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:14 smithi115 ceph-mon[34719]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T10:58:15.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:15 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/1698926647' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a4c40e-8d21-4145-b284-efb8ba4e8fcc"}]: dispatch 2024-09-10T10:58:15.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:15 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a4c40e-8d21-4145-b284-efb8ba4e8fcc"}]: dispatch 2024-09-10T10:58:15.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:15 smithi181 ceph-mon[35409]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6a4c40e-8d21-4145-b284-efb8ba4e8fcc"}]': finished 2024-09-10T10:58:15.793 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:15 smithi181 ceph-mon[35409]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T10:58:15.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:15 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:15 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/1698926647' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a4c40e-8d21-4145-b284-efb8ba4e8fcc"}]: dispatch 2024-09-10T10:58:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:15 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a4c40e-8d21-4145-b284-efb8ba4e8fcc"}]: dispatch 2024-09-10T10:58:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:15 smithi059 ceph-mon[30978]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6a4c40e-8d21-4145-b284-efb8ba4e8fcc"}]': finished 2024-09-10T10:58:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:15 smithi059 ceph-mon[30978]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T10:58:15.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:15 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:15.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:15 smithi115 ceph-mon[34719]: from='client.? 172.21.15.181:0/1698926647' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a4c40e-8d21-4145-b284-efb8ba4e8fcc"}]: dispatch 2024-09-10T10:58:15.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:15 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c6a4c40e-8d21-4145-b284-efb8ba4e8fcc"}]: dispatch 2024-09-10T10:58:15.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:15 smithi115 ceph-mon[34719]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6a4c40e-8d21-4145-b284-efb8ba4e8fcc"}]': finished 2024-09-10T10:58:15.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:15 smithi115 ceph-mon[34719]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T10:58:15.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:15 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:16.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:16 smithi059 ceph-mon[30978]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:16.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:16 smithi059 ceph-mon[30978]: from='client.? 172.21.15.181:0/1725553030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:58:16.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:16 smithi181 ceph-mon[35409]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:16.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:16 smithi181 ceph-mon[35409]: from='client.? 172.21.15.181:0/1725553030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:58:16.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:16 smithi115 ceph-mon[34719]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:16.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:16 smithi115 ceph-mon[34719]: from='client.? 172.21.15.181:0/1725553030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:58:17.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:17 smithi059 ceph-mon[30978]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T10:58:17.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:17 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:17.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:17 smithi181 ceph-mon[35409]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T10:58:17.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:17 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:17.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:17 smithi115 ceph-mon[34719]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T10:58:17.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:17 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:18.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:18 smithi059 ceph-mon[30978]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:18.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:18 smithi059 ceph-mon[30978]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T10:58:18.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:18 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:18.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:18 smithi181 ceph-mon[35409]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:18.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:18 smithi181 ceph-mon[35409]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T10:58:18.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:18 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:18.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:18 smithi115 ceph-mon[34719]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:18.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:18 smithi115 ceph-mon[34719]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T10:58:18.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:18 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:20.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:20 smithi059 ceph-mon[30978]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-10T10:58:20.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:20 smithi181 ceph-mon[35409]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-10T10:58:20.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:20 smithi115 ceph-mon[34719]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-10T10:58:22.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:22 smithi059 ceph-mon[30978]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:58:22.923 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:22 smithi181 ceph-mon[35409]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:58:22.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:22 smithi115 ceph-mon[34719]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:58:24.740 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:24 smithi181 ceph-mon[35409]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-10T10:58:24.741 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T10:58:24.741 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:24 smithi059 ceph-mon[30978]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-10T10:58:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T10:58:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:24 smithi115 ceph-mon[34719]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-10T10:58:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T10:58:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:25 smithi181 ceph-mon[35409]: Deploying daemon osd.11 on smithi181 2024-09-10T10:58:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:25 smithi115 ceph-mon[34719]: Deploying daemon osd.11 on smithi181 2024-09-10T10:58:26.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:25 smithi059 ceph-mon[30978]: Deploying daemon osd.11 on smithi181 2024-09-10T10:58:26.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:26 smithi181 ceph-mon[35409]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-10T10:58:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:26 smithi115 ceph-mon[34719]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-10T10:58:27.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:26 smithi059 ceph-mon[30978]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-10T10:58:28.893 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:28 smithi181 ceph-mon[35409]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:58:28.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:28 smithi115 ceph-mon[34719]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:58:29.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:28 smithi059 ceph-mon[30978]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:58:30.926 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:30 smithi181 ceph-mon[35409]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:30.926 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:30 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:30.927 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:30 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:30.927 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:30 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:30.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:30 smithi115 ceph-mon[34719]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:30.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:30 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:30.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:30 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:30.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:30 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:31.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:30 smithi059 ceph-mon[30978]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:31.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:30 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:31.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:30 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:31.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:30 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:32.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:32 smithi181 ceph-mon[35409]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:32.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:32 smithi115 ceph-mon[34719]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:33.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:32 smithi059 ceph-mon[30978]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:33.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.950+0000 7f19e4977640 1 -- 172.21.15.181:0/2638831823 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f19e0062630 con 0x7f19cc0a2bb0 2024-09-10T10:58:33.952 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 11 on host 'smithi181' 2024-09-10T10:58:33.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f19cc0a2bb0 msgr2=0x7f19cc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:33.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f19cc0a2bb0 0x7f19cc0a5070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f19d8005fd0 tx=0x7f19d8009680 comp rx=0 tx=0).stop 2024-09-10T10:58:33.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 msgr2=0x7f19e0198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:33.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 0x7f19e0198460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19c8031610 tx=0x7f19c8004270 comp rx=0 tx=0).stop 2024-09-10T10:58:33.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 shutdown_connections 2024-09-10T10:58:33.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f19cc0a2bb0 0x7f19cc0a5070 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:33.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e01078c0 0x7f19e019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:33.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19e0104f90 0x7f19e0198460 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:33.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 --2- 172.21.15.181:0/2638831823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19e0102660 0x7f19e0197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:33.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 >> 172.21.15.181:0/2638831823 conn(0x7f19e00fc280 msgr2=0x7f19e01030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:33.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 shutdown_connections 2024-09-10T10:58:33.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:33.953+0000 7f19e5979640 1 -- 172.21.15.181:0/2638831823 wait complete. 2024-09-10T10:58:34.710 DEBUG:teuthology.orchestra.run.smithi181:osd.11> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T10:58:34.713 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T10:58:34.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:58:34.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:34 smithi181 ceph-mon[35409]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:34.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:34 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:34.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:34 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:34.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:34 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:34.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:34 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:34.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:34 smithi115 ceph-mon[34719]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:34.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:34 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:34.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:34 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:34.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:34 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:34.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:34 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:34.981 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:58:35.103 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:34 smithi059 ceph-mon[30978]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:35.103 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:34 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:35.103 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:34 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:35.103 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:34 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:35.104 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:34 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.583+0000 7fcb50aee640 1 -- 172.21.15.59:0/1060035809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 msgr2=0x7fcb4c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.583+0000 7fcb50aee640 1 --2- 172.21.15.59:0/1060035809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 0x7fcb4c108f60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009ca0 tx=0x7fcb4402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.583+0000 7fcb50aee640 1 -- 172.21.15.59:0/1060035809 shutdown_connections 2024-09-10T10:58:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.583+0000 7fcb50aee640 1 --2- 172.21.15.59:0/1060035809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 0x7fcb4c108f60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.583+0000 7fcb50aee640 1 --2- 172.21.15.59:0/1060035809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb4c101d10 0x7fcb4c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.583+0000 7fcb50aee640 1 --2- 172.21.15.59:0/1060035809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb4c100b10 0x7fcb4c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.583+0000 7fcb50aee640 1 -- 172.21.15.59:0/1060035809 >> 172.21.15.59:0/1060035809 conn(0x7fcb4c0fc2a0 msgr2=0x7fcb4c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:35.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.583+0000 7fcb50aee640 1 -- 172.21.15.59:0/1060035809 shutdown_connections 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.583+0000 7fcb50aee640 1 -- 172.21.15.59:0/1060035809 wait complete. 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.584+0000 7fcb50aee640 1 Processor -- start 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.584+0000 7fcb50aee640 1 -- start start 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.584+0000 7fcb50aee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb4c100b10 0x7fcb4c104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.584+0000 7fcb50aee640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb4c101d10 0x7fcb4c1030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.584+0000 7fcb50aee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 0x7fcb4c103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.584+0000 7fcb50aee640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c10c790 con 0x7fcb4c1026d0 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.584+0000 7fcb50aee640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c10c610 con 0x7fcb4c101d10 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.584+0000 7fcb50aee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c10c910 con 0x7fcb4c100b10 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.584+0000 7fcb4ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 0x7fcb4c103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb4ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 0x7fcb4c103630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39828/0 (socket says 172.21.15.59:39828) 2024-09-10T10:58:35.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb4ad9d640 1 -- 172.21.15.59:0/410666503 learned_addr learned my addr 172.21.15.59:0/410666503 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb4a59c640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb4c100b10 0x7fcb4c104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb49d9b640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb4c101d10 0x7fcb4c1030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb4ad9d640 1 -- 172.21.15.59:0/410666503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb4c100b10 msgr2=0x7fcb4c104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb4ad9d640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb4c100b10 0x7fcb4c104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb4ad9d640 1 -- 172.21.15.59:0/410666503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb4c101d10 msgr2=0x7fcb4c1030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb4ad9d640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb4c101d10 0x7fcb4c1030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb4ad9d640 1 -- 172.21.15.59:0/410666503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c103ef0 con 0x7fcb4c1026d0 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb4ad9d640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 0x7fcb4c103630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb44031ae0 tx=0x7fcb44031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb437fe640 1 -- 172.21.15.59:0/410666503 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44003b70 con 0x7fcb4c1026d0 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb437fe640 1 -- 172.21.15.59:0/410666503 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb44003d10 con 0x7fcb4c1026d0 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c1a2000 con 0x7fcb4c1026d0 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb437fe640 1 -- 172.21.15.59:0/410666503 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4402fc40 con 0x7fcb4c1026d0 2024-09-10T10:58:35.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.585+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c1a2560 con 0x7fcb4c1026d0 2024-09-10T10:58:35.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.586+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4c1a2790 con 0x7fcb4c1026d0 2024-09-10T10:58:35.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.587+0000 7fcb437fe640 1 -- 172.21.15.59:0/410666503 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcb44004050 con 0x7fcb4c1026d0 2024-09-10T10:58:35.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.588+0000 7fcb437fe640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcb380a2c00 0x7fcb380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:35.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.588+0000 7fcb4a59c640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcb380a2c00 0x7fcb380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:35.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.588+0000 7fcb437fe640 1 -- 172.21.15.59:0/410666503 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7fcb440efbb0 con 0x7fcb4c1026d0 2024-09-10T10:58:35.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.589+0000 7fcb4a59c640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcb380a2c00 0x7fcb380a50c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c101b70 tx=0x7fcb34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:35.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.592+0000 7fcb437fe640 1 -- 172.21.15.59:0/410666503 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb440bd170 con 0x7fcb4c1026d0 2024-09-10T10:58:35.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.769+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcb4c1a2960 con 0x7fcb4c1026d0 2024-09-10T10:58:35.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.769+0000 7fcb437fe640 1 -- 172.21.15.59:0/410666503 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fcb440bca70 con 0x7fcb4c1026d0 2024-09-10T10:58:35.771 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:58:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcb380a2c00 msgr2=0x7fcb380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcb380a2c00 0x7fcb380a50c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c101b70 tx=0x7fcb34005f90 comp rx=0 tx=0).stop 2024-09-10T10:58:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 msgr2=0x7fcb4c103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 0x7fcb4c103630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb44031ae0 tx=0x7fcb44031ee0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 shutdown_connections 2024-09-10T10:58:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcb380a2c00 0x7fcb380a50c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c1026d0 0x7fcb4c103630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb4c101d10 0x7fcb4c1030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 --2- 172.21.15.59:0/410666503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb4c100b10 0x7fcb4c104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:35.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 >> 172.21.15.59:0/410666503 conn(0x7fcb4c0fc2a0 msgr2=0x7fcb4c06a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:35.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 shutdown_connections 2024-09-10T10:58:35.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:35.772+0000 7fcb50aee640 1 -- 172.21.15.59:0/410666503 wait complete. 2024-09-10T10:58:36.318 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 10:58:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T10:58:36.144+0000 7f73a5a14640 -1 osd.11 0 log_to_monitors true 2024-09-10T10:58:36.576 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1725965893,"num_in_osds":12,"osd_in_since":1725965895,"num_remapped_pgs":0} 2024-09-10T10:58:36.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:36 smithi059 ceph-mon[30978]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:36.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:36 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/410666503' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:58:36.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:36 smithi059 ceph-mon[30978]: from='osd.11 [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:58:36.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:36 smithi059 ceph-mon[30978]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:58:36.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:36 smithi181 ceph-mon[35409]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:36.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:36 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/410666503' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:58:36.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:36 smithi181 ceph-mon[35409]: from='osd.11 [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:58:36.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:36 smithi181 ceph-mon[35409]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:58:36.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:36 smithi115 ceph-mon[34719]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:36.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:36 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/410666503' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:58:36.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:36 smithi115 ceph-mon[34719]: from='osd.11 [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:58:36.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:36 smithi115 ceph-mon[34719]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:58:37.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:58:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:58:37.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:37 smithi059 ceph-mon[30978]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T10:58:37.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:37 smithi059 ceph-mon[30978]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T10:58:37.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:37 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:37.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:37 smithi059 ceph-mon[30978]: from='osd.11 [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:58:37.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:37 smithi059 ceph-mon[30978]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:58:37.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:37 smithi059 ceph-mon[30978]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:37.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:37 smithi181 ceph-mon[35409]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T10:58:37.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:37 smithi181 ceph-mon[35409]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T10:58:37.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:37 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:37.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:37 smithi181 ceph-mon[35409]: from='osd.11 [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:58:37.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:37 smithi181 ceph-mon[35409]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:58:37.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:37 smithi181 ceph-mon[35409]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:37.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:37 smithi115 ceph-mon[34719]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T10:58:37.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:37 smithi115 ceph-mon[34719]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T10:58:37.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:37 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:37.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:37 smithi115 ceph-mon[34719]: from='osd.11 [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:58:37.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:37 smithi115 ceph-mon[34719]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-09-10T10:58:37.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:37 smithi115 ceph-mon[34719]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:38.436 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T10:58:38.085+0000 7f73a1997640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T10:58:38.436 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T10:58:38.095+0000 7f73997b7640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:58:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.450+0000 7fef31b00640 1 -- 172.21.15.59:0/3915538441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 msgr2=0x7fef2c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.450+0000 7fef31b00640 1 --2- 172.21.15.59:0/3915538441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 0x7fef2c10a050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef24009ca0 tx=0x7fef2402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.450+0000 7fef31b00640 1 -- 172.21.15.59:0/3915538441 shutdown_connections 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.450+0000 7fef31b00640 1 --2- 172.21.15.59:0/3915538441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 0x7fef2c10a050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.450+0000 7fef31b00640 1 --2- 172.21.15.59:0/3915538441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef2c102e00 0x7fef2c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.450+0000 7fef31b00640 1 --2- 172.21.15.59:0/3915538441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2c101c00 0x7fef2c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.450+0000 7fef31b00640 1 -- 172.21.15.59:0/3915538441 >> 172.21.15.59:0/3915538441 conn(0x7fef2c0fd390 msgr2=0x7fef2c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.450+0000 7fef31b00640 1 -- 172.21.15.59:0/3915538441 shutdown_connections 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.450+0000 7fef31b00640 1 -- 172.21.15.59:0/3915538441 wait complete. 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef31b00640 1 Processor -- start 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef31b00640 1 -- start start 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef31b00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef2c101c00 0x7fef2c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef31b00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2c102e00 0x7fef2c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef31b00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 0x7fef2c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef31b00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c10d8d0 con 0x7fef2c1037c0 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef31b00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c10d750 con 0x7fef2c102e00 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef31b00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c10da50 con 0x7fef2c101c00 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 0x7fef2c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 0x7fef2c19f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59156/0 (socket says 172.21.15.59:59156) 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef2bfff640 1 -- 172.21.15.59:0/995039309 learned_addr learned my addr 172.21.15.59:0/995039309 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef2b7fe640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef2c101c00 0x7fef2c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.451+0000 7fef2affd640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2c102e00 0x7fef2c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef2bfff640 1 -- 172.21.15.59:0/995039309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef2c101c00 msgr2=0x7fef2c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef2bfff640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef2c101c00 0x7fef2c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef2bfff640 1 -- 172.21.15.59:0/995039309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2c102e00 msgr2=0x7fef2c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef2bfff640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2c102e00 0x7fef2c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef2bfff640 1 -- 172.21.15.59:0/995039309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c19fad0 con 0x7fef2c1037c0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef2bfff640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 0x7fef2c19f460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef24009430 tx=0x7fef240319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef28ff9640 1 -- 172.21.15.59:0/995039309 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24003b70 con 0x7fef2c1037c0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef28ff9640 1 -- 172.21.15.59:0/995039309 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef24003d10 con 0x7fef2c1037c0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2c19fd60 con 0x7fef2c1037c0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef28ff9640 1 -- 172.21.15.59:0/995039309 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2402fc50 con 0x7fef2c1037c0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.452+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2c1a0240 con 0x7fef2c1037c0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.453+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef2c108f80 con 0x7fef2c1037c0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.455+0000 7fef28ff9640 1 -- 172.21.15.59:0/995039309 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fef24004040 con 0x7fef2c1037c0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.455+0000 7fef28ff9640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fef180a2bb0 0x7fef180a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.455+0000 7fef2b7fe640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fef180a2bb0 0x7fef180a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.456+0000 7fef28ff9640 1 -- 172.21.15.59:0/995039309 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7fef240eff70 con 0x7fef2c1037c0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.456+0000 7fef2b7fe640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fef180a2bb0 0x7fef180a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef2c102c60 tx=0x7fef1400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:38.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.459+0000 7fef28ff9640 1 -- 172.21.15.59:0/995039309 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef240bd510 con 0x7fef2c1037c0 2024-09-10T10:58:38.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.637+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fef2c062e90 con 0x7fef2c1037c0 2024-09-10T10:58:38.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.637+0000 7fef28ff9640 1 -- 172.21.15.59:0/995039309 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fef240bce10 con 0x7fef2c1037c0 2024-09-10T10:58:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:58:38.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fef180a2bb0 msgr2=0x7fef180a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:38.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fef180a2bb0 0x7fef180a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef2c102c60 tx=0x7fef1400b390 comp rx=0 tx=0).stop 2024-09-10T10:58:38.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 msgr2=0x7fef2c19f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:38.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 0x7fef2c19f460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef24009430 tx=0x7fef240319f0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 shutdown_connections 2024-09-10T10:58:38.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fef180a2bb0 0x7fef180a5070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef2c1037c0 0x7fef2c19f460 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2c102e00 0x7fef2c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 --2- 172.21.15.59:0/995039309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fef2c101c00 0x7fef2c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:38.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.639+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 >> 172.21.15.59:0/995039309 conn(0x7fef2c0fd390 msgr2=0x7fef2c106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:38.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.640+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 shutdown_connections 2024-09-10T10:58:38.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:38.640+0000 7fef31b00640 1 -- 172.21.15.59:0/995039309 wait complete. 2024-09-10T10:58:38.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:58:38.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T10:58:38.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:38.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: Detected new or changed devices on smithi181 2024-09-10T10:58:38.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi181 to 4272M 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='osd.11 ' entity='osd.11' 2024-09-10T10:58:38.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/995039309' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:58:38.890 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:38.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: Detected new or changed devices on smithi181 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi181 to 4272M 2024-09-10T10:58:38.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='osd.11 ' entity='osd.11' 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/995039309' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:58:38.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:38.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-10T10:58:38.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T10:58:38.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: Detected new or changed devices on smithi181 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi181 to 4272M 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:38.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:38.960 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:38.960 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:38.960 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='osd.11 ' entity='osd.11' 2024-09-10T10:58:38.960 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/995039309' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:58:38.960 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:39.305 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1725965893,"num_in_osds":12,"osd_in_since":1725965895,"num_remapped_pgs":0} 2024-09-10T10:58:40.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:58:40.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:40 smithi059 ceph-mon[30978]: purged_snaps scrub starts 2024-09-10T10:58:40.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:40 smithi059 ceph-mon[30978]: purged_snaps scrub ok 2024-09-10T10:58:40.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:40 smithi059 ceph-mon[30978]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:40.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:40 smithi059 ceph-mon[30978]: osd.11 [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] boot 2024-09-10T10:58:40.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:40 smithi059 ceph-mon[30978]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T10:58:40.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:40 smithi181 ceph-mon[35409]: purged_snaps scrub starts 2024-09-10T10:58:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:40 smithi181 ceph-mon[35409]: purged_snaps scrub ok 2024-09-10T10:58:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:40 smithi181 ceph-mon[35409]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:40 smithi181 ceph-mon[35409]: osd.11 [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] boot 2024-09-10T10:58:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:40 smithi181 ceph-mon[35409]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T10:58:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:40 smithi115 ceph-mon[34719]: purged_snaps scrub starts 2024-09-10T10:58:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:40 smithi115 ceph-mon[34719]: purged_snaps scrub ok 2024-09-10T10:58:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:40 smithi115 ceph-mon[34719]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:58:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:40 smithi115 ceph-mon[34719]: osd.11 [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] boot 2024-09-10T10:58:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:40 smithi115 ceph-mon[34719]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T10:58:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:58:40.576 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:58:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.024+0000 7f9e018b7640 1 -- 172.21.15.59:0/3283076371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc1037c0 msgr2=0x7f9dfc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.024+0000 7f9e018b7640 1 --2- 172.21.15.59:0/3283076371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc1037c0 0x7f9dfc10a050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009900 tx=0x7f9df402a410 comp rx=0 tx=0).stop 2024-09-10T10:58:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.024+0000 7f9e018b7640 1 -- 172.21.15.59:0/3283076371 shutdown_connections 2024-09-10T10:58:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.024+0000 7f9e018b7640 1 --2- 172.21.15.59:0/3283076371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc1037c0 0x7f9dfc10a050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.024+0000 7f9e018b7640 1 --2- 172.21.15.59:0/3283076371 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc102e00 0x7f9dfc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.024+0000 7f9e018b7640 1 --2- 172.21.15.59:0/3283076371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dfc101c00 0x7f9dfc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.024+0000 7f9e018b7640 1 -- 172.21.15.59:0/3283076371 >> 172.21.15.59:0/3283076371 conn(0x7f9dfc0fd390 msgr2=0x7f9dfc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.024+0000 7f9e018b7640 1 -- 172.21.15.59:0/3283076371 shutdown_connections 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.024+0000 7f9e018b7640 1 -- 172.21.15.59:0/3283076371 wait complete. 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9e018b7640 1 Processor -- start 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9e018b7640 1 -- start start 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9e018b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc101c00 0x7f9dfc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9e018b7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dfc102e00 0x7f9dfc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9e018b7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1037c0 0x7f9dfc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9e018b7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc10d8e0 con 0x7f9dfc101c00 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9e018b7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc10d760 con 0x7f9dfc102e00 2024-09-10T10:58:41.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9e018b7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc10da60 con 0x7f9dfc1037c0 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9dfaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc101c00 0x7f9dfc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9dfaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc101c00 0x7f9dfc075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59174/0 (socket says 172.21.15.59:59174) 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.025+0000 7f9dfaffd640 1 -- 172.21.15.59:0/1217029469 learned_addr learned my addr 172.21.15.59:0/1217029469 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9dfa7fc640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dfc102e00 0x7f9dfc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9dfaffd640 1 -- 172.21.15.59:0/1217029469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1037c0 msgr2=0x7f9dfc074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9dfaffd640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1037c0 0x7f9dfc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9dfaffd640 1 -- 172.21.15.59:0/1217029469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dfc102e00 msgr2=0x7f9dfc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9dfaffd640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dfc102e00 0x7f9dfc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9dfaffd640 1 -- 172.21.15.59:0/1217029469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc0753e0 con 0x7f9dfc101c00 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9dfaffd640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc101c00 0x7f9dfc075f90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00ccb0 tx=0x7f9dec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9e008b5640 1 -- 172.21.15.59:0/1217029469 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec003b70 con 0x7f9dfc101c00 2024-09-10T10:58:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9e008b5640 1 -- 172.21.15.59:0/1217029469 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dec00ae50 con 0x7f9dfc101c00 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc1a1fe0 con 0x7f9dfc101c00 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9e008b5640 1 -- 172.21.15.59:0/1217029469 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00f810 con 0x7f9dfc101c00 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.026+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc1a24c0 con 0x7f9dfc101c00 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.027+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc108f30 con 0x7f9dfc101c00 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.028+0000 7f9e008b5640 1 -- 172.21.15.59:0/1217029469 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9dec00f9b0 con 0x7f9dfc101c00 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.029+0000 7f9e008b5640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9de80a2c00 0x7f9de80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.029+0000 7f9dfa7fc640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9de80a2c00 0x7f9de80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.029+0000 7f9e008b5640 1 -- 172.21.15.59:0/1217029469 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f9dec0ced40 con 0x7f9dfc101c00 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.030+0000 7f9dfa7fc640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9de80a2c00 0x7f9de80a50c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc075d10 tx=0x7f9de4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.033+0000 7f9e008b5640 1 -- 172.21.15.59:0/1217029469 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9dec014070 con 0x7f9dfc101c00 2024-09-10T10:58:41.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.209+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9dfc02da30 con 0x7f9dfc101c00 2024-09-10T10:58:41.211 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:41 smithi059 ceph-mon[30978]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T10:58:41.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.209+0000 7f9e008b5640 1 -- 172.21.15.59:0/1217029469 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f9dec09c140 con 0x7f9dfc101c00 2024-09-10T10:58:41.212 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:58:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9de80a2c00 msgr2=0x7f9de80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9de80a2c00 0x7f9de80a50c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc075d10 tx=0x7f9de4008040 comp rx=0 tx=0).stop 2024-09-10T10:58:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc101c00 msgr2=0x7f9dfc075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc101c00 0x7f9dfc075f90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00ccb0 tx=0x7f9dec00a620 comp rx=0 tx=0).stop 2024-09-10T10:58:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 shutdown_connections 2024-09-10T10:58:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9de80a2c00 0x7f9de80a50c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9dfc1037c0 0x7f9dfc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dfc102e00 0x7f9dfc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 --2- 172.21.15.59:0/1217029469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc101c00 0x7f9dfc075f90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.211+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 >> 172.21.15.59:0/1217029469 conn(0x7f9dfc0fd390 msgr2=0x7f9dfc106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.212+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 shutdown_connections 2024-09-10T10:58:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:41.212+0000 7f9e018b7640 1 -- 172.21.15.59:0/1217029469 wait complete. 2024-09-10T10:58:41.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:41 smithi181 ceph-mon[35409]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T10:58:41.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:41 smithi115 ceph-mon[34719]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T10:58:41.917 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1725965919,"num_in_osds":12,"osd_in_since":1725965895,"num_remapped_pgs":0} 2024-09-10T10:58:41.918 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:58:42.181 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:58:42.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:42 smithi059 ceph-mon[30978]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:42.405 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:42 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1217029469' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:58:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:42 smithi181 ceph-mon[35409]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:42 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1217029469' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:58:42.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:42 smithi115 ceph-mon[34719]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:42.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:42 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1217029469' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.648+0000 7f605ad48640 1 -- 172.21.15.59:0/2898206393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054101de0 msgr2=0x7f60541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.648+0000 7f605ad48640 1 --2- 172.21.15.59:0/2898206393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054101de0 0x7f60541021c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6048009900 tx=0x7f604802a410 comp rx=0 tx=0).stop 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 -- 172.21.15.59:0/2898206393 shutdown_connections 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 --2- 172.21.15.59:0/2898206393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6054106f10 0x7f605410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 --2- 172.21.15.59:0/2898206393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6054102790 0x7f60541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 --2- 172.21.15.59:0/2898206393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054101de0 0x7f60541021c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 -- 172.21.15.59:0/2898206393 >> 172.21.15.59:0/2898206393 conn(0x7f60540fd8c0 msgr2=0x7f60540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 -- 172.21.15.59:0/2898206393 shutdown_connections 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 -- 172.21.15.59:0/2898206393 wait complete. 2024-09-10T10:58:42.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 Processor -- start 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 -- start start 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.649+0000 7f605ad48640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6054101de0 0x7f6054198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f605ad48640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054102790 0x7f6054198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f605ad48640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6054106f10 0x7f605419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f605ad48640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6054111f30 con 0x7f6054102790 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f605ad48640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6054111db0 con 0x7f6054101de0 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f605ad48640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f60541120b0 con 0x7f6054106f10 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6053fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054102790 0x7f6054198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6053fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054102790 0x7f6054198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59196/0 (socket says 172.21.15.59:59196) 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6053fff640 1 -- 172.21.15.59:0/1545172367 learned_addr learned my addr 172.21.15.59:0/1545172367 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6058ae4640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6054101de0 0x7f6054198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:42.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6053fff640 1 -- 172.21.15.59:0/1545172367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6054106f10 msgr2=0x7f605419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f60592e5640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6054106f10 0x7f605419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6053fff640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6054106f10 0x7f605419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6053fff640 1 -- 172.21.15.59:0/1545172367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6054101de0 msgr2=0x7f6054198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6053fff640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6054101de0 0x7f6054198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6053fff640 1 -- 172.21.15.59:0/1545172367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605419d3e0 con 0x7f6054102790 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6053fff640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054102790 0x7f6054198970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f604000c920 tx=0x7f604000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6051ffb640 1 -- 172.21.15.59:0/1545172367 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040007c70 con 0x7f6054102790 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6051ffb640 1 -- 172.21.15.59:0/1545172367 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6040007e10 con 0x7f6054102790 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605419d6d0 con 0x7f6054102790 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.650+0000 7f6051ffb640 1 -- 172.21.15.59:0/1545172367 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040018890 con 0x7f6054102790 2024-09-10T10:58:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.651+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60541a4fb0 con 0x7f6054102790 2024-09-10T10:58:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.652+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60541021c0 con 0x7f6054102790 2024-09-10T10:58:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.653+0000 7f6051ffb640 1 -- 172.21.15.59:0/1545172367 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6040018a70 con 0x7f6054102790 2024-09-10T10:58:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.653+0000 7f6051ffb640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60440a2b80 0x7f60440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.654+0000 7f6058ae4640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60440a2b80 0x7f60440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.654+0000 7f6051ffb640 1 -- 172.21.15.59:0/1545172367 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f60400ceda0 con 0x7f6054102790 2024-09-10T10:58:42.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.654+0000 7f6058ae4640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60440a2b80 0x7f60440a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6048005ab0 tx=0x7f6048005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:42.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.658+0000 7f6051ffb640 1 -- 172.21.15.59:0/1545172367 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6040014030 con 0x7f6054102790 2024-09-10T10:58:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.837+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6054109b60 con 0x7f6054102790 2024-09-10T10:58:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.838+0000 7f6051ffb640 1 -- 172.21.15.59:0/1545172367 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18446 (secure 0 0 0) 0x7f604000de20 con 0x7f6054102790 2024-09-10T10:58:42.841 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:58:42.841 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":76,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T10:58:40.090955+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:58:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60440a2b80 msgr2=0x7f60440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60440a2b80 0x7f60440a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6048005ab0 tx=0x7f6048005a20 comp rx=0 tx=0).stop 2024-09-10T10:58:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054102790 msgr2=0x7f6054198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054102790 0x7f6054198970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f604000c920 tx=0x7f604000cde0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 shutdown_connections 2024-09-10T10:58:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60440a2b80 0x7f60440a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6054106f10 0x7f605419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6054102790 0x7f6054198970 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 --2- 172.21.15.59:0/1545172367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6054101de0 0x7f6054198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 >> 172.21.15.59:0/1545172367 conn(0x7f60540fd8c0 msgr2=0x7f60540feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 shutdown_connections 2024-09-10T10:58:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:42.840+0000 7f605ad48640 1 -- 172.21.15.59:0/1545172367 wait complete. 2024-09-10T10:58:43.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:43 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1545172367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:58:43.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:43 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1545172367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:58:43.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:43 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1545172367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:58:43.667 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T10:54:53.126290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T10:58:43.667 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T10:58:43.925 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:58:44.303 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:44 smithi059 ceph-mon[30978]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.386+0000 7ff53351d640 1 -- 172.21.15.59:0/431423605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c106f10 msgr2=0x7ff52c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.386+0000 7ff53351d640 1 --2- 172.21.15.59:0/431423605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c106f10 0x7ff52c10ea90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff524009ca0 tx=0x7ff52402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.386+0000 7ff53351d640 1 -- 172.21.15.59:0/431423605 shutdown_connections 2024-09-10T10:58:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.386+0000 7ff53351d640 1 --2- 172.21.15.59:0/431423605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c106f10 0x7ff52c10ea90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.386+0000 7ff53351d640 1 --2- 172.21.15.59:0/431423605 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff52c102790 0x7ff52c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.386+0000 7ff53351d640 1 --2- 172.21.15.59:0/431423605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff52c101de0 0x7ff52c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.386+0000 7ff53351d640 1 -- 172.21.15.59:0/431423605 >> 172.21.15.59:0/431423605 conn(0x7ff52c0fd8c0 msgr2=0x7ff52c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.386+0000 7ff53351d640 1 -- 172.21.15.59:0/431423605 shutdown_connections 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.386+0000 7ff53351d640 1 -- 172.21.15.59:0/431423605 wait complete. 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff53351d640 1 Processor -- start 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff53351d640 1 -- start start 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff53351d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c101de0 0x7ff52c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff53351d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff52c102790 0x7ff52c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff53351d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff52c106f10 0x7ff52c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff53351d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c111fe0 con 0x7ff52c101de0 2024-09-10T10:58:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff53351d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c111e60 con 0x7ff52c106f10 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff53351d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c112160 con 0x7ff52c102790 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff5312b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c101de0 0x7ff52c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff5312b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c101de0 0x7ff52c1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59216/0 (socket says 172.21.15.59:59216) 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff5312b9640 1 -- 172.21.15.59:0/2653642456 learned_addr learned my addr 172.21.15.59:0/2653642456 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff530ab8640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff52c102790 0x7ff52c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff531aba640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff52c106f10 0x7ff52c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff5312b9640 1 -- 172.21.15.59:0/2653642456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff52c102790 msgr2=0x7ff52c198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff5312b9640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff52c102790 0x7ff52c198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff5312b9640 1 -- 172.21.15.59:0/2653642456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff52c106f10 msgr2=0x7ff52c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff5312b9640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff52c106f10 0x7ff52c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff5312b9640 1 -- 172.21.15.59:0/2653642456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c19d370 con 0x7ff52c101de0 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff530ab8640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff52c102790 0x7ff52c198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.387+0000 7ff531aba640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff52c106f10 0x7ff52c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.388+0000 7ff5312b9640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c101de0 0x7ff52c1983c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff52800b4a0 tx=0x7ff52800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.388+0000 7ff5227fc640 1 -- 172.21.15.59:0/2653642456 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528014070 con 0x7ff52c101de0 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.388+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52c19d660 con 0x7ff52c101de0 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.388+0000 7ff5227fc640 1 -- 172.21.15.59:0/2653642456 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff528010af0 con 0x7ff52c101de0 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.388+0000 7ff5227fc640 1 -- 172.21.15.59:0/2653642456 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528017d10 con 0x7ff52c101de0 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.388+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff52c1a4f40 con 0x7ff52c101de0 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.389+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52c1021c0 con 0x7ff52c101de0 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.390+0000 7ff5227fc640 1 -- 172.21.15.59:0/2653642456 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff528017070 con 0x7ff52c101de0 2024-09-10T10:58:44.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.391+0000 7ff5227fc640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5180a2b80 0x7ff5180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:44.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.391+0000 7ff530ab8640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5180a2b80 0x7ff5180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:44.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.391+0000 7ff5227fc640 1 -- 172.21.15.59:0/2653642456 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff5280ce3c0 con 0x7ff52c101de0 2024-09-10T10:58:44.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.391+0000 7ff530ab8640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5180a2b80 0x7ff5180a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff52c108880 tx=0x7ff51c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:44.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.394+0000 7ff5227fc640 1 -- 172.21.15.59:0/2653642456 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff52809b7c0 con 0x7ff52c101de0 2024-09-10T10:58:44.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:44 smithi181 ceph-mon[35409]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:44.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:44 smithi115 ceph-mon[34719]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:44.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.569+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff52c1a51e0 con 0x7ff52c101de0 2024-09-10T10:58:44.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.569+0000 7ff5227fc640 1 -- 172.21.15.59:0/2653642456 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7ff52809b0c0 con 0x7ff52c101de0 2024-09-10T10:58:44.571 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-09-10T10:58:44.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5180a2b80 msgr2=0x7ff5180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:44.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5180a2b80 0x7ff5180a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff52c108880 tx=0x7ff51c005d90 comp rx=0 tx=0).stop 2024-09-10T10:58:44.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c101de0 msgr2=0x7ff52c1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:44.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c101de0 0x7ff52c1983c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff52800b4a0 tx=0x7ff52800b960 comp rx=0 tx=0).stop 2024-09-10T10:58:44.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 shutdown_connections 2024-09-10T10:58:44.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5180a2b80 0x7ff5180a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff52c106f10 0x7ff52c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff52c102790 0x7ff52c198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 --2- 172.21.15.59:0/2653642456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff52c101de0 0x7ff52c1983c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:44.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 >> 172.21.15.59:0/2653642456 conn(0x7ff52c0fd8c0 msgr2=0x7ff52c0ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:44.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 shutdown_connections 2024-09-10T10:58:44.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:44.572+0000 7ff53351d640 1 -- 172.21.15.59:0/2653642456 wait complete. 2024-09-10T10:58:45.349 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:45 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2653642456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.a on smithi059 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.d on smithi059 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.g on smithi059 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.j on smithi059 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.b on smithi115 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.e on smithi115 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.h on smithi115 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.k on smithi115 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.c on smithi181 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.f on smithi181 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.i on smithi181 2024-09-10T10:58:45.383 INFO:tasks.cephadm:Adding mds.l on smithi181 2024-09-10T10:58:45.384 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l' 2024-09-10T10:58:45.413 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:45 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2653642456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:58:45.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:45 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2653642456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:58:45.642 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:58:46.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.113+0000 7f243c5a9640 1 -- 172.21.15.181:0/3335856578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 msgr2=0x7f2434104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:46.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.113+0000 7f243c5a9640 1 --2- 172.21.15.181:0/3335856578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 0x7f2434104af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2424009900 tx=0x7f242402a410 comp rx=0 tx=0).stop 2024-09-10T10:58:46.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.113+0000 7f243c5a9640 1 -- 172.21.15.181:0/3335856578 shutdown_connections 2024-09-10T10:58:46.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.113+0000 7f243c5a9640 1 --2- 172.21.15.181:0/3335856578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434107960 0x7f2434109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:46.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.113+0000 7f243c5a9640 1 --2- 172.21.15.181:0/3335856578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434105030 0x7f2434107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:46.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.113+0000 7f243c5a9640 1 --2- 172.21.15.181:0/3335856578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 0x7f2434104af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.113+0000 7f243c5a9640 1 -- 172.21.15.181:0/3335856578 >> 172.21.15.181:0/3335856578 conn(0x7f24340fc280 msgr2=0x7f24340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.113+0000 7f243c5a9640 1 -- 172.21.15.181:0/3335856578 shutdown_connections 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.113+0000 7f243c5a9640 1 -- 172.21.15.181:0/3335856578 wait complete. 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243c5a9640 1 Processor -- start 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243c5a9640 1 -- start start 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243c5a9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 0x7f243419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243c5a9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434105030 0x7f243419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243c5a9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434107960 0x7f24341a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243c5a9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f243410d8e0 con 0x7f2434107960 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243c5a9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f243410d760 con 0x7f2434105030 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243c5a9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f243410da60 con 0x7f2434102700 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243a345640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 0x7f243419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:46.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243a345640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 0x7f243419a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49364/0 (socket says 172.21.15.181:49364) 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243a345640 1 -- 172.21.15.181:0/1578189452 learned_addr learned my addr 172.21.15.181:0/1578189452 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f243ab46640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434107960 0x7f24341a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.114+0000 7f2439b44640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434105030 0x7f243419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f243a345640 1 -- 172.21.15.181:0/1578189452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434105030 msgr2=0x7f243419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f243a345640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434105030 0x7f243419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f243a345640 1 -- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434107960 msgr2=0x7f24341a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f243a345640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434107960 0x7f24341a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f243a345640 1 -- 172.21.15.181:0/1578189452 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24341a1de0 con 0x7f2434102700 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f243a345640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 0x7f243419a1b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2424009230 tx=0x7f2424004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f242b7fe640 1 -- 172.21.15.181:0/1578189452 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242403f030 con 0x7f2434102700 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24341a2070 con 0x7f2434102700 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f242b7fe640 1 -- 172.21.15.181:0/1578189452 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2424003ce0 con 0x7f2434102700 2024-09-10T10:58:46.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f242b7fe640 1 -- 172.21.15.181:0/1578189452 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424035070 con 0x7f2434102700 2024-09-10T10:58:46.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.115+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24341a2550 con 0x7f2434102700 2024-09-10T10:58:46.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.116+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2434109450 con 0x7f2434102700 2024-09-10T10:58:46.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.117+0000 7f242b7fe640 1 -- 172.21.15.181:0/1578189452 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2424042030 con 0x7f2434102700 2024-09-10T10:58:46.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.118+0000 7f242b7fe640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f24200a2bb0 0x7f24200a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:46.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.118+0000 7f2439b44640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f24200a2bb0 0x7f24200a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:46.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.119+0000 7f2439b44640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f24200a2bb0 0x7f24200a5070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2430005d00 tx=0x7f2430005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:46.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.123+0000 7f242b7fe640 1 -- 172.21.15.181:0/1578189452 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f24240ba390 con 0x7f2434102700 2024-09-10T10:58:46.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.131+0000 7f242b7fe640 1 -- 172.21.15.181:0/1578189452 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24240bc9f0 con 0x7f2434102700 2024-09-10T10:58:46.302 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:46 smithi181 ceph-mon[35409]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:46.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.315+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}) -- 0x7f24340627f0 con 0x7f24200a2bb0 2024-09-10T10:58:46.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.325+0000 7f242b7fe640 1 -- 172.21.15.181:0/1578189452 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f24340627f0 con 0x7f24200a2bb0 2024-09-10T10:58:46.326 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mds.all update... 2024-09-10T10:58:46.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f24200a2bb0 msgr2=0x7f24200a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:46.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f24200a2bb0 0x7f24200a5070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2430005d00 tx=0x7f2430005c50 comp rx=0 tx=0).stop 2024-09-10T10:58:46.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 msgr2=0x7f243419a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:46.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 0x7f243419a1b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2424009230 tx=0x7f2424004360 comp rx=0 tx=0).stop 2024-09-10T10:58:46.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 shutdown_connections 2024-09-10T10:58:46.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f24200a2bb0 0x7f24200a5070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:46.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434107960 0x7f24341a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:46.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434105030 0x7f243419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:46.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 --2- 172.21.15.181:0/1578189452 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2434102700 0x7f243419a1b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:46.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 >> 172.21.15.181:0/1578189452 conn(0x7f24340fc280 msgr2=0x7f2434101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:46.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 shutdown_connections 2024-09-10T10:58:46.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-10T10:58:46.327+0000 7f243c5a9640 1 -- 172.21.15.181:0/1578189452 wait complete. 2024-09-10T10:58:46.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:46 smithi059 ceph-mon[30978]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:46 smithi115 ceph-mon[34719]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:47.045 DEBUG:teuthology.orchestra.run.smithi059:mds.a> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T10:58:47.048 DEBUG:teuthology.orchestra.run.smithi059:mds.d> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T10:58:47.090 DEBUG:teuthology.orchestra.run.smithi059:mds.g> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T10:58:47.133 DEBUG:teuthology.orchestra.run.smithi059:mds.j> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T10:58:47.176 DEBUG:teuthology.orchestra.run.smithi115:mds.b> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T10:58:47.179 DEBUG:teuthology.orchestra.run.smithi115:mds.e> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T10:58:47.223 DEBUG:teuthology.orchestra.run.smithi115:mds.h> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T10:58:47.266 DEBUG:teuthology.orchestra.run.smithi115:mds.k> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T10:58:47.309 DEBUG:teuthology.orchestra.run.smithi181:mds.c> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T10:58:47.312 DEBUG:teuthology.orchestra.run.smithi181:mds.f> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T10:58:47.355 DEBUG:teuthology.orchestra.run.smithi181:mds.i> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T10:58:47.399 DEBUG:teuthology.orchestra.run.smithi181:mds.l> sudo journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T10:58:47.441 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T10:58:47.442 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:58:47.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:58:47.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: Saving service mds.all spec with placement smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-10T10:58:47.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:47.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:47.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:47.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:47.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:47.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:47.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:47.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:47 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:47.596 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:58:47.597 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: Saving service mds.all spec with placement smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-10T10:58:47.597 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:47.597 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:47.597 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:47.597 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:47.597 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:47.597 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:47.597 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:47.597 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:47 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:47.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:58:47.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: Saving service mds.all spec with placement smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-10T10:58:47.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:47.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:58:47.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:47.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:58:47.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:47.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:47.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:47.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:47 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:47.700 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:58:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.158+0000 7f4a96623640 1 -- 172.21.15.59:0/3198944142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90106f10 msgr2=0x7f4a9010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.158+0000 7f4a96623640 1 --2- 172.21.15.59:0/3198944142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90106f10 0x7f4a9010ea90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4a88009ca0 tx=0x7f4a8802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.158+0000 7f4a96623640 1 -- 172.21.15.59:0/3198944142 shutdown_connections 2024-09-10T10:58:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.158+0000 7f4a96623640 1 --2- 172.21.15.59:0/3198944142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90106f10 0x7f4a9010ea90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.158+0000 7f4a96623640 1 --2- 172.21.15.59:0/3198944142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a90102790 0x7f4a901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.158+0000 7f4a96623640 1 --2- 172.21.15.59:0/3198944142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a90101de0 0x7f4a901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.158+0000 7f4a96623640 1 -- 172.21.15.59:0/3198944142 >> 172.21.15.59:0/3198944142 conn(0x7f4a900fd8c0 msgr2=0x7f4a900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.158+0000 7f4a96623640 1 -- 172.21.15.59:0/3198944142 shutdown_connections 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.158+0000 7f4a96623640 1 -- 172.21.15.59:0/3198944142 wait complete. 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a96623640 1 Processor -- start 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a96623640 1 -- start start 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a96623640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a90101de0 0x7f4a90198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a96623640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90102790 0x7f4a90198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a96623640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a90106f10 0x7f4a9019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a96623640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4a90111f70 con 0x7f4a90102790 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a96623640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4a90111df0 con 0x7f4a90101de0 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a96623640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4a901120f0 con 0x7f4a90106f10 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90102790 0x7f4a90198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90102790 0x7f4a90198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52864/0 (socket says 172.21.15.59:52864) 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a8f7fe640 1 -- 172.21.15.59:0/2169256930 learned_addr learned my addr 172.21.15.59:0/2169256930 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a8ffff640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a90101de0 0x7f4a90198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a94bc0640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a90106f10 0x7f4a9019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a8f7fe640 1 -- 172.21.15.59:0/2169256930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a90106f10 msgr2=0x7f4a9019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a8f7fe640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a90106f10 0x7f4a9019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a8f7fe640 1 -- 172.21.15.59:0/2169256930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a90101de0 msgr2=0x7f4a90198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a8f7fe640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a90101de0 0x7f4a90198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.159+0000 7f4a8f7fe640 1 -- 172.21.15.59:0/2169256930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9019d2f0 con 0x7f4a90102790 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.160+0000 7f4a8f7fe640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90102790 0x7f4a90198880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400c920 tx=0x7f4a8400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.160+0000 7f4a8d7fa640 1 -- 172.21.15.59:0/2169256930 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a84007c70 con 0x7f4a90102790 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.160+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9019d5e0 con 0x7f4a90102790 2024-09-10T10:58:48.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.160+0000 7f4a8d7fa640 1 -- 172.21.15.59:0/2169256930 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a84007e10 con 0x7f4a90102790 2024-09-10T10:58:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.160+0000 7f4a8d7fa640 1 -- 172.21.15.59:0/2169256930 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a84018890 con 0x7f4a90102790 2024-09-10T10:58:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.160+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a901a4ec0 con 0x7f4a90102790 2024-09-10T10:58:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.161+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a901021c0 con 0x7f4a90102790 2024-09-10T10:58:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.162+0000 7f4a8d7fa640 1 -- 172.21.15.59:0/2169256930 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4a84018a70 con 0x7f4a90102790 2024-09-10T10:58:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.163+0000 7f4a8d7fa640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a780a2b80 0x7f4a780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.163+0000 7f4a8ffff640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a780a2b80 0x7f4a780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.163+0000 7f4a8d7fa640 1 -- 172.21.15.59:0/2169256930 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f4a840ceca0 con 0x7f4a90102790 2024-09-10T10:58:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.163+0000 7f4a8ffff640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a780a2b80 0x7f4a780a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a80005fd0 tx=0x7f4a8000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.167+0000 7f4a8d7fa640 1 -- 172.21.15.59:0/2169256930 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a84014030 con 0x7f4a90102790 2024-09-10T10:58:48.328 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:48 smithi059 ceph-mon[30978]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:48.328 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:48 smithi059 ceph-mon[30978]: Deploying daemon mds.l on smithi181 2024-09-10T10:58:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.378+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a9002d7c0 con 0x7f4a90102790 2024-09-10T10:58:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.379+0000 7f4a8d7fa640 1 -- 172.21.15.59:0/2169256930 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f4a8409c0a0 con 0x7f4a90102790 2024-09-10T10:58:48.381 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:58:48.381 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":1,"btime":"2024-09-10T10:51:53:731417+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T10:58:48.381 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 1 2024-09-10T10:58:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a780a2b80 msgr2=0x7f4a780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a780a2b80 0x7f4a780a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a80005fd0 tx=0x7f4a8000b390 comp rx=0 tx=0).stop 2024-09-10T10:58:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90102790 msgr2=0x7f4a90198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90102790 0x7f4a90198880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400c920 tx=0x7f4a8400cde0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 shutdown_connections 2024-09-10T10:58:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a780a2b80 0x7f4a780a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a90106f10 0x7f4a9019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a90102790 0x7f4a90198880 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 --2- 172.21.15.59:0/2169256930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a90101de0 0x7f4a90198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 >> 172.21.15.59:0/2169256930 conn(0x7f4a900fd8c0 msgr2=0x7f4a900febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 shutdown_connections 2024-09-10T10:58:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:48.381+0000 7f4a96623640 1 -- 172.21.15.59:0/2169256930 wait complete. 2024-09-10T10:58:48.633 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:48 smithi115 ceph-mon[34719]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:48.633 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:48 smithi115 ceph-mon[34719]: Deploying daemon mds.l on smithi181 2024-09-10T10:58:48.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:48 smithi181 ceph-mon[35409]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:48.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:48 smithi181 ceph-mon[35409]: Deploying daemon mds.l on smithi181 2024-09-10T10:58:49.080 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 10:58:48 smithi181 systemd[1]: Starting Ceph mds.l for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:58:49.333 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 10:58:49 smithi181 podman[65389]: 2024-09-10 10:58:48.981405031 +0000 UTC m=+0.015911132 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:58:49.333 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 10:58:49 smithi181 podman[65389]: 2024-09-10 10:58:49.086606651 +0000 UTC m=+0.121112750 container create e1dd3464e4eb38538a86afdc6335c10a16345787e332f6ebc6aa5a57138aaf64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T10:58:49.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:49 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2169256930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:58:49.596 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:49 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2169256930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:58:49.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:49 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2169256930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:58:49.687 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 10:58:49 smithi181 podman[65389]: 2024-09-10 10:58:49.351524021 +0000 UTC m=+0.386030124 container init e1dd3464e4eb38538a86afdc6335c10a16345787e332f6ebc6aa5a57138aaf64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T10:58:49.687 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 10:58:49 smithi181 podman[65389]: 2024-09-10 10:58:49.354570713 +0000 UTC m=+0.389076825 container start e1dd3464e4eb38538a86afdc6335c10a16345787e332f6ebc6aa5a57138aaf64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:58:49.687 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 10:58:49 smithi181 ceph-mds[65408]: -- 172.21.15.181:0/878256283 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c7fd0c7860 con 0x55c7fd0a5000 2024-09-10T10:58:49.687 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 10:58:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l[65404]: starting mds.l at 2024-09-10T10:58:49.687 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 10:58:49 smithi181 bash[65389]: e1dd3464e4eb38538a86afdc6335c10a16345787e332f6ebc6aa5a57138aaf64 2024-09-10T10:58:49.687 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 10:58:49 smithi181 systemd[1]: Started Ceph mds.l for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:58:50.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:50.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.181:6832/2390302822,v1:172.21.15.181:6833/2390302822] up:boot 2024-09-10T10:58:50.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: fsmap 1 up:standby 2024-09-10T10:58:50.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:58:50.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:50.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:50.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:50.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:50.612 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:50.613 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:50.613 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:50 smithi115 ceph-mon[34719]: Deploying daemon mds.k on smithi115 2024-09-10T10:58:50.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:50.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.181:6832/2390302822,v1:172.21.15.181:6833/2390302822] up:boot 2024-09-10T10:58:50.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: fsmap 1 up:standby 2024-09-10T10:58:50.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:58:50.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:50.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:50.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:50.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:50.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:50.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:50.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:50 smithi059 ceph-mon[30978]: Deploying daemon mds.k on smithi115 2024-09-10T10:58:50.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:50.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.181:6832/2390302822,v1:172.21.15.181:6833/2390302822] up:boot 2024-09-10T10:58:50.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: fsmap 1 up:standby 2024-09-10T10:58:50.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:58:50.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:50.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:50.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:50.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:50.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:50.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:50.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:50 smithi181 ceph-mon[35409]: Deploying daemon mds.k on smithi115 2024-09-10T10:58:51.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:58:51.384 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:58:51.683 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 10:58:51 smithi115 systemd[1]: Starting Ceph mds.k for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:58:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.851+0000 7f2b346eb640 1 -- 172.21.15.59:0/1393695402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c074620 msgr2=0x7f2b2c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.851+0000 7f2b346eb640 1 --2- 172.21.15.59:0/1393695402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c074620 0x7f2b2c074a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b28009900 tx=0x7f2b2802a480 comp rx=0 tx=0).stop 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.851+0000 7f2b346eb640 1 -- 172.21.15.59:0/1393695402 shutdown_connections 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.851+0000 7f2b346eb640 1 --2- 172.21.15.59:0/1393695402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b2c10e3c0 0x7f2b2c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.851+0000 7f2b346eb640 1 --2- 172.21.15.59:0/1393695402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c074f40 0x7f2b2c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.851+0000 7f2b346eb640 1 --2- 172.21.15.59:0/1393695402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c074620 0x7f2b2c074a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.851+0000 7f2b346eb640 1 -- 172.21.15.59:0/1393695402 >> 172.21.15.59:0/1393695402 conn(0x7f2b2c0fd8c0 msgr2=0x7f2b2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.851+0000 7f2b346eb640 1 -- 172.21.15.59:0/1393695402 shutdown_connections 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.851+0000 7f2b346eb640 1 -- 172.21.15.59:0/1393695402 wait complete. 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b346eb640 1 Processor -- start 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b346eb640 1 -- start start 2024-09-10T10:58:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b346eb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c074620 0x7f2b2c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b346eb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b2c074f40 0x7f2b2c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b346eb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c10e3c0 0x7f2b2c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b346eb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c1141c0 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b346eb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c114040 con 0x7f2b2c074f40 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b346eb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c114340 con 0x7f2b2c074620 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b32c88640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c10e3c0 0x7f2b2c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b32c88640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c10e3c0 0x7f2b2c19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52880/0 (socket says 172.21.15.59:52880) 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b32c88640 1 -- 172.21.15.59:0/3728706844 learned_addr learned my addr 172.21.15.59:0/3728706844 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b31c86640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b2c074f40 0x7f2b2c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b32487640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c074620 0x7f2b2c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b32c88640 1 -- 172.21.15.59:0/3728706844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c074620 msgr2=0x7f2b2c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b32c88640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c074620 0x7f2b2c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b32c88640 1 -- 172.21.15.59:0/3728706844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b2c074f40 msgr2=0x7f2b2c19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b32c88640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b2c074f40 0x7f2b2c19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.852+0000 7f2b32c88640 1 -- 172.21.15.59:0/3728706844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c19f690 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.853+0000 7f2b32c88640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c10e3c0 0x7f2b2c19efb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400eb10 tx=0x7f2b2400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.853+0000 7f2b237fe640 1 -- 172.21.15.59:0/3728706844 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400ce20 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.853+0000 7f2b237fe640 1 -- 172.21.15.59:0/3728706844 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b24005020 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.853+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c19f980 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.853+0000 7f2b237fe640 1 -- 172.21.15.59:0/3728706844 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b24010690 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.853+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c1a7260 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.854+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2c074a00 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.855+0000 7f2b237fe640 1 -- 172.21.15.59:0/3728706844 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2b24005540 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.856+0000 7f2b237fe640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2b180a2c00 0x7f2b180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.856+0000 7f2b32487640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2b180a2c00 0x7f2b180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.856+0000 7f2b237fe640 1 -- 172.21.15.59:0/3728706844 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f2b240cf160 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.856+0000 7f2b32487640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2b180a2c00 0x7f2b180a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b28005ab0 tx=0x7f2b28005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:51.861+0000 7f2b237fe640 1 -- 172.21.15.59:0/3728706844 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b2409c560 con 0x7f2b2c10e3c0 2024-09-10T10:58:51.936 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 10:58:51 smithi115 podman[64416]: 2024-09-10 10:58:51.68171567 +0000 UTC m=+0.104184606 container create d9a80b5aec544bff14d74ae01becb399b6aa77c6b1a63bba931de6b2f1719a82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T10:58:51.936 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 10:58:51 smithi115 podman[64416]: 2024-09-10 10:58:51.594804987 +0000 UTC m=+0.017273950 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:58:51.937 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 10:58:51 smithi115 podman[64416]: 2024-09-10 10:58:51.909520227 +0000 UTC m=+0.331989170 container init d9a80b5aec544bff14d74ae01becb399b6aa77c6b1a63bba931de6b2f1719a82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:58:51.937 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 10:58:51 smithi115 podman[64416]: 2024-09-10 10:58:51.912305451 +0000 UTC m=+0.334774396 container start d9a80b5aec544bff14d74ae01becb399b6aa77c6b1a63bba931de6b2f1719a82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-09-10T10:58:52.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.078+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b2c02d7c0 con 0x7f2b2c10e3c0 2024-09-10T10:58:52.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.078+0000 7f2b237fe640 1 -- 172.21.15.59:0/3728706844 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f2b2409be60 con 0x7f2b2c10e3c0 2024-09-10T10:58:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:58:52.081 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":2,"btime":"2024-09-10T10:58:49:382890+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T10:58:52.081 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 2 2024-09-10T10:58:52.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2b180a2c00 msgr2=0x7f2b180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:52.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2b180a2c00 0x7f2b180a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b28005ab0 tx=0x7f2b28005a20 comp rx=0 tx=0).stop 2024-09-10T10:58:52.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c10e3c0 msgr2=0x7f2b2c19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:52.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c10e3c0 0x7f2b2c19efb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400eb10 tx=0x7f2b2400ef10 comp rx=0 tx=0).stop 2024-09-10T10:58:52.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 shutdown_connections 2024-09-10T10:58:52.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2b180a2c00 0x7f2b180a50c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:52.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b2c10e3c0 0x7f2b2c19efb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:52.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b2c074f40 0x7f2b2c19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:52.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 --2- 172.21.15.59:0/3728706844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c074620 0x7f2b2c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:52.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 >> 172.21.15.59:0/3728706844 conn(0x7f2b2c0fd8c0 msgr2=0x7f2b2c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:52.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 shutdown_connections 2024-09-10T10:58:52.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:52.081+0000 7f2b346eb640 1 -- 172.21.15.59:0/3728706844 wait complete. 2024-09-10T10:58:52.208 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 10:58:51 smithi115 ceph-mds[64436]: -- 172.21.15.115:0/124686643 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55be54a15860 con 0x55be549f3400 2024-09-10T10:58:52.208 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 10:58:51 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-k[64432]: starting mds.k at 2024-09-10T10:58:52.208 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 10:58:51 smithi115 bash[64416]: d9a80b5aec544bff14d74ae01becb399b6aa77c6b1a63bba931de6b2f1719a82 2024-09-10T10:58:52.208 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 10:58:51 smithi115 systemd[1]: Started Ceph mds.k for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:58:52.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:52 smithi181 ceph-mon[35409]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:52.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:52.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:52.688 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:52.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:52.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:52.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:52 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:52.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:52 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3728706844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:58:52.712 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:52 smithi115 ceph-mon[34719]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:52.712 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:52.712 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:52.712 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:52.712 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:52.713 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:52.713 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:52 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:52.713 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:52 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3728706844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:58:52.778 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:52 smithi059 ceph-mon[30978]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:52.778 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:52.778 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:52.779 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:52.779 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:52.779 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:52.779 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:52 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:52.779 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:52 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3728706844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:58:53.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:53 smithi181 ceph-mon[35409]: Deploying daemon mds.j on smithi059 2024-09-10T10:58:53.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:53 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.115:6832/293569527,v1:172.21.15.115:6833/293569527] up:boot 2024-09-10T10:58:53.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:53 smithi181 ceph-mon[35409]: fsmap 2 up:standby 2024-09-10T10:58:53.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:53 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:58:53.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:53 smithi115 ceph-mon[34719]: Deploying daemon mds.j on smithi059 2024-09-10T10:58:53.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:53 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.115:6832/293569527,v1:172.21.15.115:6833/293569527] up:boot 2024-09-10T10:58:53.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:53 smithi115 ceph-mon[34719]: fsmap 2 up:standby 2024-09-10T10:58:53.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:53 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:58:53.757 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:53 smithi059 ceph-mon[30978]: Deploying daemon mds.j on smithi059 2024-09-10T10:58:53.758 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:53 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.115:6832/293569527,v1:172.21.15.115:6833/293569527] up:boot 2024-09-10T10:58:53.758 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:53 smithi059 ceph-mon[30978]: fsmap 2 up:standby 2024-09-10T10:58:53.758 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:53 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:58:54.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:54 smithi059 ceph-mon[30978]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:54.638 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 10:58:54 smithi059 systemd[1]: Starting Ceph mds.j for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:58:54.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:54 smithi181 ceph-mon[35409]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:54.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:54 smithi115 ceph-mon[34719]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:54.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:58:55.022 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 10:58:54 smithi059 podman[67891]: 2024-09-10 10:58:54.656189021 +0000 UTC m=+0.017077309 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:58:55.022 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 10:58:54 smithi059 podman[67891]: 2024-09-10 10:58:54.785436464 +0000 UTC m=+0.146324752 container create 719175ea0b31a52f1985ab808b60c36e0f14c451bb337711db0f5c5eb9d42349 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:58:55.022 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 10:58:55 smithi059 podman[67891]: 2024-09-10 10:58:55.02150976 +0000 UTC m=+0.382398047 container init 719175ea0b31a52f1985ab808b60c36e0f14c451bb337711db0f5c5eb9d42349 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T10:58:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:58:55.321 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 10:58:55 smithi059 podman[67891]: 2024-09-10 10:58:55.026613032 +0000 UTC m=+0.387501328 container start 719175ea0b31a52f1985ab808b60c36e0f14c451bb337711db0f5c5eb9d42349 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T10:58:55.321 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 10:58:55 smithi059 ceph-mds[67940]: -- 172.21.15.59:0/3444512578 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b25ee95860 con 0x55b25ee72800 2024-09-10T10:58:55.322 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 10:58:55 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-j[67924]: starting mds.j at 2024-09-10T10:58:55.322 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 10:58:55 smithi059 bash[67891]: 719175ea0b31a52f1985ab808b60c36e0f14c451bb337711db0f5c5eb9d42349 2024-09-10T10:58:55.322 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 10:58:55 smithi059 systemd[1]: Started Ceph mds.j for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:58:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.693+0000 7fbd7a246640 1 -- 172.21.15.59:0/3756522818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 msgr2=0x7fbd74106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.693+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3756522818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 0x7fbd74106f80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009900 tx=0x7fbd6402a410 comp rx=0 tx=0).stop 2024-09-10T10:58:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.693+0000 7fbd7a246640 1 -- 172.21.15.59:0/3756522818 shutdown_connections 2024-09-10T10:58:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.693+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3756522818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd74100a70 0x7fbd7410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.693+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3756522818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd741000d0 0x7fbd74100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.693+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3756522818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 0x7fbd74106f80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.693+0000 7fbd7a246640 1 -- 172.21.15.59:0/3756522818 >> 172.21.15.59:0/3756522818 conn(0x7fbd74077210 msgr2=0x7fbd740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.693+0000 7fbd7a246640 1 -- 172.21.15.59:0/3756522818 shutdown_connections 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.693+0000 7fbd7a246640 1 -- 172.21.15.59:0/3756522818 wait complete. 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.694+0000 7fbd7a246640 1 Processor -- start 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.694+0000 7fbd7a246640 1 -- start start 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.694+0000 7fbd7a246640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd741000d0 0x7fbd741012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.694+0000 7fbd7a246640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd74100a70 0x7fbd741017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.694+0000 7fbd7a246640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 0x7fbd74101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.694+0000 7fbd7a246640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbd74112090 con 0x7fbd74106ba0 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.694+0000 7fbd7a246640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbd74111f10 con 0x7fbd74100a70 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.694+0000 7fbd7a246640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbd74112210 con 0x7fbd741000d0 2024-09-10T10:58:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.694+0000 7fbd73fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 0x7fbd74101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd73fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 0x7fbd74101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52914/0 (socket says 172.21.15.59:52914) 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd73fff640 1 -- 172.21.15.59:0/3266443019 learned_addr learned my addr 172.21.15.59:0/3266443019 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd737fe640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd741000d0 0x7fbd741012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd6affd640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd74100a70 0x7fbd741017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd73fff640 1 -- 172.21.15.59:0/3266443019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd741000d0 msgr2=0x7fbd741012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd73fff640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd741000d0 0x7fbd741012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd73fff640 1 -- 172.21.15.59:0/3266443019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd74100a70 msgr2=0x7fbd741017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd73fff640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd74100a70 0x7fbd741017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd73fff640 1 -- 172.21.15.59:0/3266443019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd741aae50 con 0x7fbd74106ba0 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd737fe640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd741000d0 0x7fbd741012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd73fff640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 0x7fbd74101d30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009fd0 tx=0x7fbd6c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd717fa640 1 -- 172.21.15.59:0/3266443019 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c017070 con 0x7fbd74106ba0 2024-09-10T10:58:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd741ab080 con 0x7fbd74106ba0 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd717fa640 1 -- 172.21.15.59:0/3266443019 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd6c003e50 con 0x7fbd74106ba0 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd717fa640 1 -- 172.21.15.59:0/3266443019 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0106c0 con 0x7fbd74106ba0 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.695+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd741ab5c0 con 0x7fbd74106ba0 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.696+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd74100530 con 0x7fbd74106ba0 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.698+0000 7fbd717fa640 1 -- 172.21.15.59:0/3266443019 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbd6c003970 con 0x7fbd74106ba0 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.699+0000 7fbd717fa640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbd600a2b80 0x7fbd600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.699+0000 7fbd717fa640 1 -- 172.21.15.59:0/3266443019 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fbd6c0ce890 con 0x7fbd74106ba0 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.699+0000 7fbd737fe640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbd600a2b80 0x7fbd600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.699+0000 7fbd737fe640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbd600a2b80 0x7fbd600a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000c00 tx=0x7fbd64004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.702+0000 7fbd717fa640 1 -- 172.21.15.59:0/3266443019 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd6c09bc90 con 0x7fbd74106ba0 2024-09-10T10:58:55.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.916+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd74103320 con 0x7fbd74106ba0 2024-09-10T10:58:55.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.916+0000 7fbd717fa640 1 -- 172.21.15.59:0/3266443019 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7fbd6c013c70 con 0x7fbd74106ba0 2024-09-10T10:58:55.917 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:58:55.917 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":4,"btime":"2024-09-10T10:58:55:402339+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T10:58:55.918 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 4 2024-09-10T10:58:55.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbd600a2b80 msgr2=0x7fbd600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:55.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbd600a2b80 0x7fbd600a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000c00 tx=0x7fbd64004100 comp rx=0 tx=0).stop 2024-09-10T10:58:55.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 msgr2=0x7fbd74101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:55.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 0x7fbd74101d30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009fd0 tx=0x7fbd6c00b260 comp rx=0 tx=0).stop 2024-09-10T10:58:55.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 shutdown_connections 2024-09-10T10:58:55.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fbd600a2b80 0x7fbd600a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:55.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd74106ba0 0x7fbd74101d30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:55.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd74100a70 0x7fbd741017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:55.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 --2- 172.21.15.59:0/3266443019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd741000d0 0x7fbd741012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:55.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 >> 172.21.15.59:0/3266443019 conn(0x7fbd74077210 msgr2=0x7fbd74104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:55.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 shutdown_connections 2024-09-10T10:58:55.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:55.918+0000 7fbd7a246640 1 -- 172.21.15.59:0/3266443019 wait complete. 2024-09-10T10:58:56.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: Deploying daemon mds.d on smithi059 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.59:6834/2132184928,v1:172.21.15.59:6835/2132184928] up:boot 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: fsmap 3 up:standby 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:58:56.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:56 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3266443019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:58:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:56.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:56.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: Deploying daemon mds.d on smithi059 2024-09-10T10:58:56.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.59:6834/2132184928,v1:172.21.15.59:6835/2132184928] up:boot 2024-09-10T10:58:56.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: fsmap 3 up:standby 2024-09-10T10:58:56.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:58:56.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:56 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3266443019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:58:56.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:56.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: Deploying daemon mds.d on smithi059 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.59:6834/2132184928,v1:172.21.15.59:6835/2132184928] up:boot 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: fsmap 3 up:standby 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:58:56.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:56 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3266443019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:58:58.374 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:58 smithi059 ceph-mon[30978]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:58.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:58 smithi115 ceph-mon[34719]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:58.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:58 smithi181 ceph-mon[35409]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:58.888 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 10:58:58 smithi059 systemd[1]: Started Ceph mds.d for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:58:58.920 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:58:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:58:59.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.648+0000 7fe687675640 1 -- 172.21.15.59:0/2845450576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680102790 msgr2=0x7fe6801067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:59.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.648+0000 7fe687675640 1 --2- 172.21.15.59:0/2845450576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680102790 0x7fe6801067e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe670009900 tx=0x7fe67002a410 comp rx=0 tx=0).stop 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.649+0000 7fe687675640 1 -- 172.21.15.59:0/2845450576 shutdown_connections 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.649+0000 7fe687675640 1 --2- 172.21.15.59:0/2845450576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe680106f10 0x7fe68010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.649+0000 7fe687675640 1 --2- 172.21.15.59:0/2845450576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680102790 0x7fe6801067e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.649+0000 7fe687675640 1 --2- 172.21.15.59:0/2845450576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680101de0 0x7fe6801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.649+0000 7fe687675640 1 -- 172.21.15.59:0/2845450576 >> 172.21.15.59:0/2845450576 conn(0x7fe6800fd8c0 msgr2=0x7fe6800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.649+0000 7fe687675640 1 -- 172.21.15.59:0/2845450576 shutdown_connections 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.649+0000 7fe687675640 1 -- 172.21.15.59:0/2845450576 wait complete. 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.649+0000 7fe687675640 1 Processor -- start 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.649+0000 7fe687675640 1 -- start start 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe687675640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680101de0 0x7fe6800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe687675640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe680102790 0x7fe680074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:59.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe687675640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680106f10 0x7fe680074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe687675640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe680111f30 con 0x7fe680101de0 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe687675640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe680111db0 con 0x7fe680106f10 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe687675640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe6801120b0 con 0x7fe680102790 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685411640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680101de0 0x7fe6800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685411640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680101de0 0x7fe6800744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48586/0 (socket says 172.21.15.59:48586) 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685411640 1 -- 172.21.15.59:0/2054850530 learned_addr learned my addr 172.21.15.59:0/2054850530 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe684c10640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe680102790 0x7fe680074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685c12640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680106f10 0x7fe680074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685411640 1 -- 172.21.15.59:0/2054850530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe680102790 msgr2=0x7fe680074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685411640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe680102790 0x7fe680074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685411640 1 -- 172.21.15.59:0/2054850530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680106f10 msgr2=0x7fe680074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:59.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685411640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680106f10 0x7fe680074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685411640 1 -- 172.21.15.59:0/2054850530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6801a67d0 con 0x7fe680101de0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe685411640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680101de0 0x7fe6800744f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00c920 tx=0x7fe67c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.650+0000 7fe6767fc640 1 -- 172.21.15.59:0/2054850530 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c007c70 con 0x7fe680101de0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.651+0000 7fe6767fc640 1 -- 172.21.15.59:0/2054850530 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe67c007e10 con 0x7fe680101de0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.651+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6801a6ac0 con 0x7fe680101de0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.651+0000 7fe6767fc640 1 -- 172.21.15.59:0/2054850530 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c018890 con 0x7fe680101de0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.651+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6801a6fd0 con 0x7fe680101de0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.651+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6801021c0 con 0x7fe680101de0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.653+0000 7fe6767fc640 1 -- 172.21.15.59:0/2054850530 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe67c018a50 con 0x7fe680101de0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.653+0000 7fe6767fc640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe66c0a2b80 0x7fe66c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.654+0000 7fe684c10640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe66c0a2b80 0x7fe66c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.654+0000 7fe6767fc640 1 -- 172.21.15.59:0/2054850530 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fe67c0ceed0 con 0x7fe680101de0 2024-09-10T10:58:59.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.654+0000 7fe684c10640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe66c0a2b80 0x7fe66c0a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe670000c00 tx=0x7fe6700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:58:59.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.657+0000 7fe6767fc640 1 -- 172.21.15.59:0/2054850530 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe67c014030 con 0x7fe680101de0 2024-09-10T10:58:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.870+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe680075a20 con 0x7fe680101de0 2024-09-10T10:58:59.871 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:58:59.871 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:59.871 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:59.871 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:58:59.872 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:58:59.872 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:58:59.872 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:58:59.872 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: Deploying daemon mds.e on smithi115 2024-09-10T10:58:59.872 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.59:6836/138342907,v1:172.21.15.59:6837/138342907] up:boot 2024-09-10T10:58:59.872 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: fsmap 4 up:standby 2024-09-10T10:58:59.872 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:58:59 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:58:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.871+0000 7fe6767fc640 1 -- 172.21.15.59:0/2054850530 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fe67c09c360 con 0x7fe680101de0 2024-09-10T10:58:59.873 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:58:59.873 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"btime":"2024-09-10T10:58:59:200645+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T10:58:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 5 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe66c0a2b80 msgr2=0x7fe66c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe66c0a2b80 0x7fe66c0a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe670000c00 tx=0x7fe6700058d0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680101de0 msgr2=0x7fe6800744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680101de0 0x7fe6800744f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00c920 tx=0x7fe67c00cde0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 shutdown_connections 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe66c0a2b80 0x7fe66c0a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680106f10 0x7fe680074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe680102790 0x7fe680074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 --2- 172.21.15.59:0/2054850530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe680101de0 0x7fe6800744f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 >> 172.21.15.59:0/2054850530 conn(0x7fe6800fd8c0 msgr2=0x7fe6800febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 shutdown_connections 2024-09-10T10:58:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:58:59.873+0000 7fe687675640 1 -- 172.21.15.59:0/2054850530 wait complete. 2024-09-10T10:59:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:00.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:00.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:00.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:00.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:00.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:00.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: Deploying daemon mds.e on smithi115 2024-09-10T10:59:00.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.59:6836/138342907,v1:172.21.15.59:6837/138342907] up:boot 2024-09-10T10:59:00.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: fsmap 4 up:standby 2024-09-10T10:59:00.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:58:59 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:59:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: Deploying daemon mds.e on smithi115 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.59:6836/138342907,v1:172.21.15.59:6837/138342907] up:boot 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: fsmap 4 up:standby 2024-09-10T10:59:00.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:58:59 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:59:00.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:00 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2054850530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:00.959 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 10:59:00 smithi115 systemd[1]: Starting Ceph mds.e for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:59:01.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:00 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2054850530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:01.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:00 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2054850530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:01.282 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 10:59:01 smithi115 podman[64719]: 2024-09-10 10:59:00.919434288 +0000 UTC m=+0.015865677 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:59:01.282 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 10:59:01 smithi115 podman[64719]: 2024-09-10 10:59:01.028030065 +0000 UTC m=+0.124461449 container create 7dc7dcbb6de7b21c15e56892e771c61774d79bc85983d048012753b3c7ab26e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T10:59:01.282 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 10:59:01 smithi115 podman[64719]: 2024-09-10 10:59:01.255807308 +0000 UTC m=+0.352238699 container init 7dc7dcbb6de7b21c15e56892e771c61774d79bc85983d048012753b3c7ab26e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T10:59:01.282 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 10:59:01 smithi115 podman[64719]: 2024-09-10 10:59:01.258608529 +0000 UTC m=+0.355039921 container start 7dc7dcbb6de7b21c15e56892e771c61774d79bc85983d048012753b3c7ab26e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:59:01.708 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 10:59:01 smithi115 ceph-mds[64738]: -- 172.21.15.115:0/1522647143 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a94e911860 con 0x55a94e8ee800 2024-09-10T10:59:01.709 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 10:59:01 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e[64734]: starting mds.e at 2024-09-10T10:59:01.709 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 10:59:01 smithi115 bash[64719]: 7dc7dcbb6de7b21c15e56892e771c61774d79bc85983d048012753b3c7ab26e4 2024-09-10T10:59:01.709 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 10:59:01 smithi115 systemd[1]: Started Ceph mds.e for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:59:02.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:59:02.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:02.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:02.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:02.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:02.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:02.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:02.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:02.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: Deploying daemon mds.f on smithi181 2024-09-10T10:59:02.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.115:6834/3263764144,v1:172.21.15.115:6835/3263764144] up:boot 2024-09-10T10:59:02.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: fsmap 5 up:standby 2024-09-10T10:59:02.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:02 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:59:02.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:02.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:02.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:02.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:02.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:02.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:02.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:02.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: Deploying daemon mds.f on smithi181 2024-09-10T10:59:02.707 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.115:6834/3263764144,v1:172.21.15.115:6835/3263764144] up:boot 2024-09-10T10:59:02.707 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: fsmap 5 up:standby 2024-09-10T10:59:02.707 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:02 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:59:02.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:02.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:02.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:02.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:02.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:02.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:02.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:02.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: Deploying daemon mds.f on smithi181 2024-09-10T10:59:02.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.115:6834/3263764144,v1:172.21.15.115:6835/3263764144] up:boot 2024-09-10T10:59:02.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: fsmap 5 up:standby 2024-09-10T10:59:02.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:02 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:59:02.947 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:03.436 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 10:59:03 smithi181 systemd[1]: Starting Ceph mds.f for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:59:03.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.450+0000 7ff26096c640 1 -- 172.21.15.59:0/2282118786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c106a80 msgr2=0x7ff25c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:03.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.450+0000 7ff26096c640 1 --2- 172.21.15.59:0/2282118786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c106a80 0x7ff25c106e60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009930 tx=0x7ff24c02a420 comp rx=0 tx=0).stop 2024-09-10T10:59:03.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.450+0000 7ff26096c640 1 -- 172.21.15.59:0/2282118786 shutdown_connections 2024-09-10T10:59:03.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.450+0000 7ff26096c640 1 --2- 172.21.15.59:0/2282118786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff25c101420 0x7ff25c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:03.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.450+0000 7ff26096c640 1 --2- 172.21.15.59:0/2282118786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff25c100a80 0x7ff25c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.450+0000 7ff26096c640 1 --2- 172.21.15.59:0/2282118786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c106a80 0x7ff25c106e60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.450+0000 7ff26096c640 1 -- 172.21.15.59:0/2282118786 >> 172.21.15.59:0/2282118786 conn(0x7ff25c0fc7a0 msgr2=0x7ff25c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.450+0000 7ff26096c640 1 -- 172.21.15.59:0/2282118786 shutdown_connections 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.450+0000 7ff26096c640 1 -- 172.21.15.59:0/2282118786 wait complete. 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff26096c640 1 Processor -- start 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff26096c640 1 -- start start 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff26096c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c100a80 0x7ff25c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff26096c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff25c101420 0x7ff25c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff26096c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff25c106a80 0x7ff25c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff26096c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c111fa0 con 0x7ff25c100a80 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff26096c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c111e20 con 0x7ff25c106a80 2024-09-10T10:59:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff26096c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c112120 con 0x7ff25c101420 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff25a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c100a80 0x7ff25c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff25a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c100a80 0x7ff25c19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48612/0 (socket says 172.21.15.59:48612) 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff25a59c640 1 -- 172.21.15.59:0/57584483 learned_addr learned my addr 172.21.15.59:0/57584483 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff253fff640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff25c101420 0x7ff25c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff25ad9d640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff25c106a80 0x7ff25c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff25a59c640 1 -- 172.21.15.59:0/57584483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff25c101420 msgr2=0x7ff25c19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff25a59c640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff25c101420 0x7ff25c19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff25a59c640 1 -- 172.21.15.59:0/57584483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff25c106a80 msgr2=0x7ff25c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff25a59c640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff25c106a80 0x7ff25c19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.451+0000 7ff25a59c640 1 -- 172.21.15.59:0/57584483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c19f630 con 0x7ff25c100a80 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.452+0000 7ff25a59c640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c100a80 0x7ff25c19a680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009230 tx=0x7ff24c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.452+0000 7ff2537fe640 1 -- 172.21.15.59:0/57584483 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c03f030 con 0x7ff25c100a80 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.452+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c19f8c0 con 0x7ff25c100a80 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.452+0000 7ff2537fe640 1 -- 172.21.15.59:0/57584483 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff24c003ad0 con 0x7ff25c100a80 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.452+0000 7ff2537fe640 1 -- 172.21.15.59:0/57584483 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c035070 con 0x7ff25c100a80 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.452+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c1a7200 con 0x7ff25c100a80 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.453+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25c100ee0 con 0x7ff25c100a80 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.454+0000 7ff2537fe640 1 -- 172.21.15.59:0/57584483 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff24c042030 con 0x7ff25c100a80 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.455+0000 7ff2537fe640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2480a2b80 0x7ff2480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.455+0000 7ff253fff640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2480a2b80 0x7ff2480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.455+0000 7ff2537fe640 1 -- 172.21.15.59:0/57584483 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff24c0ef0a0 con 0x7ff25c100a80 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.455+0000 7ff253fff640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2480a2b80 0x7ff2480a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff25c10dbc0 tx=0x7ff24400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.459+0000 7ff2537fe640 1 -- 172.21.15.59:0/57584483 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff24c0bbdb0 con 0x7ff25c100a80 2024-09-10T10:59:03.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.670+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff25c1a73d0 con 0x7ff25c100a80 2024-09-10T10:59:03.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.670+0000 7ff2537fe640 1 -- 172.21.15.59:0/57584483 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7ff24c0c00b0 con 0x7ff25c100a80 2024-09-10T10:59:03.671 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:03.671 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"btime":"2024-09-10T10:59:01:775216+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T10:59:03.672 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2024-09-10T10:59:03.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2480a2b80 msgr2=0x7ff2480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:03.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2480a2b80 0x7ff2480a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff25c10dbc0 tx=0x7ff24400b390 comp rx=0 tx=0).stop 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c100a80 msgr2=0x7ff25c19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c100a80 0x7ff25c19a680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009230 tx=0x7ff24c004270 comp rx=0 tx=0).stop 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 shutdown_connections 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2480a2b80 0x7ff2480a5040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff25c106a80 0x7ff25c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff25c101420 0x7ff25c19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 --2- 172.21.15.59:0/57584483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff25c100a80 0x7ff25c19a680 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 >> 172.21.15.59:0/57584483 conn(0x7ff25c0fc7a0 msgr2=0x7ff25c10c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 shutdown_connections 2024-09-10T10:59:03.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:03.673+0000 7ff26096c640 1 -- 172.21.15.59:0/57584483 wait complete. 2024-09-10T10:59:03.769 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 10:59:03 smithi181 podman[65689]: 2024-09-10 10:59:03.416175399 +0000 UTC m=+0.016182806 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:59:03.769 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 10:59:03 smithi181 podman[65689]: 2024-09-10 10:59:03.541007652 +0000 UTC m=+0.141015048 container create 8c4d874877d802afc41098e127015f1419586ff398fe1366ca9e1873985f5bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T10:59:04.186 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 10:59:03 smithi181 podman[65689]: 2024-09-10 10:59:03.768566401 +0000 UTC m=+0.368573796 container init 8c4d874877d802afc41098e127015f1419586ff398fe1366ca9e1873985f5bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T10:59:04.186 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 10:59:03 smithi181 podman[65689]: 2024-09-10 10:59:03.771537637 +0000 UTC m=+0.371545034 container start 8c4d874877d802afc41098e127015f1419586ff398fe1366ca9e1873985f5bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T10:59:04.187 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 10:59:03 smithi181 ceph-mds[65708]: -- 172.21.15.181:0/2570866524 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633e1d8d860 con 0x5633e1d6b000 2024-09-10T10:59:04.187 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 10:59:03 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f[65704]: starting mds.f at 2024-09-10T10:59:04.187 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 10:59:03 smithi181 bash[65689]: 8c4d874877d802afc41098e127015f1419586ff398fe1366ca9e1873985f5bfd 2024-09-10T10:59:04.187 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 10:59:03 smithi181 systemd[1]: Started Ceph mds.f for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:59:04.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:04 smithi059 ceph-mon[30978]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:04.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:04 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/57584483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:04.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:04 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:04.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:04 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:04.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:04 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:04.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:04 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:04.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:04 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:04.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:04 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:04.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:04 smithi181 ceph-mon[35409]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:04.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:04 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/57584483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:04.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:04 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:04.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:04 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:04.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:04 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:04.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:04 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:04.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:04 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:04.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:04 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:04.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:04 smithi115 ceph-mon[34719]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:04.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:04 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/57584483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:04.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:04 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:04 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:04 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:04 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:04 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:04.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:04 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:05.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:05 smithi181 ceph-mon[35409]: Deploying daemon mds.c on smithi181 2024-09-10T10:59:05.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:05 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.181:6834/3551536786,v1:172.21.15.181:6835/3551536786] up:boot 2024-09-10T10:59:05.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:05 smithi181 ceph-mon[35409]: fsmap 6 up:standby 2024-09-10T10:59:05.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:05 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:59:05.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:05 smithi115 ceph-mon[34719]: Deploying daemon mds.c on smithi181 2024-09-10T10:59:05.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:05 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.181:6834/3551536786,v1:172.21.15.181:6835/3551536786] up:boot 2024-09-10T10:59:05.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:05 smithi115 ceph-mon[34719]: fsmap 6 up:standby 2024-09-10T10:59:05.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:05 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:59:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:05 smithi059 ceph-mon[30978]: Deploying daemon mds.c on smithi181 2024-09-10T10:59:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:05 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.181:6834/3551536786,v1:172.21.15.181:6835/3551536786] up:boot 2024-09-10T10:59:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:05 smithi059 ceph-mon[30978]: fsmap 6 up:standby 2024-09-10T10:59:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:05 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:59:06.156 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 10:59:05 smithi181 systemd[1]: Starting Ceph mds.c for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:59:06.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:59:06.422 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 10:59:06 smithi181 podman[65991]: 2024-09-10 10:59:06.05771235 +0000 UTC m=+0.016048284 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:59:06.422 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 10:59:06 smithi181 podman[65991]: 2024-09-10 10:59:06.178624337 +0000 UTC m=+0.136960276 container create 4c5c205ff79184a8dfae3031b19eba7de6db7b30b84162e6e0fb2b413fd1f833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T10:59:06.661 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:06.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:06 smithi181 ceph-mon[35409]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:06.687 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 10:59:06 smithi181 podman[65991]: 2024-09-10 10:59:06.46516481 +0000 UTC m=+0.423500744 container init 4c5c205ff79184a8dfae3031b19eba7de6db7b30b84162e6e0fb2b413fd1f833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:59:06.687 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 10:59:06 smithi181 podman[65991]: 2024-09-10 10:59:06.468146419 +0000 UTC m=+0.426482359 container start 4c5c205ff79184a8dfae3031b19eba7de6db7b30b84162e6e0fb2b413fd1f833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T10:59:06.687 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 10:59:06 smithi181 ceph-mds[66010]: -- 172.21.15.181:0/758047499 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55566aaaf860 con 0x55566aa8d000 2024-09-10T10:59:06.687 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 10:59:06 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c[66006]: starting mds.c at 2024-09-10T10:59:06.687 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 10:59:06 smithi181 bash[65991]: 4c5c205ff79184a8dfae3031b19eba7de6db7b30b84162e6e0fb2b413fd1f833 2024-09-10T10:59:06.687 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 10:59:06 smithi181 systemd[1]: Started Ceph mds.c for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:59:06.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:06 smithi115 ceph-mon[34719]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:06.783 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:06 smithi059 ceph-mon[30978]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 -- 172.21.15.59:0/3544503708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77e0102ef0 msgr2=0x7f77e010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 --2- 172.21.15.59:0/3544503708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77e0102ef0 0x7f77e010da40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009cd0 tx=0x7f77d802a980 comp rx=0 tx=0).stop 2024-09-10T10:59:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 -- 172.21.15.59:0/3544503708 shutdown_connections 2024-09-10T10:59:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 --2- 172.21.15.59:0/3544503708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77e0102ef0 0x7f77e010da40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 --2- 172.21.15.59:0/3544503708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e0102570 0x7f77e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 --2- 172.21.15.59:0/3544503708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0100e20 0x7f77e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 -- 172.21.15.59:0/3544503708 >> 172.21.15.59:0/3544503708 conn(0x7f77e00fc7d0 msgr2=0x7f77e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 -- 172.21.15.59:0/3544503708 shutdown_connections 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 -- 172.21.15.59:0/3544503708 wait complete. 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 Processor -- start 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.170+0000 7f77e70c8640 1 -- start start 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e70c8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77e0100e20 0x7f77e0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e70c8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e0102570 0x7f77e0198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e70c8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0102ef0 0x7f77e019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e70c8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0110f80 con 0x7f77e0102ef0 2024-09-10T10:59:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e70c8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0110e00 con 0x7f77e0102570 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e70c8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0111100 con 0x7f77e0100e20 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e5665640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0102ef0 0x7f77e019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e5665640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0102ef0 0x7f77e019ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34098/0 (socket says 172.21.15.59:34098) 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e5665640 1 -- 172.21.15.59:0/2132819412 learned_addr learned my addr 172.21.15.59:0/2132819412 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77dffff640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e0102570 0x7f77e0198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e4e64640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77e0100e20 0x7f77e0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e5665640 1 -- 172.21.15.59:0/2132819412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77e0100e20 msgr2=0x7f77e0198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e5665640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77e0100e20 0x7f77e0198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e5665640 1 -- 172.21.15.59:0/2132819412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e0102570 msgr2=0x7f77e0198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e5665640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e0102570 0x7f77e0198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e5665640 1 -- 172.21.15.59:0/2132819412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e019d4e0 con 0x7f77e0102ef0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77dffff640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e0102570 0x7f77e0198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77e5665640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0102ef0 0x7f77e019ce00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009ca0 tx=0x7f77d802f620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.171+0000 7f77ddffb640 1 -- 172.21.15.59:0/2132819412 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8034040 con 0x7f77e0102ef0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.172+0000 7f77ddffb640 1 -- 172.21.15.59:0/2132819412 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77d8003e50 con 0x7f77e0102ef0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.172+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e019d770 con 0x7f77e0102ef0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.172+0000 7f77ddffb640 1 -- 172.21.15.59:0/2132819412 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8004670 con 0x7f77e0102ef0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.172+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e01a50b0 con 0x7f77e0102ef0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.173+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e0101200 con 0x7f77e0102ef0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.174+0000 7f77ddffb640 1 -- 172.21.15.59:0/2132819412 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f77d8037020 con 0x7f77e0102ef0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.175+0000 7f77ddffb640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f77d00a2c00 0x7f77d00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.175+0000 7f77e4e64640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f77d00a2c00 0x7f77d00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.175+0000 7f77ddffb640 1 -- 172.21.15.59:0/2132819412 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f77d80efa40 con 0x7f77e0102ef0 2024-09-10T10:59:07.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.175+0000 7f77e4e64640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f77d00a2c00 0x7f77d00a50c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77d40095f0 tx=0x7f77d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:07.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.178+0000 7f77ddffb640 1 -- 172.21.15.59:0/2132819412 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77d80bce40 con 0x7f77e0102ef0 2024-09-10T10:59:07.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.392+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77e0199890 con 0x7f77e0102ef0 2024-09-10T10:59:07.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.393+0000 7f77ddffb640 1 -- 172.21.15.59:0/2132819412 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7f77e0199890 con 0x7f77e0102ef0 2024-09-10T10:59:07.394 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:07.394 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"btime":"2024-09-10T10:59:04:406929+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T10:59:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f77d00a2c00 msgr2=0x7f77d00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f77d00a2c00 0x7f77d00a50c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77d40095f0 tx=0x7f77d4005f90 comp rx=0 tx=0).stop 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0102ef0 msgr2=0x7f77e019ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0102ef0 0x7f77e019ce00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009ca0 tx=0x7f77d802f620 comp rx=0 tx=0).stop 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 shutdown_connections 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f77d00a2c00 0x7f77d00a50c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e0102ef0 0x7f77e019ce00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e0102570 0x7f77e0198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 --2- 172.21.15.59:0/2132819412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77e0100e20 0x7f77e0198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 >> 172.21.15.59:0/2132819412 conn(0x7f77e00fc7d0 msgr2=0x7f77e006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 shutdown_connections 2024-09-10T10:59:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:07.395+0000 7f77e70c8640 1 -- 172.21.15.59:0/2132819412 wait complete. 2024-09-10T10:59:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: Deploying daemon mds.h on smithi115 2024-09-10T10:59:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2132819412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.181:6836/4124427529,v1:172.21.15.181:6837/4124427529] up:boot 2024-09-10T10:59:07.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: fsmap 7 up:standby 2024-09-10T10:59:07.889 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:07 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:59:07.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:07.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: Deploying daemon mds.h on smithi115 2024-09-10T10:59:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2132819412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.181:6836/4124427529,v1:172.21.15.181:6837/4124427529] up:boot 2024-09-10T10:59:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: fsmap 7 up:standby 2024-09-10T10:59:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:07 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:59:07.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:07.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:07.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:07.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:07.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: Deploying daemon mds.h on smithi115 2024-09-10T10:59:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2132819412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.181:6836/4124427529,v1:172.21.15.181:6837/4124427529] up:boot 2024-09-10T10:59:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: fsmap 7 up:standby 2024-09-10T10:59:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:07 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:59:08.893 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:08 smithi115 ceph-mon[34719]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:08.893 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 10:59:08 smithi115 systemd[1]: Starting Ceph mds.h for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:59:08.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:08 smithi181 ceph-mon[35409]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:09.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:08 smithi059 ceph-mon[30978]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:09.154 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 10:59:08 smithi115 podman[65020]: 2024-09-10 10:59:08.794873904 +0000 UTC m=+0.015988067 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:59:09.154 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 10:59:08 smithi115 podman[65020]: 2024-09-10 10:59:08.908861979 +0000 UTC m=+0.129976175 container create ded43844aba23b0f893472e34fdaf9064e564afab34c73c0e9f825882334c8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T10:59:09.154 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 10:59:09 smithi115 podman[65020]: 2024-09-10 10:59:09.15342401 +0000 UTC m=+0.374538161 container init ded43844aba23b0f893472e34fdaf9064e564afab34c73c0e9f825882334c8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T10:59:09.458 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 10:59:09 smithi115 podman[65020]: 2024-09-10 10:59:09.156249328 +0000 UTC m=+0.377363480 container start ded43844aba23b0f893472e34fdaf9064e564afab34c73c0e9f825882334c8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T10:59:09.458 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 10:59:09 smithi115 ceph-mds[65039]: -- 172.21.15.115:0/3882408807 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c2e9f7860 con 0x556c2e9d5400 2024-09-10T10:59:09.458 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 10:59:09 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h[65035]: starting mds.h at 2024-09-10T10:59:09.458 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 10:59:09 smithi115 bash[65020]: ded43844aba23b0f893472e34fdaf9064e564afab34c73c0e9f825882334c8b7 2024-09-10T10:59:09.459 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 10:59:09 smithi115 systemd[1]: Started Ceph mds.h for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:59:10.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:59:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:10.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: Deploying daemon mds.i on smithi181 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] up:boot 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: fsmap 8 up:standby 2024-09-10T10:59:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:10 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:59:10.565 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:10.565 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:10.565 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:10.565 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:10.565 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:10.565 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:10.565 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:10.565 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: Deploying daemon mds.i on smithi181 2024-09-10T10:59:10.566 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] up:boot 2024-09-10T10:59:10.566 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: fsmap 8 up:standby 2024-09-10T10:59:10.566 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:10 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:59:10.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:10.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:10.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:10.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: Deploying daemon mds.i on smithi181 2024-09-10T10:59:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] up:boot 2024-09-10T10:59:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: fsmap 8 up:standby 2024-09-10T10:59:10.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:10 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:59:10.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 -- 172.21.15.59:0/1366952434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688102570 msgr2=0x7fa6881029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 --2- 172.21.15.59:0/1366952434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688102570 0x7fa6881029b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009900 tx=0x7fa67c02a480 comp rx=0 tx=0).stop 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 -- 172.21.15.59:0/1366952434 shutdown_connections 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 --2- 172.21.15.59:0/1366952434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa688102ef0 0x7fa68810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 --2- 172.21.15.59:0/1366952434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688102570 0x7fa6881029b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 --2- 172.21.15.59:0/1366952434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa688100e20 0x7fa688101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 -- 172.21.15.59:0/1366952434 >> 172.21.15.59:0/1366952434 conn(0x7fa6880fc7d0 msgr2=0x7fa6880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 -- 172.21.15.59:0/1366952434 shutdown_connections 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 -- 172.21.15.59:0/1366952434 wait complete. 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.819+0000 7fa68df74640 1 Processor -- start 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa68df74640 1 -- start start 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa68df74640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688100e20 0x7fa6880fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:10.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa68df74640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa688102570 0x7fa6880fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa68df74640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa688102ef0 0x7fa6880fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa68df74640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa688110f50 con 0x7fa688100e20 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa68df74640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa688110dd0 con 0x7fa688102570 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa68df74640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa6881110d0 con 0x7fa688102ef0 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa6877fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688100e20 0x7fa6880fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa6877fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688100e20 0x7fa6880fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34126/0 (socket says 172.21.15.59:34126) 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa6877fe640 1 -- 172.21.15.59:0/2257088908 learned_addr learned my addr 172.21.15.59:0/2257088908 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa687fff640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa688102ef0 0x7fa6880fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa686ffd640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa688102570 0x7fa6880fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa6877fe640 1 -- 172.21.15.59:0/2257088908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa688102ef0 msgr2=0x7fa6880fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa6877fe640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa688102ef0 0x7fa6880fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa6877fe640 1 -- 172.21.15.59:0/2257088908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa688102570 msgr2=0x7fa6880fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:10.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa6877fe640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa688102570 0x7fa6880fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa6877fe640 1 -- 172.21.15.59:0/2257088908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6881a6940 con 0x7fa688100e20 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa687fff640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa688102ef0 0x7fa6880fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.820+0000 7fa6877fe640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688100e20 0x7fa6880fcc80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c920 tx=0x7fa67800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.821+0000 7fa684ff9640 1 -- 172.21.15.59:0/2257088908 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678007c70 con 0x7fa688100e20 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.821+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6881a6c30 con 0x7fa688100e20 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.821+0000 7fa684ff9640 1 -- 172.21.15.59:0/2257088908 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa678007e10 con 0x7fa688100e20 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.821+0000 7fa684ff9640 1 -- 172.21.15.59:0/2257088908 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678018890 con 0x7fa688100e20 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.821+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6881a7170 con 0x7fa688100e20 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.822+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa688101200 con 0x7fa688100e20 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.823+0000 7fa684ff9640 1 -- 172.21.15.59:0/2257088908 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa678018a70 con 0x7fa688100e20 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.823+0000 7fa684ff9640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6700a2b80 0x7fa6700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.824+0000 7fa686ffd640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6700a2b80 0x7fa6700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:10.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.824+0000 7fa684ff9640 1 -- 172.21.15.59:0/2257088908 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fa6780cee40 con 0x7fa688100e20 2024-09-10T10:59:10.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.824+0000 7fa686ffd640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6700a2b80 0x7fa6700a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa6880fe440 tx=0x7fa67c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:10.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:10.828+0000 7fa684ff9640 1 -- 172.21.15.59:0/2257088908 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa678014030 con 0x7fa688100e20 2024-09-10T10:59:11.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.039+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa68802d7c0 con 0x7fa688100e20 2024-09-10T10:59:11.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.039+0000 7fa684ff9640 1 -- 172.21.15.59:0/2257088908 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7219 (secure 0 0 0) 0x7fa67800de20 con 0x7fa688100e20 2024-09-10T10:59:11.041 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:11.041 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"btime":"2024-09-10T10:59:09:641080+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T10:59:11.042 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-09-10T10:59:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6700a2b80 msgr2=0x7fa6700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:11.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6700a2b80 0x7fa6700a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa6880fe440 tx=0x7fa67c005a20 comp rx=0 tx=0).stop 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688100e20 msgr2=0x7fa6880fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688100e20 0x7fa6880fcc80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c920 tx=0x7fa67800cde0 comp rx=0 tx=0).stop 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 shutdown_connections 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6700a2b80 0x7fa6700a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa688102ef0 0x7fa6880fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa688102570 0x7fa6880fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 --2- 172.21.15.59:0/2257088908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa688100e20 0x7fa6880fcc80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 >> 172.21.15.59:0/2257088908 conn(0x7fa6880fc7d0 msgr2=0x7fa68806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 shutdown_connections 2024-09-10T10:59:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:11.042+0000 7fa68df74640 1 -- 172.21.15.59:0/2257088908 wait complete. 2024-09-10T10:59:11.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:11 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2257088908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:11.437 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 10:59:11 smithi181 systemd[1]: Starting Ceph mds.i for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:59:11.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:11 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2257088908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:11.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:11 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2257088908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:11.895 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 10:59:11 smithi181 podman[66289]: 2024-09-10 10:59:11.472682442 +0000 UTC m=+0.016080304 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:59:11.896 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 10:59:11 smithi181 podman[66289]: 2024-09-10 10:59:11.617434416 +0000 UTC m=+0.160832274 container create aa81da2952fd7d059582cd67bc508b8e368df8ad6d339b14b73f1cb968520171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T10:59:11.896 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 10:59:11 smithi181 podman[66289]: 2024-09-10 10:59:11.894902929 +0000 UTC m=+0.438300789 container init aa81da2952fd7d059582cd67bc508b8e368df8ad6d339b14b73f1cb968520171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-10T10:59:12.186 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 10:59:11 smithi181 podman[66289]: 2024-09-10 10:59:11.897734701 +0000 UTC m=+0.441132560 container start aa81da2952fd7d059582cd67bc508b8e368df8ad6d339b14b73f1cb968520171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T10:59:12.187 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 10:59:11 smithi181 ceph-mds[66308]: -- 172.21.15.181:0/96442792 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5654d91ef860 con 0x5654d91cd400 2024-09-10T10:59:12.187 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 10:59:11 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i[66304]: starting mds.i at 2024-09-10T10:59:12.187 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 10:59:11 smithi181 bash[66289]: aa81da2952fd7d059582cd67bc508b8e368df8ad6d339b14b73f1cb968520171 2024-09-10T10:59:12.187 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 10:59:11 smithi181 systemd[1]: Started Ceph mds.i for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:59:12.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:12 smithi059 ceph-mon[30978]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:12.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:12.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:12.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:12.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:12.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:12.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:12 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:12.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:12 smithi181 ceph-mon[35409]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:12.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:12.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:12.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:12.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:12.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:12.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:12 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:12.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:12 smithi115 ceph-mon[34719]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:12.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:12.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:12.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:12.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:12.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:12.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:12 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:13.597 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:13 smithi059 ceph-mon[30978]: Deploying daemon mds.g on smithi059 2024-09-10T10:59:13.598 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:13 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] up:boot 2024-09-10T10:59:13.598 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:13 smithi059 ceph-mon[30978]: fsmap 9 up:standby 2024-09-10T10:59:13.598 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:13 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:59:13.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:13 smithi181 ceph-mon[35409]: Deploying daemon mds.g on smithi059 2024-09-10T10:59:13.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:13 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] up:boot 2024-09-10T10:59:13.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:13 smithi181 ceph-mon[35409]: fsmap 9 up:standby 2024-09-10T10:59:13.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:13 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:59:13.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:13 smithi115 ceph-mon[34719]: Deploying daemon mds.g on smithi059 2024-09-10T10:59:13.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:13 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] up:boot 2024-09-10T10:59:13.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:13 smithi115 ceph-mon[34719]: fsmap 9 up:standby 2024-09-10T10:59:13.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:13 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:59:13.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:59:14.136 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:14.138 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 10:59:14 smithi059 systemd[1]: Starting Ceph mds.g for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:59:14.569 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:14 smithi059 ceph-mon[30978]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:14.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:14 smithi181 ceph-mon[35409]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.652+0000 7efe331a2640 1 -- 172.21.15.59:0/3146642624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 msgr2=0x7efe2c101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.652+0000 7efe331a2640 1 --2- 172.21.15.59:0/3146642624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 0x7efe2c101e40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009930 tx=0x7efe1c02a420 comp rx=0 tx=0).stop 2024-09-10T10:59:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.653+0000 7efe331a2640 1 -- 172.21.15.59:0/3146642624 shutdown_connections 2024-09-10T10:59:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.653+0000 7efe331a2640 1 --2- 172.21.15.59:0/3146642624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe2c102380 0x7efe2c10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.653+0000 7efe331a2640 1 --2- 172.21.15.59:0/3146642624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 0x7efe2c101e40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.653+0000 7efe331a2640 1 --2- 172.21.15.59:0/3146642624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2c107af0 0x7efe2c107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.653+0000 7efe331a2640 1 -- 172.21.15.59:0/3146642624 >> 172.21.15.59:0/3146642624 conn(0x7efe2c0fd700 msgr2=0x7efe2c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.653+0000 7efe331a2640 1 -- 172.21.15.59:0/3146642624 shutdown_connections 2024-09-10T10:59:14.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.653+0000 7efe331a2640 1 -- 172.21.15.59:0/3146642624 wait complete. 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.653+0000 7efe331a2640 1 Processor -- start 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.653+0000 7efe331a2640 1 -- start start 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe331a2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 0x7efe2c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe331a2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe2c102380 0x7efe2c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe331a2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2c107af0 0x7efe2c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe331a2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c111f90 con 0x7efe2c1019e0 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe331a2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c111e10 con 0x7efe2c102380 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe331a2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c112110 con 0x7efe2c107af0 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe321a0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 0x7efe2c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe321a0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 0x7efe2c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34144/0 (socket says 172.21.15.59:34144) 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe321a0640 1 -- 172.21.15.59:0/1817468354 learned_addr learned my addr 172.21.15.59:0/1817468354 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe3199f640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe2c102380 0x7efe2c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe329a1640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2c107af0 0x7efe2c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe321a0640 1 -- 172.21.15.59:0/1817468354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2c107af0 msgr2=0x7efe2c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:14.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe321a0640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2c107af0 0x7efe2c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe321a0640 1 -- 172.21.15.59:0/1817468354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe2c102380 msgr2=0x7efe2c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe321a0640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe2c102380 0x7efe2c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe321a0640 1 -- 172.21.15.59:0/1817468354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2c1a69b0 con 0x7efe2c1019e0 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe3199f640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe2c102380 0x7efe2c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.654+0000 7efe321a0640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 0x7efe2c0744f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe2800b4a0 tx=0x7efe2800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.655+0000 7efe237fe640 1 -- 172.21.15.59:0/1817468354 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28014070 con 0x7efe2c1019e0 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.655+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2c1a6ca0 con 0x7efe2c1019e0 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.655+0000 7efe237fe640 1 -- 172.21.15.59:0/1817468354 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe28010af0 con 0x7efe2c1019e0 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.655+0000 7efe237fe640 1 -- 172.21.15.59:0/1817468354 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28017d10 con 0x7efe2c1019e0 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.655+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2c1a71b0 con 0x7efe2c1019e0 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.656+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe2c101ec0 con 0x7efe2c1019e0 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.657+0000 7efe237fe640 1 -- 172.21.15.59:0/1817468354 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efe28017070 con 0x7efe2c1019e0 2024-09-10T10:59:14.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.658+0000 7efe237fe640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efe180a2b80 0x7efe180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:14.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.658+0000 7efe3199f640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efe180a2b80 0x7efe180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:14.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.658+0000 7efe237fe640 1 -- 172.21.15.59:0/1817468354 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7efe280ce3b0 con 0x7efe2c1019e0 2024-09-10T10:59:14.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.658+0000 7efe3199f640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efe180a2b80 0x7efe180a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efe1c000c00 tx=0x7efe1c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:14.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.661+0000 7efe237fe640 1 -- 172.21.15.59:0/1817468354 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe2809b7b0 con 0x7efe2c1019e0 2024-09-10T10:59:14.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:14 smithi115 ceph-mon[34719]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:14.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.876+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe2c103120 con 0x7efe2c1019e0 2024-09-10T10:59:14.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.876+0000 7efe237fe640 1 -- 172.21.15.59:0/1817468354 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8046 (secure 0 0 0) 0x7efe2809b0b0 con 0x7efe2c1019e0 2024-09-10T10:59:14.877 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:14.877 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":10,"btime":"2024-09-10T10:59:12:308952+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T10:59:14.878 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 10 2024-09-10T10:59:14.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efe180a2b80 msgr2=0x7efe180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:14.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efe180a2b80 0x7efe180a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efe1c000c00 tx=0x7efe1c005a20 comp rx=0 tx=0).stop 2024-09-10T10:59:14.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 msgr2=0x7efe2c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:14.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 0x7efe2c0744f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe2800b4a0 tx=0x7efe2800b960 comp rx=0 tx=0).stop 2024-09-10T10:59:14.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 shutdown_connections 2024-09-10T10:59:14.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efe180a2b80 0x7efe180a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:14.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe2c107af0 0x7efe2c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:14.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe2c102380 0x7efe2c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:14.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 --2- 172.21.15.59:0/1817468354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe2c1019e0 0x7efe2c0744f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:14.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 >> 172.21.15.59:0/1817468354 conn(0x7efe2c0fd700 msgr2=0x7efe2c0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:14.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 shutdown_connections 2024-09-10T10:59:14.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:14.879+0000 7efe331a2640 1 -- 172.21.15.59:0/1817468354 wait complete. 2024-09-10T10:59:15.138 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 10:59:14 smithi059 podman[69160]: 2024-09-10 10:59:14.792756666 +0000 UTC m=+0.346396166 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:59:15.138 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 10:59:14 smithi059 podman[69160]: 2024-09-10 10:59:14.923077659 +0000 UTC m=+0.476717158 container create 8a47b092f746c618d9fe4e658c2615fe9ab0308eec387eb67d53f6a07366f82d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:59:15.627 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:15 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1817468354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:15.627 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 10:59:15 smithi059 podman[69160]: 2024-09-10 10:59:15.214773333 +0000 UTC m=+0.768412840 container init 8a47b092f746c618d9fe4e658c2615fe9ab0308eec387eb67d53f6a07366f82d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T10:59:15.627 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 10:59:15 smithi059 podman[69160]: 2024-09-10 10:59:15.217811637 +0000 UTC m=+0.771451134 container start 8a47b092f746c618d9fe4e658c2615fe9ab0308eec387eb67d53f6a07366f82d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T10:59:15.628 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 10:59:15 smithi059 ceph-mds[69213]: -- 172.21.15.59:0/3644780909 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ffb65f860 con 0x563ffb63c800 2024-09-10T10:59:15.628 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 10:59:15 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-g[69209]: starting mds.g at 2024-09-10T10:59:15.628 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 10:59:15 smithi059 bash[69160]: 8a47b092f746c618d9fe4e658c2615fe9ab0308eec387eb67d53f6a07366f82d 2024-09-10T10:59:15.628 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 10:59:15 smithi059 systemd[1]: Started Ceph mds.g for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:59:15.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:15 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1817468354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:15.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:15 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1817468354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:16.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:16.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.59:6838/1687951839,v1:172.21.15.59:6839/1687951839] up:boot 2024-09-10T10:59:16.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: fsmap 10 up:standby 2024-09-10T10:59:16.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:59:16.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:16.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:16.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:16.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:16.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:16.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:16.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:16 smithi059 ceph-mon[30978]: Deploying daemon mds.a on smithi059 2024-09-10T10:59:16.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:16.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.59:6838/1687951839,v1:172.21.15.59:6839/1687951839] up:boot 2024-09-10T10:59:16.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: fsmap 10 up:standby 2024-09-10T10:59:16.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:59:16.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:16.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:16.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:16.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:16.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:16.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:16.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:16 smithi181 ceph-mon[35409]: Deploying daemon mds.a on smithi059 2024-09-10T10:59:16.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:16.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.59:6838/1687951839,v1:172.21.15.59:6839/1687951839] up:boot 2024-09-10T10:59:16.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: fsmap 10 up:standby 2024-09-10T10:59:16.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:59:16.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:16.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:16.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:16.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:16.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:16.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:16.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:16 smithi115 ceph-mon[34719]: Deploying daemon mds.a on smithi059 2024-09-10T10:59:17.864 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 10:59:17 smithi059 systemd[1]: Starting Ceph mds.a for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T10:59:17.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:59:18.137 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 10:59:17 smithi059 podman[69499]: 2024-09-10 10:59:17.812771607 +0000 UTC m=+0.016771313 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:59:18.138 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 10:59:17 smithi059 podman[69499]: 2024-09-10 10:59:17.929171543 +0000 UTC m=+0.133171280 container create c7177cafb17be9b25e53fc4425237901383683c2512f8a9335287b57ff9e7e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T10:59:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:18.459 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:18 smithi059 ceph-mon[30978]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:18.459 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 10:59:18 smithi059 podman[69499]: 2024-09-10 10:59:18.198574088 +0000 UTC m=+0.402573783 container init c7177cafb17be9b25e53fc4425237901383683c2512f8a9335287b57ff9e7e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T10:59:18.459 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 10:59:18 smithi059 podman[69499]: 2024-09-10 10:59:18.201731751 +0000 UTC m=+0.405731458 container start c7177cafb17be9b25e53fc4425237901383683c2512f8a9335287b57ff9e7e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T10:59:18.459 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 10:59:18 smithi059 ceph-mds[69549]: -- 172.21.15.59:0/365447442 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b38706b860 con 0x55b387048800 2024-09-10T10:59:18.459 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 10:59:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a[69532]: starting mds.a at 2024-09-10T10:59:18.459 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 10:59:18 smithi059 bash[69499]: c7177cafb17be9b25e53fc4425237901383683c2512f8a9335287b57ff9e7e31 2024-09-10T10:59:18.459 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 10:59:18 smithi059 systemd[1]: Started Ceph mds.a for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:59:18.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:18 smithi181 ceph-mon[35409]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:18.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:18 smithi115 ceph-mon[34719]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:18.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.944+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2505181867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 msgr2=0x7f3f34106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.944+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2505181867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 0x7f3f34106f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009900 tx=0x7f3f2402a410 comp rx=0 tx=0).stop 2024-09-10T10:59:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2505181867 shutdown_connections 2024-09-10T10:59:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2505181867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f34100a70 0x7f3f3410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2505181867 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f341000d0 0x7f3f34100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2505181867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 0x7f3f34106f80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2505181867 >> 172.21.15.59:0/2505181867 conn(0x7f3f34077210 msgr2=0x7f3f340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2505181867 shutdown_connections 2024-09-10T10:59:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2505181867 wait complete. 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 Processor -- start 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 -- start start 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f341000d0 0x7f3f34198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f34100a70 0x7f3f34198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 0x7f3f3419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34112090 con 0x7f3f34106ba0 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34111f10 con 0x7f3f34100a70 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.945+0000 7f3f3a88e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34112210 con 0x7f3f341000d0 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f38e2b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 0x7f3f3419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f38e2b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 0x7f3f3419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36746/0 (socket says 172.21.15.59:36746) 2024-09-10T10:59:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f2bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f34100a70 0x7f3f34198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f38e2b640 1 -- 172.21.15.59:0/2228892635 learned_addr learned my addr 172.21.15.59:0/2228892635 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f33fff640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f341000d0 0x7f3f34198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f38e2b640 1 -- 172.21.15.59:0/2228892635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f341000d0 msgr2=0x7f3f34198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f38e2b640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f341000d0 0x7f3f34198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f38e2b640 1 -- 172.21.15.59:0/2228892635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f34100a70 msgr2=0x7f3f34198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f38e2b640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f34100a70 0x7f3f34198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f38e2b640 1 -- 172.21.15.59:0/2228892635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3419d480 con 0x7f3f34106ba0 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f38e2b640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 0x7f3f3419cda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00eb10 tx=0x7f3f2c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f31ffb640 1 -- 172.21.15.59:0/2228892635 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c004b20 con 0x7f3f34106ba0 2024-09-10T10:59:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3419d770 con 0x7f3f34106ba0 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f31ffb640 1 -- 172.21.15.59:0/2228892635 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f2c004cc0 con 0x7f3f34106ba0 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f31ffb640 1 -- 172.21.15.59:0/2228892635 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c010760 con 0x7f3f34106ba0 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.946+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f341a5050 con 0x7f3f34106ba0 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.947+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f34100530 con 0x7f3f34106ba0 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.948+0000 7f3f31ffb640 1 -- 172.21.15.59:0/2228892635 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3f2c005020 con 0x7f3f34106ba0 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.949+0000 7f3f31ffb640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3f200a2b80 0x7f3f200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.949+0000 7f3f33fff640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3f200a2b80 0x7f3f200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.949+0000 7f3f31ffb640 1 -- 172.21.15.59:0/2228892635 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f3f2c0cf2e0 con 0x7f3f34106ba0 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.950+0000 7f3f33fff640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3f200a2b80 0x7f3f200a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009230 tx=0x7f3f240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:18.953+0000 7f3f31ffb640 1 -- 172.21.15.59:0/2228892635 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f2c09c640 con 0x7f3f34106ba0 2024-09-10T10:59:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.164+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f34109b00 con 0x7f3f34106ba0 2024-09-10T10:59:19.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.164+0000 7f3f31ffb640 1 -- 172.21.15.59:0/2228892635 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7f3f2c09bf40 con 0x7f3f34106ba0 2024-09-10T10:59:19.166 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:19.166 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":12,"btime":"2024-09-10T10:59:18:328196+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T10:59:19.166 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 12 2024-09-10T10:59:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3f200a2b80 msgr2=0x7f3f200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3f200a2b80 0x7f3f200a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009230 tx=0x7f3f240058d0 comp rx=0 tx=0).stop 2024-09-10T10:59:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 msgr2=0x7f3f3419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 0x7f3f3419cda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00eb10 tx=0x7f3f2c00c2d0 comp rx=0 tx=0).stop 2024-09-10T10:59:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 shutdown_connections 2024-09-10T10:59:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3f200a2b80 0x7f3f200a5040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34106ba0 0x7f3f3419cda0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f34100a70 0x7f3f34198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 --2- 172.21.15.59:0/2228892635 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f341000d0 0x7f3f34198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:19.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.166+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 >> 172.21.15.59:0/2228892635 conn(0x7f3f34077210 msgr2=0x7f3f340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:19.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.167+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 shutdown_connections 2024-09-10T10:59:19.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:19.167+0000 7f3f3a88e640 1 -- 172.21.15.59:0/2228892635 wait complete. 2024-09-10T10:59:19.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.59:6840/2789106247,v1:172.21.15.59:6841/2789106247] up:boot 2024-09-10T10:59:19.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: fsmap 11 up:standby 2024-09-10T10:59:19.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:59:19.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:19.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:19.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:19.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:19.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:19.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:19.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: Deploying daemon mds.b on smithi115 2024-09-10T10:59:19.639 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:19 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2228892635' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:19.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.59:6840/2789106247,v1:172.21.15.59:6841/2789106247] up:boot 2024-09-10T10:59:19.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: fsmap 11 up:standby 2024-09-10T10:59:19.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:59:19.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:19.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:19.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:19.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:19.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:19.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:19.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: Deploying daemon mds.b on smithi115 2024-09-10T10:59:19.687 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:19 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2228892635' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:19.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.59:6840/2789106247,v1:172.21.15.59:6841/2789106247] up:boot 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: fsmap 11 up:standby 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: Deploying daemon mds.b on smithi115 2024-09-10T10:59:19.709 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:19 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2228892635' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:20.443 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:20 smithi115 ceph-mon[34719]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:20.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:20 smithi059 ceph-mon[30978]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:20.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:20 smithi181 ceph-mon[35409]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:20.708 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 10:59:20 smithi115 podman[65333]: 2024-09-10 10:59:20.680128164 +0000 UTC m=+0.139229668 container create 7c22dccd851494a028bce8fa280122a7ee2fde57ac6b9e84b5b8d111d760d105 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T10:59:21.208 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 10:59:20 smithi115 podman[65333]: 2024-09-10 10:59:20.933035722 +0000 UTC m=+0.392137220 container init 7c22dccd851494a028bce8fa280122a7ee2fde57ac6b9e84b5b8d111d760d105 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:59:21.208 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 10:59:20 smithi115 podman[65333]: 2024-09-10 10:59:20.935796751 +0000 UTC m=+0.394898248 container start 7c22dccd851494a028bce8fa280122a7ee2fde57ac6b9e84b5b8d111d760d105 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T10:59:21.208 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 10:59:20 smithi115 ceph-mds[65352]: -- 172.21.15.115:0/1117962042 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d67b85d860 con 0x55d67b83b400 2024-09-10T10:59:21.209 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 10:59:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b[65348]: starting mds.b at 2024-09-10T10:59:21.209 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 10:59:20 smithi115 bash[65333]: 7c22dccd851494a028bce8fa280122a7ee2fde57ac6b9e84b5b8d111d760d105 2024-09-10T10:59:21.209 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 10:59:20 smithi115 systemd[1]: Started Ceph mds.b for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T10:59:21.829 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:59:22.042 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:22.042 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.042 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.042 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.042 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.042 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.042 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:59:22.042 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] up:boot 2024-09-10T10:59:22.042 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: fsmap 12 up:standby 2024-09-10T10:59:22.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:59:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] up:boot 2024-09-10T10:59:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: fsmap 12 up:standby 2024-09-10T10:59:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:22 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:59:22.278 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:22.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:22 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:59:22.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:22.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:22.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:59:22.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] up:boot 2024-09-10T10:59:22.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: fsmap 12 up:standby 2024-09-10T10:59:22.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:22 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:59:22.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/2214132312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 msgr2=0x7fdd2810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/2214132312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 0x7fdd2810df40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd18009900 tx=0x7fdd1802a410 comp rx=0 tx=0).stop 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/2214132312 shutdown_connections 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/2214132312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2810e480 0x7fdd28110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/2214132312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 0x7fdd2810df40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/2214132312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd281008d0 0x7fdd28100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/2214132312 >> 172.21.15.59:0/2214132312 conn(0x7fdd280fc7a0 msgr2=0x7fdd280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/2214132312 shutdown_connections 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/2214132312 wait complete. 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 Processor -- start 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 -- start start 2024-09-10T10:59:22.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.824+0000 7fdd2f3aa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd281008d0 0x7fdd2819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2f3aa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 0x7fdd2819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2f3aa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2810e480 0x7fdd2819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2f3aa640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281141b0 con 0x7fdd28101280 2024-09-10T10:59:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2f3aa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdd28114030 con 0x7fdd2810e480 2024-09-10T10:59:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2f3aa640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdd28114330 con 0x7fdd281008d0 2024-09-10T10:59:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2c945640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 0x7fdd2819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:22.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2c945640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 0x7fdd2819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36754/0 (socket says 172.21.15.59:36754) 2024-09-10T10:59:22.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2c945640 1 -- 172.21.15.59:0/3654923931 learned_addr learned my addr 172.21.15.59:0/3654923931 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:22.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2d146640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd281008d0 0x7fdd2819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:22.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2d947640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2810e480 0x7fdd2819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:22.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2c945640 1 -- 172.21.15.59:0/3654923931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd281008d0 msgr2=0x7fdd2819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:22.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2c945640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd281008d0 0x7fdd2819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:22.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2c945640 1 -- 172.21.15.59:0/3654923931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2810e480 msgr2=0x7fdd2819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:22.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2c945640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2810e480 0x7fdd2819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:22.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2c945640 1 -- 172.21.15.59:0/3654923931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2819f6a0 con 0x7fdd28101280 2024-09-10T10:59:22.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2d146640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd281008d0 0x7fdd2819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:59:22.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2d947640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2810e480 0x7fdd2819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:22.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2c945640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 0x7fdd2819ac30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd18006010 tx=0x7fdd180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:22.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd1e7fc640 1 -- 172.21.15.59:0/3654923931 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1803f030 con 0x7fdd28101280 2024-09-10T10:59:22.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2819f930 con 0x7fdd28101280 2024-09-10T10:59:22.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd1e7fc640 1 -- 172.21.15.59:0/3654923931 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd18003ce0 con 0x7fdd28101280 2024-09-10T10:59:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd1e7fc640 1 -- 172.21.15.59:0/3654923931 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd18035070 con 0x7fdd28101280 2024-09-10T10:59:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.825+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd281a7270 con 0x7fdd28101280 2024-09-10T10:59:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.826+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd2806b070 con 0x7fdd28101280 2024-09-10T10:59:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.828+0000 7fdd1e7fc640 1 -- 172.21.15.59:0/3654923931 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdd18042030 con 0x7fdd28101280 2024-09-10T10:59:22.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.828+0000 7fdd1e7fc640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdd140a2b80 0x7fdd140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.828+0000 7fdd2d146640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdd140a2b80 0x7fdd140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.828+0000 7fdd1e7fc640 1 -- 172.21.15.59:0/3654923931 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fdd180ef350 con 0x7fdd28101280 2024-09-10T10:59:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.829+0000 7fdd2d146640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdd140a2b80 0x7fdd140a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009fc0 tx=0x7fdd24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:22.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:22.831+0000 7fdd1e7fc640 1 -- 172.21.15.59:0/3654923931 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd180bc810 con 0x7fdd28101280 2024-09-10T10:59:23.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.054+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd28109610 con 0x7fdd28101280 2024-09-10T10:59:23.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.055+0000 7fdd1e7fc640 1 -- 172.21.15.59:0/3654923931 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10524 (secure 0 0 0) 0x7fdd180bc110 con 0x7fdd28101280 2024-09-10T10:59:23.056 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:23.057 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"btime":"2024-09-10T10:59:21:370246+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/411505011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":411505011},{"type":"v1","addr":"172.21.15.115:6839","nonce":411505011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T10:59:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 13 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdd140a2b80 msgr2=0x7fdd140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdd140a2b80 0x7fdd140a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009fc0 tx=0x7fdd24005f90 comp rx=0 tx=0).stop 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 msgr2=0x7fdd2819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 0x7fdd2819ac30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd18006010 tx=0x7fdd180042f0 comp rx=0 tx=0).stop 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 shutdown_connections 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdd140a2b80 0x7fdd140a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2810e480 0x7fdd2819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd28101280 0x7fdd2819ac30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 --2- 172.21.15.59:0/3654923931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd281008d0 0x7fdd2819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 >> 172.21.15.59:0/3654923931 conn(0x7fdd280fc7a0 msgr2=0x7fdd280feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 shutdown_connections 2024-09-10T10:59:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:23.058+0000 7fdd2f3aa640 1 -- 172.21.15.59:0/3654923931 wait complete. 2024-09-10T10:59:23.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:23 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:23 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:23 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:23 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:23 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3654923931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:23.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T10:59:23.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:23 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:23 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:23 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:23 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:23 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3654923931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:23.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:23 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:23 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:23 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:23 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:23.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:23 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3654923931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:24.011 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:24.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 -- 172.21.15.59:0/1089370686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030101420 msgr2=0x7f103010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:24.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 --2- 172.21.15.59:0/1089370686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030101420 0x7f103010d950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1028009cd0 tx=0x7f102802a8e0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 -- 172.21.15.59:0/1089370686 shutdown_connections 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 --2- 172.21.15.59:0/1089370686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030101420 0x7f103010d950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 --2- 172.21.15.59:0/1089370686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1030100a80 0x7f1030100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 --2- 172.21.15.59:0/1089370686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1030106a80 0x7f1030106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 -- 172.21.15.59:0/1089370686 >> 172.21.15.59:0/1089370686 conn(0x7f10300fc7a0 msgr2=0x7f10300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 -- 172.21.15.59:0/1089370686 shutdown_connections 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 -- 172.21.15.59:0/1089370686 wait complete. 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.506+0000 7f1037e66640 1 Processor -- start 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1037e66640 1 -- start start 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1037e66640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030100a80 0x7f1030197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1037e66640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1030101420 0x7f10301975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:24.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1037e66640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1030106a80 0x7f1030197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1037e66640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1030110e80 con 0x7f1030100a80 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1037e66640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1030110d00 con 0x7f1030101420 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1037e66640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1030111000 con 0x7f1030106a80 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035c02640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030100a80 0x7f1030197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035c02640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030100a80 0x7f1030197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36770/0 (socket says 172.21.15.59:36770) 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035c02640 1 -- 172.21.15.59:0/1302190842 learned_addr learned my addr 172.21.15.59:0/1302190842 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035401640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1030101420 0x7f10301975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1036403640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1030106a80 0x7f1030197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035c02640 1 -- 172.21.15.59:0/1302190842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1030106a80 msgr2=0x7f1030197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035c02640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1030106a80 0x7f1030197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035c02640 1 -- 172.21.15.59:0/1302190842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1030101420 msgr2=0x7f10301975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035c02640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1030101420 0x7f10301975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035c02640 1 -- 172.21.15.59:0/1302190842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10301a68f0 con 0x7f1030100a80 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1035c02640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030100a80 0x7f1030197080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f102c00e9f0 tx=0x7f102c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1026ffd640 1 -- 172.21.15.59:0/1302190842 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c00cd80 con 0x7f1030100a80 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1026ffd640 1 -- 172.21.15.59:0/1302190842 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f102c005500 con 0x7f1030100a80 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.507+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10301a6be0 con 0x7f1030100a80 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.508+0000 7f1026ffd640 1 -- 172.21.15.59:0/1302190842 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c010690 con 0x7f1030100a80 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.508+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10301a7120 con 0x7f1030100a80 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.509+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1030100ee0 con 0x7f1030100a80 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.510+0000 7f1026ffd640 1 -- 172.21.15.59:0/1302190842 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f102c0046c0 con 0x7f1030100a80 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.510+0000 7f1026ffd640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f101c0a2c00 0x7f101c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.510+0000 7f1035401640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f101c0a2c00 0x7f101c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.510+0000 7f1026ffd640 1 -- 172.21.15.59:0/1302190842 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f102c0cef60 con 0x7f1030100a80 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.511+0000 7f1035401640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f101c0a2c00 0x7f101c0a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f10301991e0 tx=0x7f102000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:24.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.515+0000 7f1026ffd640 1 -- 172.21.15.59:0/1302190842 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f102c09c340 con 0x7f1030100a80 2024-09-10T10:59:24.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.704+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f103002d7c0 con 0x7f1030100a80 2024-09-10T10:59:24.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:24 smithi059 ceph-mon[30978]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:24.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:24.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:59:24.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.706 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:24 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:59:24.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.705+0000 7f1026ffd640 1 -- 172.21.15.59:0/1302190842 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f102c09bc40 con 0x7f1030100a80 2024-09-10T10:59:24.707 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:24.707 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-09-10T10:59:24.707 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T10:59:24.707 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-09-10T10:59:24.707 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-09-10T10:59:24.707 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T10:59:24.707 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-09-10T10:59:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f101c0a2c00 msgr2=0x7f101c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:24.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f101c0a2c00 0x7f101c0a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f10301991e0 tx=0x7f102000b410 comp rx=0 tx=0).stop 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030100a80 msgr2=0x7f1030197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030100a80 0x7f1030197080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f102c00e9f0 tx=0x7f102c00edf0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 shutdown_connections 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f101c0a2c00 0x7f101c0a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1030106a80 0x7f1030197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1030101420 0x7f10301975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 --2- 172.21.15.59:0/1302190842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1030100a80 0x7f1030197080 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.707+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 >> 172.21.15.59:0/1302190842 conn(0x7f10300fc7a0 msgr2=0x7f10300fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.708+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 shutdown_connections 2024-09-10T10:59:24.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:24.708+0000 7f1037e66640 1 -- 172.21.15.59:0/1302190842 wait complete. 2024-09-10T10:59:24.924 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:24 smithi115 ceph-mon[34719]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:24.924 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.924 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.924 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.925 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:24.925 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:59:24.925 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.925 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:24 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:59:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:24 smithi181 ceph-mon[35409]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:59:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:24 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:59:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:25 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1302190842' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T10:59:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:25 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:25 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1302190842' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T10:59:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:25 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:25 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:25 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:25 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:26.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:25 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1302190842' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T10:59:26.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:26.016 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:26.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:26.017 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:25 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:26.051 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T10:59:26.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T10:59:26.343 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:26.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:26 smithi059 ceph-mon[30978]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:26.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.853+0000 7fd346944640 1 -- 172.21.15.59:0/3207852621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 msgr2=0x7fd34010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:26.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.853+0000 7fd346944640 1 --2- 172.21.15.59:0/3207852621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 0x7fd34010e610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd338009ca0 tx=0x7fd33802a950 comp rx=0 tx=0).stop 2024-09-10T10:59:26.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.853+0000 7fd346944640 1 -- 172.21.15.59:0/3207852621 shutdown_connections 2024-09-10T10:59:26.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.853+0000 7fd346944640 1 --2- 172.21.15.59:0/3207852621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 0x7fd34010e610 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:26.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.853+0000 7fd346944640 1 --2- 172.21.15.59:0/3207852621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd340103660 0x7fd34010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:26.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.853+0000 7fd346944640 1 --2- 172.21.15.59:0/3207852621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd340102d40 0x7fd340103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.853+0000 7fd346944640 1 -- 172.21.15.59:0/3207852621 >> 172.21.15.59:0/3207852621 conn(0x7fd3400fc7a0 msgr2=0x7fd3400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.854+0000 7fd346944640 1 -- 172.21.15.59:0/3207852621 shutdown_connections 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.854+0000 7fd346944640 1 -- 172.21.15.59:0/3207852621 wait complete. 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.854+0000 7fd346944640 1 Processor -- start 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.854+0000 7fd346944640 1 -- start start 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.854+0000 7fd346944640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd340102d40 0x7fd340198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.854+0000 7fd346944640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd340103660 0x7fd340198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd346944640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 0x7fd34019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd346944640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd340112030 con 0x7fd34010c170 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd346944640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd340111eb0 con 0x7fd340102d40 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd346944640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd3401121b0 con 0x7fd340103660 2024-09-10T10:59:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd344ee1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 0x7fd34019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd344ee1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 0x7fd34019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44624/0 (socket says 172.21.15.59:44624) 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd344ee1640 1 -- 172.21.15.59:0/2480776675 learned_addr learned my addr 172.21.15.59:0/2480776675 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd33ffff640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd340102d40 0x7fd340198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd33f7fe640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd340103660 0x7fd340198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd344ee1640 1 -- 172.21.15.59:0/2480776675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd340103660 msgr2=0x7fd340198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd344ee1640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd340103660 0x7fd340198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd344ee1640 1 -- 172.21.15.59:0/2480776675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd340102d40 msgr2=0x7fd340198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd344ee1640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd340102d40 0x7fd340198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd344ee1640 1 -- 172.21.15.59:0/2480776675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34019d5f0 con 0x7fd34010c170 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd33f7fe640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd340103660 0x7fd340198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd33ffff640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd340102d40 0x7fd340198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd344ee1640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 0x7fd34019cf10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd338006010 tx=0x7fd33802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd33d7fa640 1 -- 172.21.15.59:0/2480776675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338034040 con 0x7fd34010c170 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34019d880 con 0x7fd34010c170 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd33d7fa640 1 -- 172.21.15.59:0/2480776675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd338003e00 con 0x7fd34010c170 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd33d7fa640 1 -- 172.21.15.59:0/2480776675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3380456e0 con 0x7fd34010c170 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.855+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3401a51c0 con 0x7fd34010c170 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.857+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3401031a0 con 0x7fd34010c170 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.858+0000 7fd33d7fa640 1 -- 172.21.15.59:0/2480776675 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd338037020 con 0x7fd34010c170 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.858+0000 7fd33d7fa640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd3280a2c00 0x7fd3280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.858+0000 7fd33ffff640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd3280a2c00 0x7fd3280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.858+0000 7fd33d7fa640 1 -- 172.21.15.59:0/2480776675 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd3380efce0 con 0x7fd34010c170 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.859+0000 7fd33ffff640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd3280a2c00 0x7fd3280a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd330009930 tx=0x7fd330008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:26.862+0000 7fd33d7fa640 1 -- 172.21.15.59:0/2480776675 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3380bd0e0 con 0x7fd34010c170 2024-09-10T10:59:26.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:26 smithi181 ceph-mon[35409]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:26 smithi115 ceph-mon[34719]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.043+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd340107210 con 0x7fd34010c170 2024-09-10T10:59:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.959+0000 7fd33d7fa640 1 -- 172.21.15.59:0/2480776675 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7fd3380bc9e0 con 0x7fd34010c170 2024-09-10T10:59:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd3280a2c00 msgr2=0x7fd3280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd3280a2c00 0x7fd3280a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd330009930 tx=0x7fd330008040 comp rx=0 tx=0).stop 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 msgr2=0x7fd34019cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 0x7fd34019cf10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd338006010 tx=0x7fd33802f710 comp rx=0 tx=0).stop 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 shutdown_connections 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd3280a2c00 0x7fd3280a50c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34010c170 0x7fd34019cf10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd340103660 0x7fd340198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 --2- 172.21.15.59:0/2480776675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd340102d40 0x7fd340198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 >> 172.21.15.59:0/2480776675 conn(0x7fd3400fc7a0 msgr2=0x7fd3400fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 shutdown_connections 2024-09-10T10:59:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:27.963+0000 7fd346944640 1 -- 172.21.15.59:0/2480776675 wait complete. 2024-09-10T10:59:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:27 smithi115 ceph-mon[34719]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:59:28.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:28.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:27 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2480776675' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:59:28.290 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:27 smithi059 ceph-mon[30978]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:28.290 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:27 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:28.290 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:27 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:28.290 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:27 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:28.290 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:27 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:59:28.290 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:27 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:28.291 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:27 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2480776675' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:59:28.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:27 smithi181 ceph-mon[35409]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:27 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:27 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:27 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:59:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:27 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:59:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:27 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T10:59:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:27 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2480776675' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:59:28.666 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T10:59:28.926 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:29.227 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:28 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2480776675' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T10:59:29.228 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:28 smithi059 ceph-mon[30978]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T10:59:29.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:28 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2480776675' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T10:59:29.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:28 smithi181 ceph-mon[35409]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T10:59:29.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:28 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2480776675' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T10:59:29.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:28 smithi115 ceph-mon[34719]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T10:59:29.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.465+0000 7fb95a056640 1 -- 172.21.15.59:0/1882551511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 msgr2=0x7fb954100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:29.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.465+0000 7fb95a056640 1 --2- 172.21.15.59:0/1882551511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 0x7fb954100ee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009930 tx=0x7fb93c02a420 comp rx=0 tx=0).stop 2024-09-10T10:59:29.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.466+0000 7fb95a056640 1 -- 172.21.15.59:0/1882551511 shutdown_connections 2024-09-10T10:59:29.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.466+0000 7fb95a056640 1 --2- 172.21.15.59:0/1882551511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb954101420 0x7fb95410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.466+0000 7fb95a056640 1 --2- 172.21.15.59:0/1882551511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 0x7fb954100ee0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.466+0000 7fb95a056640 1 --2- 172.21.15.59:0/1882551511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb954106a80 0x7fb954106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.466+0000 7fb95a056640 1 -- 172.21.15.59:0/1882551511 >> 172.21.15.59:0/1882551511 conn(0x7fb9540fc7a0 msgr2=0x7fb9540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.466+0000 7fb95a056640 1 -- 172.21.15.59:0/1882551511 shutdown_connections 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.466+0000 7fb95a056640 1 -- 172.21.15.59:0/1882551511 wait complete. 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.466+0000 7fb95a056640 1 Processor -- start 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.466+0000 7fb95a056640 1 -- start start 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb95a056640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 0x7fb954198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb95a056640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb954101420 0x7fb954198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb95a056640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb954106a80 0x7fb95419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb95a056640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb954110e40 con 0x7fb954100a80 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb95a056640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb954110cc0 con 0x7fb954101420 2024-09-10T10:59:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb95a056640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb954110fc0 con 0x7fb954106a80 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 0x7fb954198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 0x7fb954198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44652/0 (socket says 172.21.15.59:44652) 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9537fe640 1 -- 172.21.15.59:0/563277056 learned_addr learned my addr 172.21.15.59:0/563277056 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb94affd640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb954101420 0x7fb954198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9537fe640 1 -- 172.21.15.59:0/563277056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb954106a80 msgr2=0x7fb95419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9537fe640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb954106a80 0x7fb95419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9537fe640 1 -- 172.21.15.59:0/563277056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb954101420 msgr2=0x7fb954198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9537fe640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb954101420 0x7fb954198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9537fe640 1 -- 172.21.15.59:0/563277056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95419d400 con 0x7fb954100a80 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9537fe640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 0x7fb954198450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb94400d950 tx=0x7fb94400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9517fa640 1 -- 172.21.15.59:0/563277056 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944017030 con 0x7fb954100a80 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9517fa640 1 -- 172.21.15.59:0/563277056 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb944004020 con 0x7fb954100a80 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95419d6f0 con 0x7fb954100a80 2024-09-10T10:59:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.467+0000 7fb9517fa640 1 -- 172.21.15.59:0/563277056 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9440047a0 con 0x7fb954100a80 2024-09-10T10:59:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.468+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9541a4fd0 con 0x7fb954100a80 2024-09-10T10:59:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.468+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb954100ee0 con 0x7fb954100a80 2024-09-10T10:59:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.470+0000 7fb9517fa640 1 -- 172.21.15.59:0/563277056 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb9440041d0 con 0x7fb954100a80 2024-09-10T10:59:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.471+0000 7fb9517fa640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb9400a2b80 0x7fb9400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.471+0000 7fb94affd640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb9400a2b80 0x7fb9400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.471+0000 7fb9517fa640 1 -- 172.21.15.59:0/563277056 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7fb9440cedc0 con 0x7fb954100a80 2024-09-10T10:59:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.471+0000 7fb94affd640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb9400a2b80 0x7fb9400a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009900 tx=0x7fb93c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.474+0000 7fb9517fa640 1 -- 172.21.15.59:0/563277056 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb94409bfb0 con 0x7fb954100a80 2024-09-10T10:59:29.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:29.651+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb9541997b0 con 0x7fb954100a80 2024-09-10T10:59:30.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.097+0000 7fb9517fa640 1 -- 172.21.15.59:0/563277056 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7fb94409b8b0 con 0x7fb954100a80 2024-09-10T10:59:30.099 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-09-10T10:59:30.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb9400a2b80 msgr2=0x7fb9400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:30.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb9400a2b80 0x7fb9400a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009900 tx=0x7fb93c0058d0 comp rx=0 tx=0).stop 2024-09-10T10:59:30.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 msgr2=0x7fb954198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:30.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 0x7fb954198450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb94400d950 tx=0x7fb94400de10 comp rx=0 tx=0).stop 2024-09-10T10:59:30.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 shutdown_connections 2024-09-10T10:59:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb9400a2b80 0x7fb9400a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb954106a80 0x7fb95419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb954101420 0x7fb954198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 --2- 172.21.15.59:0/563277056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb954100a80 0x7fb954198450 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 >> 172.21.15.59:0/563277056 conn(0x7fb9540fc7a0 msgr2=0x7fb95406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 shutdown_connections 2024-09-10T10:59:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:30.099+0000 7fb95a056640 1 -- 172.21.15.59:0/563277056 wait complete. 2024-09-10T10:59:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:30 smithi059 ceph-mon[30978]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T10:59:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:30 smithi059 ceph-mon[30978]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:59:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:30 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/563277056' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:59:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:30 smithi181 ceph-mon[35409]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T10:59:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:30 smithi181 ceph-mon[35409]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:59:30.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:30 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/563277056' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:59:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:30 smithi115 ceph-mon[34719]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T10:59:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:30 smithi115 ceph-mon[34719]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:59:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:30 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/563277056' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:59:30.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T10:59:31.098 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:31.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:31 smithi059 ceph-mon[30978]: pgmap v272: 33 pgs: 23 creating+peering, 9 unknown, 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:31.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:31 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/563277056' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T10:59:31.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:31 smithi059 ceph-mon[30978]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T10:59:31.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:31 smithi181 ceph-mon[35409]: pgmap v272: 33 pgs: 23 creating+peering, 9 unknown, 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:31.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:31 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/563277056' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T10:59:31.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:31 smithi181 ceph-mon[35409]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T10:59:31.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:31 smithi115 ceph-mon[34719]: pgmap v272: 33 pgs: 23 creating+peering, 9 unknown, 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:31.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:31 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/563277056' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T10:59:31.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:31 smithi115 ceph-mon[34719]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T10:59:31.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.611+0000 7f8e5591e640 1 -- 172.21.15.59:0/2855740951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 msgr2=0x7f8e5010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:31.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.611+0000 7f8e5591e640 1 --2- 172.21.15.59:0/2855740951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 0x7f8e5010e610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009ca0 tx=0x7f8e4802a950 comp rx=0 tx=0).stop 2024-09-10T10:59:31.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.611+0000 7f8e5591e640 1 -- 172.21.15.59:0/2855740951 shutdown_connections 2024-09-10T10:59:31.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.611+0000 7f8e5591e640 1 --2- 172.21.15.59:0/2855740951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 0x7f8e5010e610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:31.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.611+0000 7f8e5591e640 1 --2- 172.21.15.59:0/2855740951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e50103660 0x7f8e5010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.611+0000 7f8e5591e640 1 --2- 172.21.15.59:0/2855740951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e50102d40 0x7f8e50103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.611+0000 7f8e5591e640 1 -- 172.21.15.59:0/2855740951 >> 172.21.15.59:0/2855740951 conn(0x7f8e500fc7a0 msgr2=0x7f8e500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.611+0000 7f8e5591e640 1 -- 172.21.15.59:0/2855740951 shutdown_connections 2024-09-10T10:59:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.611+0000 7f8e5591e640 1 -- 172.21.15.59:0/2855740951 wait complete. 2024-09-10T10:59:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e5591e640 1 Processor -- start 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e5591e640 1 -- start start 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e5591e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e50102d40 0x7f8e50198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e5591e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e50103660 0x7f8e501989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e5591e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 0x7f8e5019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e5591e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e50111f50 con 0x7f8e5010c170 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e5591e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8e50111dd0 con 0x7f8e50102d40 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e5591e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8e501120d0 con 0x7f8e50103660 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e4f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 0x7f8e5019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e4f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 0x7f8e5019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44680/0 (socket says 172.21.15.59:44680) 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e4f7fe640 1 -- 172.21.15.59:0/4025876755 learned_addr learned my addr 172.21.15.59:0/4025876755 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e4effd640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e50102d40 0x7f8e50198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.612+0000 7f8e4e7fc640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e50103660 0x7f8e501989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e4f7fe640 1 -- 172.21.15.59:0/4025876755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e50103660 msgr2=0x7f8e501989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e4f7fe640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e50103660 0x7f8e501989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e4f7fe640 1 -- 172.21.15.59:0/4025876755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e50102d40 msgr2=0x7f8e50198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e4f7fe640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e50102d40 0x7f8e50198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e4f7fe640 1 -- 172.21.15.59:0/4025876755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5019d410 con 0x7f8e5010c170 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e4effd640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e50102d40 0x7f8e50198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e4f7fe640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 0x7f8e5019cd30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8e4802ae70 tx=0x7f8e4802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e5491c640 1 -- 172.21.15.59:0/4025876755 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48034040 con 0x7f8e5010c170 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e5491c640 1 -- 172.21.15.59:0/4025876755 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e48030920 con 0x7f8e5010c170 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5019d6a0 con 0x7f8e5010c170 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e5491c640 1 -- 172.21.15.59:0/4025876755 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48045480 con 0x7f8e5010c170 2024-09-10T10:59:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.613+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e501a4fe0 con 0x7f8e5010c170 2024-09-10T10:59:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.614+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e50103120 con 0x7f8e5010c170 2024-09-10T10:59:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.615+0000 7f8e5491c640 1 -- 172.21.15.59:0/4025876755 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8e48037020 con 0x7f8e5010c170 2024-09-10T10:59:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.616+0000 7f8e5491c640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8e380a2c00 0x7f8e380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.616+0000 7f8e4effd640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8e380a2c00 0x7f8e380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.616+0000 7f8e5491c640 1 -- 172.21.15.59:0/4025876755 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f8e480eff10 con 0x7f8e5010c170 2024-09-10T10:59:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.617+0000 7f8e4effd640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8e380a2c00 0x7f8e380a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000bfd0 tx=0x7f8e4000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.619+0000 7f8e5491c640 1 -- 172.21.15.59:0/4025876755 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e480811b0 con 0x7f8e5010c170 2024-09-10T10:59:31.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:31.831+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8e501997c0 con 0x7f8e5010c170 2024-09-10T10:59:32.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.107+0000 7f8e5491c640 1 -- 172.21.15.59:0/4025876755 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8e501997c0 con 0x7f8e5010c170 2024-09-10T10:59:32.109 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T10:59:32.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8e380a2c00 msgr2=0x7f8e380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:32.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8e380a2c00 0x7f8e380a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000bfd0 tx=0x7f8e4000b390 comp rx=0 tx=0).stop 2024-09-10T10:59:32.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 msgr2=0x7f8e5019cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:32.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 0x7f8e5019cd30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8e4802ae70 tx=0x7f8e4802f5b0 comp rx=0 tx=0).stop 2024-09-10T10:59:32.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 shutdown_connections 2024-09-10T10:59:32.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8e380a2c00 0x7f8e380a50c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:32.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5010c170 0x7f8e5019cd30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:32.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e50103660 0x7f8e501989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:32.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 --2- 172.21.15.59:0/4025876755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e50102d40 0x7f8e50198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:32.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 >> 172.21.15.59:0/4025876755 conn(0x7f8e500fc7a0 msgr2=0x7f8e500fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:32.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 shutdown_connections 2024-09-10T10:59:32.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:32.110+0000 7f8e5591e640 1 -- 172.21.15.59:0/4025876755 wait complete. 2024-09-10T10:59:32.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:32 smithi059 ceph-mon[30978]: pgmap v275: 97 pgs: 23 creating+peering, 73 unknown, 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:32.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:32 smithi059 ceph-mon[30978]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T10:59:32.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:32 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/4025876755' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:59:32.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:32 smithi059 ceph-mon[30978]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T10:59:32.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:32 smithi181 ceph-mon[35409]: pgmap v275: 97 pgs: 23 creating+peering, 73 unknown, 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:32.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:32 smithi181 ceph-mon[35409]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T10:59:32.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:32 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/4025876755' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:59:32.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:32 smithi181 ceph-mon[35409]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T10:59:32.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:32 smithi115 ceph-mon[34719]: pgmap v275: 97 pgs: 23 creating+peering, 73 unknown, 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:32.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:32 smithi115 ceph-mon[34719]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T10:59:32.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:32 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/4025876755' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:59:32.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:32 smithi115 ceph-mon[34719]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T10:59:32.878 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:59:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:33.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:33 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/4025876755' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T10:59:33.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:33 smithi059 ceph-mon[30978]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T10:59:33.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:33 smithi059 ceph-mon[30978]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T10:59:33.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:33 smithi059 ceph-mon[30978]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T10:59:33.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:33 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/4025876755' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T10:59:33.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:33 smithi181 ceph-mon[35409]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T10:59:33.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:33 smithi181 ceph-mon[35409]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T10:59:33.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:33 smithi181 ceph-mon[35409]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T10:59:33.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:33 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/4025876755' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T10:59:33.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:33 smithi115 ceph-mon[34719]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T10:59:33.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:33 smithi115 ceph-mon[34719]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T10:59:33.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:33 smithi115 ceph-mon[34719]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 -- 172.21.15.59:0/3447376123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700101420 msgr2=0x7fd70010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 --2- 172.21.15.59:0/3447376123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700101420 0x7fd70010d950 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009cd0 tx=0x7fd6f802a8e0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 -- 172.21.15.59:0/3447376123 shutdown_connections 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 --2- 172.21.15.59:0/3447376123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700101420 0x7fd70010d950 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 --2- 172.21.15.59:0/3447376123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd700100a80 0x7fd700100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 --2- 172.21.15.59:0/3447376123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd700106a80 0x7fd700106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 -- 172.21.15.59:0/3447376123 >> 172.21.15.59:0/3447376123 conn(0x7fd7000fc7a0 msgr2=0x7fd7000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 -- 172.21.15.59:0/3447376123 shutdown_connections 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 -- 172.21.15.59:0/3447376123 wait complete. 2024-09-10T10:59:33.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 Processor -- start 2024-09-10T10:59:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.632+0000 7fd7048b9640 1 -- start start 2024-09-10T10:59:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd7048b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700100a80 0x7fd700198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd7048b9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd700101420 0x7fd7001989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd7048b9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd700106a80 0x7fd70019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd7048b9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd700110ea0 con 0x7fd700100a80 2024-09-10T10:59:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd7048b9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd700110d20 con 0x7fd700101420 2024-09-10T10:59:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd7048b9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd700111020 con 0x7fd700106a80 2024-09-10T10:59:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fe59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700100a80 0x7fd700198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:33.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fe59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700100a80 0x7fd700198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44694/0 (socket says 172.21.15.59:44694) 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fe59c640 1 -- 172.21.15.59:0/1889922045 learned_addr learned my addr 172.21.15.59:0/1889922045 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fdd9b640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd700101420 0x7fd7001989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fed9d640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd700106a80 0x7fd70019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fe59c640 1 -- 172.21.15.59:0/1889922045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd700106a80 msgr2=0x7fd70019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fe59c640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd700106a80 0x7fd70019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fe59c640 1 -- 172.21.15.59:0/1889922045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd700101420 msgr2=0x7fd7001989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fe59c640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd700101420 0x7fd7001989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fe59c640 1 -- 172.21.15.59:0/1889922045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70019d430 con 0x7fd700100a80 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fdd9b640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd700101420 0x7fd7001989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.633+0000 7fd6fe59c640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700100a80 0x7fd700198480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000d950 tx=0x7fd6f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:33.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.634+0000 7fd6ef7fe640 1 -- 172.21.15.59:0/1889922045 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0017070 con 0x7fd700100a80 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.634+0000 7fd6ef7fe640 1 -- 172.21.15.59:0/1889922045 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6f0009c30 con 0x7fd700100a80 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.634+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70019d720 con 0x7fd700100a80 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.634+0000 7fd6ef7fe640 1 -- 172.21.15.59:0/1889922045 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000f6b0 con 0x7fd700100a80 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.634+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7001a5000 con 0x7fd700100a80 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.635+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd700100ee0 con 0x7fd700100a80 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.636+0000 7fd6ef7fe640 1 -- 172.21.15.59:0/1889922045 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd6f00109d0 con 0x7fd700100a80 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.636+0000 7fd6ef7fe640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6e80a2b80 0x7fd6e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.637+0000 7fd6ef7fe640 1 -- 172.21.15.59:0/1889922045 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fd6f00cec30 con 0x7fd700100a80 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.637+0000 7fd6fdd9b640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6e80a2b80 0x7fd6e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.637+0000 7fd6fdd9b640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6e80a2b80 0x7fd6e80a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd70006b7e0 tx=0x7fd6f4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:33.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.641+0000 7fd6ef7fe640 1 -- 172.21.15.59:0/1889922045 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6f0009de0 con 0x7fd700100a80 2024-09-10T10:59:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.816+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7001a52f0 con 0x7fd700100a80 2024-09-10T10:59:33.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.818+0000 7fd6ef7fe640 1 -- 172.21.15.59:0/1889922045 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22257 (secure 0 0 0) 0x7fd6f009bce0 con 0x7fd700100a80 2024-09-10T10:59:33.820 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:33.820 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":81,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T10:59:31.833372+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:59:27.480743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:59:30.088912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:59:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6e80a2b80 msgr2=0x7fd6e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6e80a2b80 0x7fd6e80a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd70006b7e0 tx=0x7fd6f4008040 comp rx=0 tx=0).stop 2024-09-10T10:59:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700100a80 msgr2=0x7fd700198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700100a80 0x7fd700198480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000d950 tx=0x7fd6f000de10 comp rx=0 tx=0).stop 2024-09-10T10:59:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 shutdown_connections 2024-09-10T10:59:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6e80a2b80 0x7fd6e80a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd700106a80 0x7fd70019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd700101420 0x7fd7001989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 --2- 172.21.15.59:0/1889922045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd700100a80 0x7fd700198480 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:33.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 >> 172.21.15.59:0/1889922045 conn(0x7fd7000fc7a0 msgr2=0x7fd700104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:33.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 shutdown_connections 2024-09-10T10:59:33.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:33.820+0000 7fd7048b9640 1 -- 172.21.15.59:0/1889922045 wait complete. 2024-09-10T10:59:34.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:34 smithi059 ceph-mon[30978]: pgmap v278: 97 pgs: 23 creating+peering, 55 unknown, 19 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:34 smithi059 ceph-mon[30978]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T10:59:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:34 smithi059 ceph-mon[30978]: Cluster is now healthy 2024-09-10T10:59:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:34 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] up:active 2024-09-10T10:59:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:34 smithi059 ceph-mon[30978]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:34 smithi059 ceph-mon[30978]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:34 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1889922045' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:59:34.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:34 smithi181 ceph-mon[35409]: pgmap v278: 97 pgs: 23 creating+peering, 55 unknown, 19 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:34.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:34 smithi181 ceph-mon[35409]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T10:59:34.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:34 smithi181 ceph-mon[35409]: Cluster is now healthy 2024-09-10T10:59:34.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:34 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] up:active 2024-09-10T10:59:34.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:34 smithi181 ceph-mon[35409]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:34.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:34 smithi181 ceph-mon[35409]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:34.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:34 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1889922045' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:59:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:34 smithi115 ceph-mon[34719]: pgmap v278: 97 pgs: 23 creating+peering, 55 unknown, 19 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:59:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:34 smithi115 ceph-mon[34719]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T10:59:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:34 smithi115 ceph-mon[34719]: Cluster is now healthy 2024-09-10T10:59:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:34 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] up:active 2024-09-10T10:59:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:34 smithi115 ceph-mon[34719]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:34 smithi115 ceph-mon[34719]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:34 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1889922045' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:59:34.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:59:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:35.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.222+0000 7f05c04bc640 1 -- 172.21.15.59:0/1344480882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8100e20 msgr2=0x7f05b8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:35.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.222+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1344480882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8100e20 0x7f05b8101200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009ca0 tx=0x7f05a802a950 comp rx=0 tx=0).stop 2024-09-10T10:59:35.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 -- 172.21.15.59:0/1344480882 shutdown_connections 2024-09-10T10:59:35.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1344480882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8102ef0 0x7f05b810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:35.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1344480882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05b8102570 0x7f05b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:35.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1344480882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8100e20 0x7f05b8101200 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:35.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 -- 172.21.15.59:0/1344480882 >> 172.21.15.59:0/1344480882 conn(0x7f05b80fc7d0 msgr2=0x7f05b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:35.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 -- 172.21.15.59:0/1344480882 shutdown_connections 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 -- 172.21.15.59:0/1344480882 wait complete. 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 Processor -- start 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 -- start start 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05b8100e20 0x7f05b819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8102570 0x7f05b819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8102ef0 0x7f05b819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81120d0 con 0x7f05b8102570 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8111f50 con 0x7f05b8102ef0 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.223+0000 7f05c04bc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8112250 con 0x7f05b8100e20 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bda57640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8102570 0x7f05b819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bda57640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8102570 0x7f05b819ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44722/0 (socket says 172.21.15.59:44722) 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bda57640 1 -- 172.21.15.59:0/1587924997 learned_addr learned my addr 172.21.15.59:0/1587924997 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05be258640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05b8100e20 0x7f05b819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bea59640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8102ef0 0x7f05b819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:35.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bda57640 1 -- 172.21.15.59:0/1587924997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05b8100e20 msgr2=0x7f05b819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bda57640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05b8100e20 0x7f05b819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bda57640 1 -- 172.21.15.59:0/1587924997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8102ef0 msgr2=0x7f05b819f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bda57640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8102ef0 0x7f05b819f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bda57640 1 -- 172.21.15.59:0/1587924997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b819f700 con 0x7f05b8102570 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05bda57640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8102570 0x7f05b819ac90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00d770 tx=0x7f05ac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05b77fe640 1 -- 172.21.15.59:0/1587924997 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac017070 con 0x7f05b8102570 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05b77fe640 1 -- 172.21.15.59:0/1587924997 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05ac005500 con 0x7f05b8102570 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b819f9f0 con 0x7f05b8102570 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05b77fe640 1 -- 172.21.15.59:0/1587924997 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac004e00 con 0x7f05b8102570 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.224+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b81a72d0 con 0x7f05b8102570 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.225+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b8101200 con 0x7f05b8102570 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.226+0000 7f05b77fe640 1 -- 172.21.15.59:0/1587924997 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f05ac004fa0 con 0x7f05b8102570 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.227+0000 7f05b77fe640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f05a00a2c00 0x7f05a00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:35.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.227+0000 7f05b77fe640 1 -- 172.21.15.59:0/1587924997 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f05ac0ce970 con 0x7f05b8102570 2024-09-10T10:59:35.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.227+0000 7f05be258640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f05a00a2c00 0x7f05a00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:35.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.228+0000 7f05be258640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f05a00a2c00 0x7f05a00a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f05a8005e30 tx=0x7f05a8005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:35.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.231+0000 7f05b77fe640 1 -- 172.21.15.59:0/1587924997 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05ac09ba20 con 0x7f05b8102570 2024-09-10T10:59:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.409+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05b802d7c0 con 0x7f05b8102570 2024-09-10T10:59:35.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.411+0000 7f05b77fe640 1 -- 172.21.15.59:0/1587924997 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22257 (secure 0 0 0) 0x7f05ac09b320 con 0x7f05b8102570 2024-09-10T10:59:35.413 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:35.413 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":81,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T10:59:31.833372+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:59:27.480743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:59:30.088912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:59:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f05a00a2c00 msgr2=0x7f05a00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f05a00a2c00 0x7f05a00a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f05a8005e30 tx=0x7f05a8005d80 comp rx=0 tx=0).stop 2024-09-10T10:59:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8102570 msgr2=0x7f05b819ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8102570 0x7f05b819ac90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00d770 tx=0x7f05ac00dc30 comp rx=0 tx=0).stop 2024-09-10T10:59:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 shutdown_connections 2024-09-10T10:59:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f05a00a2c00 0x7f05a00a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8102ef0 0x7f05b819f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05b8102570 0x7f05b819ac90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 --2- 172.21.15.59:0/1587924997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05b8100e20 0x7f05b819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 >> 172.21.15.59:0/1587924997 conn(0x7f05b80fc7d0 msgr2=0x7f05b810c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 shutdown_connections 2024-09-10T10:59:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:35.413+0000 7f05c04bc640 1 -- 172.21.15.59:0/1587924997 wait complete. 2024-09-10T10:59:36.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T10:59:36.381 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:36 smithi115 ceph-mon[34719]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-10T10:59:36.382 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:36 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1587924997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:59:36.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:36 smithi059 ceph-mon[30978]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-10T10:59:36.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:36 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1587924997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:59:36.400 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:36.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:36 smithi181 ceph-mon[35409]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-10T10:59:36.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:36 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1587924997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:59:36.708 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 10:59:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b[65348]: 2024-09-10T10:59:36.380+0000 7fa8aa462640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T10:59:36.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 -- 172.21.15.59:0/3940933981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 msgr2=0x7f5138114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 --2- 172.21.15.59:0/3940933981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 0x7f5138114f80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5130009ca0 tx=0x7f513002a950 comp rx=0 tx=0).stop 2024-09-10T10:59:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 -- 172.21.15.59:0/3940933981 shutdown_connections 2024-09-10T10:59:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 --2- 172.21.15.59:0/3940933981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 0x7f5138114f80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 --2- 172.21.15.59:0/3940933981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5138074eb0 0x7f5138112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 --2- 172.21.15.59:0/3940933981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5138074590 0x7f5138074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 -- 172.21.15.59:0/3940933981 >> 172.21.15.59:0/3940933981 conn(0x7f51380fd8c0 msgr2=0x7f51380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 -- 172.21.15.59:0/3940933981 shutdown_connections 2024-09-10T10:59:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 -- 172.21.15.59:0/3940933981 wait complete. 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.886+0000 7f51403ec640 1 Processor -- start 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f51403ec640 1 -- start start 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f51403ec640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5138074590 0x7f51381a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f51403ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5138074eb0 0x7f51381a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f51403ec640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 0x7f513819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f51403ec640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5138118560 con 0x7f5138112b90 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f51403ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f51381183e0 con 0x7f5138074eb0 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f51403ec640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f51381186e0 con 0x7f5138074590 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e989640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 0x7f513819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e989640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 0x7f513819e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53448/0 (socket says 172.21.15.59:53448) 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e989640 1 -- 172.21.15.59:0/421001263 learned_addr learned my addr 172.21.15.59:0/421001263 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513d987640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5138074eb0 0x7f51381a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e188640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5138074590 0x7f51381a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e989640 1 -- 172.21.15.59:0/421001263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5138074590 msgr2=0x7f51381a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e989640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5138074590 0x7f51381a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e989640 1 -- 172.21.15.59:0/421001263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5138074eb0 msgr2=0x7f51381a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e989640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5138074eb0 0x7f51381a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e989640 1 -- 172.21.15.59:0/421001263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513819efc0 con 0x7f5138112b90 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e188640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5138074590 0x7f51381a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.887+0000 7f513e989640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 0x7f513819e890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5130004af0 tx=0x7f513002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.888+0000 7f512f7fe640 1 -- 172.21.15.59:0/421001263 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130034040 con 0x7f5138112b90 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.888+0000 7f512f7fe640 1 -- 172.21.15.59:0/421001263 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5130030920 con 0x7f5138112b90 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.888+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513819f250 con 0x7f5138112b90 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.888+0000 7f512f7fe640 1 -- 172.21.15.59:0/421001263 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130004780 con 0x7f5138112b90 2024-09-10T10:59:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.888+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51381ab5a0 con 0x7f5138112b90 2024-09-10T10:59:36.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.889+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5138074970 con 0x7f5138112b90 2024-09-10T10:59:36.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.890+0000 7f512f7fe640 1 -- 172.21.15.59:0/421001263 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5130037020 con 0x7f5138112b90 2024-09-10T10:59:36.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.891+0000 7f512f7fe640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51240a2b80 0x7f51240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:36.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.891+0000 7f513e188640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51240a2b80 0x7f51240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:36.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.891+0000 7f512f7fe640 1 -- 172.21.15.59:0/421001263 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f51300efe60 con 0x7f5138112b90 2024-09-10T10:59:36.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.891+0000 7f513e188640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51240a2b80 0x7f51240a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f513819f9d0 tx=0x7f5134005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:36.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:36.895+0000 7f512f7fe640 1 -- 172.21.15.59:0/421001263 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51300bce70 con 0x7f5138112b90 2024-09-10T10:59:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.114+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f51381ab800 con 0x7f5138112b90 2024-09-10T10:59:37.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.130+0000 7f512f7fe640 1 -- 172.21.15.59:0/421001263 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f51300bc770 con 0x7f5138112b90 2024-09-10T10:59:37.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51240a2b80 msgr2=0x7f51240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:37.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51240a2b80 0x7f51240a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f513819f9d0 tx=0x7f5134005f90 comp rx=0 tx=0).stop 2024-09-10T10:59:37.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 msgr2=0x7f513819e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:37.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 0x7f513819e890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5130004af0 tx=0x7f513002f5b0 comp rx=0 tx=0).stop 2024-09-10T10:59:37.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 shutdown_connections 2024-09-10T10:59:37.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51240a2b80 0x7f51240a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:37.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5138112b90 0x7f513819e890 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:37.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5138074eb0 0x7f51381a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:37.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 --2- 172.21.15.59:0/421001263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5138074590 0x7f51381a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:37.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 >> 172.21.15.59:0/421001263 conn(0x7f51380fd8c0 msgr2=0x7f51380ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:37.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 shutdown_connections 2024-09-10T10:59:37.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:37.132+0000 7f51403ec640 1 -- 172.21.15.59:0/421001263 wait complete. 2024-09-10T10:59:37.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:37 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/421001263' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:59:37.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:37 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/421001263' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:59:37.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:37 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/421001263' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:59:37.795 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-10T10:59:37.796 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-10T10:59:38.053 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:38.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:38 smithi059 ceph-mon[30978]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-10T10:59:38.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:38 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/421001263' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T10:59:38.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:38 smithi059 ceph-mon[30978]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:38.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:38 smithi181 ceph-mon[35409]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-10T10:59:38.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:38 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/421001263' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T10:59:38.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:38 smithi181 ceph-mon[35409]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:38.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:38 smithi115 ceph-mon[34719]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-10T10:59:38.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:38 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/421001263' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T10:59:38.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:38 smithi115 ceph-mon[34719]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:38.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/2123806762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 msgr2=0x7fcbf010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/2123806762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 0x7fcbf010eaa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009ca0 tx=0x7fcbe002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/2123806762 shutdown_connections 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/2123806762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 0x7fcbf010eaa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/2123806762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf01027a0 0x7fcbf01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/2123806762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbf0101df0 0x7fcbf01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/2123806762 >> 172.21.15.59:0/2123806762 conn(0x7fcbf00fd8f0 msgr2=0x7fcbf00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/2123806762 shutdown_connections 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/2123806762 wait complete. 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.552+0000 7fcbf7e2a640 1 Processor -- start 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf7e2a640 1 -- start start 2024-09-10T10:59:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf7e2a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf0101df0 0x7fcbf00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf7e2a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbf01027a0 0x7fcbf0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf7e2a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 0x7fcbf0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf7e2a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0111fa0 con 0x7fcbf0106f20 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf7e2a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0111e20 con 0x7fcbf01027a0 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf7e2a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0112120 con 0x7fcbf0101df0 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf63c7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 0x7fcbf0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf63c7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 0x7fcbf0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53466/0 (socket says 172.21.15.59:53466) 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf63c7640 1 -- 172.21.15.59:0/1205971666 learned_addr learned my addr 172.21.15.59:0/1205971666 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf53c5640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbf01027a0 0x7fcbf0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf5bc6640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf0101df0 0x7fcbf00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf63c7640 1 -- 172.21.15.59:0/1205971666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf0101df0 msgr2=0x7fcbf00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf63c7640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf0101df0 0x7fcbf00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf63c7640 1 -- 172.21.15.59:0/1205971666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbf01027a0 msgr2=0x7fcbf0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf63c7640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbf01027a0 0x7fcbf0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf63c7640 1 -- 172.21.15.59:0/1205971666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf01a6900 con 0x7fcbf0106f20 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf53c5640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbf01027a0 0x7fcbf0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.553+0000 7fcbf63c7640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 0x7fcbf0074f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0031a60 tx=0x7fcbe0031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.554+0000 7fcbeeffd640 1 -- 172.21.15.59:0/1205971666 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0003c30 con 0x7fcbf0106f20 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.554+0000 7fcbeeffd640 1 -- 172.21.15.59:0/1205971666 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbe0003dd0 con 0x7fcbf0106f20 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.554+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf01a6b90 con 0x7fcbf0106f20 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.554+0000 7fcbeeffd640 1 -- 172.21.15.59:0/1205971666 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00047e0 con 0x7fcbf0106f20 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.554+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf01a70d0 con 0x7fcbf0106f20 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.555+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf01021d0 con 0x7fcbf0106f20 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.556+0000 7fcbeeffd640 1 -- 172.21.15.59:0/1205971666 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcbe002f790 con 0x7fcbf0106f20 2024-09-10T10:59:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.557+0000 7fcbeeffd640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcbd80a2b80 0x7fcbd80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.557+0000 7fcbf5bc6640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcbd80a2b80 0x7fcbd80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.557+0000 7fcbeeffd640 1 -- 172.21.15.59:0/1205971666 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fcbe00f0380 con 0x7fcbf0106f20 2024-09-10T10:59:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.557+0000 7fcbf5bc6640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcbd80a2b80 0x7fcbd80a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80058c0 tx=0x7fcbe800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.561+0000 7fcbeeffd640 1 -- 172.21.15.59:0/1205971666 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbe00bd430 con 0x7fcbf0106f20 2024-09-10T10:59:38.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:38.781+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fcbf002d7c0 con 0x7fcbf0106f20 2024-09-10T10:59:39.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.136+0000 7fcbeeffd640 1 -- 172.21.15.59:0/1205971666 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fcbe00bcd30 con 0x7fcbf0106f20 2024-09-10T10:59:39.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.139+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcbd80a2b80 msgr2=0x7fcbd80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:39.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.139+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcbd80a2b80 0x7fcbd80a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80058c0 tx=0x7fcbe800a4c0 comp rx=0 tx=0).stop 2024-09-10T10:59:39.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.139+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 msgr2=0x7fcbf0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:39.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.139+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 0x7fcbf0074f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0031a60 tx=0x7fcbe0031a90 comp rx=0 tx=0).stop 2024-09-10T10:59:39.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.139+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 shutdown_connections 2024-09-10T10:59:39.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.139+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fcbd80a2b80 0x7fcbd80a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:39.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.140+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbf0106f20 0x7fcbf0074f70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:39.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.140+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbf01027a0 0x7fcbf0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:39.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.140+0000 7fcbf7e2a640 1 --2- 172.21.15.59:0/1205971666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf0101df0 0x7fcbf00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:39.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.140+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 >> 172.21.15.59:0/1205971666 conn(0x7fcbf00fd8f0 msgr2=0x7fcbf00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:39.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.140+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 shutdown_connections 2024-09-10T10:59:39.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:39.140+0000 7fcbf7e2a640 1 -- 172.21.15.59:0/1205971666 wait complete. 2024-09-10T10:59:39.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-10T10:59:39.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:39 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1205971666' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-10T10:59:39.442 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-10T10:59:39.442 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-09-10T10:59:39.442 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-10T10:59:39.442 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-10T10:59:39.442 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-09-10T10:59:39.442 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-09-10T10:59:39.442 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-09-10T10:59:39.442 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-10T10:59:39.443 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-10T10:59:39.443 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-10T10:59:39.443 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:39 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1205971666' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-10T10:59:39.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-10T10:59:39.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-09-10T10:59:39.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-10T10:59:39.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-10T10:59:39.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-09-10T10:59:39.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-09-10T10:59:39.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-09-10T10:59:39.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-10T10:59:39.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-10T10:59:39.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-10T10:59:39.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:39 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1205971666' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-10T10:59:39.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T10:59:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:40.415 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T10:59:40.415 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:59:40.415 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1205971666' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T10:59:40.415 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-10T10:59:40.415 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-10T10:59:40.415 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T10:59:40.416 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:40 smithi059 ceph-mon[30978]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T10:59:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T10:59:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:59:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1205971666' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:40.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T10:59:40.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:40 smithi181 ceph-mon[35409]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T10:59:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T10:59:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:59:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1205971666' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:59:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T10:59:40.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:40 smithi115 ceph-mon[34719]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T10:59:40.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.645+0000 7f64cf9c4640 1 -- 172.21.15.59:0/796250956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8101de0 msgr2=0x7f64c81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:40.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.645+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/796250956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8101de0 0x7f64c81021c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009900 tx=0x7f64c402a410 comp rx=0 tx=0).stop 2024-09-10T10:59:40.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.645+0000 7f64cf9c4640 1 -- 172.21.15.59:0/796250956 shutdown_connections 2024-09-10T10:59:40.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.645+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/796250956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c8106f10 0x7f64c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:40.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.645+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/796250956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c8102790 0x7f64c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:40.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.645+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/796250956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8101de0 0x7f64c81021c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.645+0000 7f64cf9c4640 1 -- 172.21.15.59:0/796250956 >> 172.21.15.59:0/796250956 conn(0x7f64c80fd8c0 msgr2=0x7f64c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.645+0000 7f64cf9c4640 1 -- 172.21.15.59:0/796250956 shutdown_connections 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.645+0000 7f64cf9c4640 1 -- 172.21.15.59:0/796250956 wait complete. 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cf9c4640 1 Processor -- start 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cf9c4640 1 -- start start 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cf9c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c8101de0 0x7f64c8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cf9c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c8102790 0x7f64c81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cf9c4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8106f10 0x7f64c819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cf9c4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f64c8111f90 con 0x7f64c8106f10 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cf9c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f64c8111e10 con 0x7f64c8102790 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cf9c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f64c8112110 con 0x7f64c8101de0 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cdf61640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8106f10 0x7f64c819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cdf61640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8106f10 0x7f64c819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53488/0 (socket says 172.21.15.59:53488) 2024-09-10T10:59:40.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cdf61640 1 -- 172.21.15.59:0/3913581488 learned_addr learned my addr 172.21.15.59:0/3913581488 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.646+0000 7f64cd760640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c8101de0 0x7f64c8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64ccf5f640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c8102790 0x7f64c81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64cdf61640 1 -- 172.21.15.59:0/3913581488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c8101de0 msgr2=0x7f64c8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64cdf61640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c8101de0 0x7f64c8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64cdf61640 1 -- 172.21.15.59:0/3913581488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c8102790 msgr2=0x7f64c81989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64cdf61640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c8102790 0x7f64c81989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64cdf61640 1 -- 172.21.15.59:0/3913581488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c819d440 con 0x7f64c8106f10 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64ccf5f640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c8102790 0x7f64c81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64cdf61640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8106f10 0x7f64c819cd60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f64c000eaa0 tx=0x7f64c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64be7fc640 1 -- 172.21.15.59:0/3913581488 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c000cdb0 con 0x7f64c8106f10 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64be7fc640 1 -- 172.21.15.59:0/3913581488 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64c0005020 con 0x7f64c8106f10 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64be7fc640 1 -- 172.21.15.59:0/3913581488 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c00116b0 con 0x7f64c8106f10 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c819d730 con 0x7f64c8106f10 2024-09-10T10:59:40.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.647+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c81a5010 con 0x7f64c8106f10 2024-09-10T10:59:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.648+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c81021c0 con 0x7f64c8106f10 2024-09-10T10:59:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.649+0000 7f64be7fc640 1 -- 172.21.15.59:0/3913581488 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f64c0005560 con 0x7f64c8106f10 2024-09-10T10:59:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.650+0000 7f64be7fc640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f64b40a2b80 0x7f64b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.650+0000 7f64be7fc640 1 -- 172.21.15.59:0/3913581488 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f64c00cf6c0 con 0x7f64c8106f10 2024-09-10T10:59:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.650+0000 7f64cd760640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f64b40a2b80 0x7f64b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.651+0000 7f64cd760640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f64b40a2b80 0x7f64b40a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009230 tx=0x7f64c40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:40.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.653+0000 7f64be7fc640 1 -- 172.21.15.59:0/3913581488 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64c0016030 con 0x7f64c8106f10 2024-09-10T10:59:40.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:40.865+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f64c802d7c0 con 0x7f64c8106f10 2024-09-10T10:59:41.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.151+0000 7f64be7fc640 1 -- 172.21.15.59:0/3913581488 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f64c009c600 con 0x7f64c8106f10 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f64b40a2b80 msgr2=0x7f64b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f64b40a2b80 0x7f64b40a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009230 tx=0x7f64c40058d0 comp rx=0 tx=0).stop 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8106f10 msgr2=0x7f64c819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8106f10 0x7f64c819cd60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f64c000eaa0 tx=0x7f64c000ef60 comp rx=0 tx=0).stop 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 shutdown_connections 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f64b40a2b80 0x7f64b40a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c8106f10 0x7f64c819cd60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c8102790 0x7f64c81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 --2- 172.21.15.59:0/3913581488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c8101de0 0x7f64c8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 >> 172.21.15.59:0/3913581488 conn(0x7f64c80fd8c0 msgr2=0x7f64c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 shutdown_connections 2024-09-10T10:59:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:41.154+0000 7f64cf9c4640 1 -- 172.21.15.59:0/3913581488 wait complete. 2024-09-10T10:59:41.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:41 smithi181 ceph-mon[35409]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T10:59:41.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:41 smithi181 ceph-mon[35409]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T10:59:41.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:41 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3913581488' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:59:41.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:41 smithi115 ceph-mon[34719]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T10:59:41.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:41 smithi115 ceph-mon[34719]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T10:59:41.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:41 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3913581488' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:59:41.459 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 10:59:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b[65348]: 2024-09-10T10:59:41.380+0000 7fa8aa462640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T10:59:41.530 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:41 smithi059 ceph-mon[30978]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T10:59:41.530 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:41 smithi059 ceph-mon[30978]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T10:59:41.530 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:41 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3913581488' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:59:41.892 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T10:59:42.156 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:42.419 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:42 smithi059 ceph-mon[30978]: pgmap v284: 97 pgs: 1 peering, 96 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T10:59:42.419 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:42 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3913581488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:59:42.419 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:42 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] up:active 2024-09-10T10:59:42.419 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:42 smithi059 ceph-mon[30978]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T10:59:42.419 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:42 smithi059 ceph-mon[30978]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:59:42.419 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:42 smithi059 ceph-mon[30978]: Cluster is now healthy 2024-09-10T10:59:42.419 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:42 smithi059 ceph-mon[30978]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T10:59:42.419 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:42 smithi059 ceph-mon[30978]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T10:59:42.419 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:42 smithi059 ceph-mon[30978]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T10:59:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:42 smithi181 ceph-mon[35409]: pgmap v284: 97 pgs: 1 peering, 96 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T10:59:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:42 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3913581488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:59:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:42 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] up:active 2024-09-10T10:59:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:42 smithi181 ceph-mon[35409]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T10:59:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:42 smithi181 ceph-mon[35409]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:59:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:42 smithi181 ceph-mon[35409]: Cluster is now healthy 2024-09-10T10:59:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:42 smithi181 ceph-mon[35409]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T10:59:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:42 smithi181 ceph-mon[35409]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T10:59:42.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:42 smithi181 ceph-mon[35409]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T10:59:42.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:42 smithi115 ceph-mon[34719]: pgmap v284: 97 pgs: 1 peering, 96 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T10:59:42.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:42 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3913581488' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:59:42.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:42 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] up:active 2024-09-10T10:59:42.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:42 smithi115 ceph-mon[34719]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T10:59:42.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:42 smithi115 ceph-mon[34719]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:59:42.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:42 smithi115 ceph-mon[34719]: Cluster is now healthy 2024-09-10T10:59:42.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:42 smithi115 ceph-mon[34719]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T10:59:42.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:42 smithi115 ceph-mon[34719]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T10:59:42.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:42 smithi115 ceph-mon[34719]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T10:59:42.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.642+0000 7f12e3542640 1 -- 172.21.15.59:0/3043731211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 msgr2=0x7f12dc100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:42.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.642+0000 7f12e3542640 1 --2- 172.21.15.59:0/3043731211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 0x7f12dc100ef0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009930 tx=0x7f12cc02a420 comp rx=0 tx=0).stop 2024-09-10T10:59:42.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.642+0000 7f12e3542640 1 -- 172.21.15.59:0/3043731211 shutdown_connections 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.642+0000 7f12e3542640 1 --2- 172.21.15.59:0/3043731211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc101430 0x7f12dc10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.642+0000 7f12e3542640 1 --2- 172.21.15.59:0/3043731211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 0x7f12dc100ef0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.642+0000 7f12e3542640 1 --2- 172.21.15.59:0/3043731211 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12dc106a90 0x7f12dc106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.642+0000 7f12e3542640 1 -- 172.21.15.59:0/3043731211 >> 172.21.15.59:0/3043731211 conn(0x7f12dc0fc7d0 msgr2=0x7f12dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.643+0000 7f12e3542640 1 -- 172.21.15.59:0/3043731211 shutdown_connections 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.643+0000 7f12e3542640 1 -- 172.21.15.59:0/3043731211 wait complete. 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.643+0000 7f12e3542640 1 Processor -- start 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.643+0000 7f12e3542640 1 -- start start 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.643+0000 7f12e3542640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 0x7f12dc0fce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e3542640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc101430 0x7f12dc0fd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e3542640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12dc106a90 0x7f12dc0fd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e3542640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc110ea0 con 0x7f12dc100a90 2024-09-10T10:59:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e3542640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc110d20 con 0x7f12dc101430 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e3542640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc111020 con 0x7f12dc106a90 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e12de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 0x7f12dc0fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e12de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 0x7f12dc0fce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53508/0 (socket says 172.21.15.59:53508) 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e12de640 1 -- 172.21.15.59:0/157832335 learned_addr learned my addr 172.21.15.59:0/157832335 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e12de640 1 -- 172.21.15.59:0/157832335 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12dc106a90 msgr2=0x7f12dc0fd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e12de640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12dc106a90 0x7f12dc0fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e0add640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc101430 0x7f12dc0fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e12de640 1 -- 172.21.15.59:0/157832335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc101430 msgr2=0x7f12dc0fd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e12de640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc101430 0x7f12dc0fd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e12de640 1 -- 172.21.15.59:0/157832335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc1a6940 con 0x7f12dc100a90 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e0add640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc101430 0x7f12dc0fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e12de640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 0x7f12dc0fce00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12d800d950 tx=0x7f12d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12d27fc640 1 -- 172.21.15.59:0/157832335 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8017070 con 0x7f12dc100a90 2024-09-10T10:59:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12d27fc640 1 -- 172.21.15.59:0/157832335 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d8009c30 con 0x7f12dc100a90 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc1a6c30 con 0x7f12dc100a90 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12d27fc640 1 -- 172.21.15.59:0/157832335 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d800f6b0 con 0x7f12dc100a90 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.644+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc1a71c0 con 0x7f12dc100a90 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.645+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12dc100ef0 con 0x7f12dc100a90 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.647+0000 7f12d27fc640 1 -- 172.21.15.59:0/157832335 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f12d80109d0 con 0x7f12dc100a90 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.647+0000 7f12d27fc640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f12c80a2c00 0x7f12c80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.647+0000 7f12e0add640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f12c80a2c00 0x7f12c80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.647+0000 7f12d27fc640 1 -- 172.21.15.59:0/157832335 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f12d80cec30 con 0x7f12dc100a90 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.648+0000 7f12e0add640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f12c80a2c00 0x7f12c80a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12cc02a940 tx=0x7f12cc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.651+0000 7f12d27fc640 1 -- 172.21.15.59:0/157832335 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12d8009de0 con 0x7f12dc100a90 2024-09-10T10:59:42.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:42.864+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f12dc0fe330 con 0x7f12dc100a90 2024-09-10T10:59:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.173+0000 7f12d27fc640 1 -- 172.21.15.59:0/157832335 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f12d809bb70 con 0x7f12dc100a90 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f12c80a2c00 msgr2=0x7f12c80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f12c80a2c00 0x7f12c80a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12cc02a940 tx=0x7f12cc005fd0 comp rx=0 tx=0).stop 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 msgr2=0x7f12dc0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 0x7f12dc0fce00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12d800d950 tx=0x7f12d800de10 comp rx=0 tx=0).stop 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 shutdown_connections 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f12c80a2c00 0x7f12c80a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12dc106a90 0x7f12dc0fd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc101430 0x7f12dc0fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 --2- 172.21.15.59:0/157832335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12dc100a90 0x7f12dc0fce00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 >> 172.21.15.59:0/157832335 conn(0x7f12dc0fc7d0 msgr2=0x7f12dc06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 shutdown_connections 2024-09-10T10:59:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:43.176+0000 7f12e3542640 1 -- 172.21.15.59:0/157832335 wait complete. 2024-09-10T10:59:43.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:43 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] up:active 2024-09-10T10:59:43.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:43 smithi181 ceph-mon[35409]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T10:59:43.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:43 smithi181 ceph-mon[35409]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:59:43.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:43 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/157832335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T10:59:43.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:43 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] up:active 2024-09-10T10:59:43.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:43 smithi115 ceph-mon[34719]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T10:59:43.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:43 smithi115 ceph-mon[34719]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:59:43.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:43 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/157832335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T10:59:43.556 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:43 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] up:active 2024-09-10T10:59:43.556 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:43 smithi059 ceph-mon[30978]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T10:59:43.556 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:43 smithi059 ceph-mon[30978]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:59:43.556 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:43 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/157832335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T10:59:43.933 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-10T10:59:43.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T10:59:44.200 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:44.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:44 smithi181 ceph-mon[35409]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 1 op/s 2024-09-10T10:59:44.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:44 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/157832335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T10:59:44.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:44 smithi181 ceph-mon[35409]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:59:44.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:44 smithi115 ceph-mon[34719]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 1 op/s 2024-09-10T10:59:44.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:44 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/157832335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T10:59:44.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:44 smithi115 ceph-mon[34719]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:59:44.462 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:44 smithi059 ceph-mon[30978]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 1 op/s 2024-09-10T10:59:44.462 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:44 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/157832335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T10:59:44.462 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:44 smithi059 ceph-mon[30978]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:59:44.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.685+0000 7efec7eb2640 1 -- 172.21.15.59:0/2288817964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 msgr2=0x7efec01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:44.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.685+0000 7efec7eb2640 1 --2- 172.21.15.59:0/2288817964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 0x7efec01021c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efebc009900 tx=0x7efebc02a410 comp rx=0 tx=0).stop 2024-09-10T10:59:44.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.685+0000 7efec7eb2640 1 -- 172.21.15.59:0/2288817964 shutdown_connections 2024-09-10T10:59:44.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.685+0000 7efec7eb2640 1 --2- 172.21.15.59:0/2288817964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec0106f10 0x7efec010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.685+0000 7efec7eb2640 1 --2- 172.21.15.59:0/2288817964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec0102790 0x7efec01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.685+0000 7efec7eb2640 1 --2- 172.21.15.59:0/2288817964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 0x7efec01021c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.685+0000 7efec7eb2640 1 -- 172.21.15.59:0/2288817964 >> 172.21.15.59:0/2288817964 conn(0x7efec00fd8c0 msgr2=0x7efec00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.685+0000 7efec7eb2640 1 -- 172.21.15.59:0/2288817964 shutdown_connections 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.685+0000 7efec7eb2640 1 -- 172.21.15.59:0/2288817964 wait complete. 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec7eb2640 1 Processor -- start 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec7eb2640 1 -- start start 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec7eb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 0x7efec01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec7eb2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec0102790 0x7efec0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec7eb2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec0106f10 0x7efec019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec7eb2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efec0112010 con 0x7efec0101de0 2024-09-10T10:59:44.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec7eb2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efec0111e90 con 0x7efec0106f10 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec7eb2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efec0112190 con 0x7efec0102790 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec5c4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 0x7efec01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec5c4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 0x7efec01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53512/0 (socket says 172.21.15.59:53512) 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec5c4e640 1 -- 172.21.15.59:0/3961597749 learned_addr learned my addr 172.21.15.59:0/3961597749 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec644f640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec0106f10 0x7efec019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec544d640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec0102790 0x7efec0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec5c4e640 1 -- 172.21.15.59:0/3961597749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec0102790 msgr2=0x7efec0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec5c4e640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec0102790 0x7efec0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec5c4e640 1 -- 172.21.15.59:0/3961597749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec0106f10 msgr2=0x7efec019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec5c4e640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec0106f10 0x7efec019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec5c4e640 1 -- 172.21.15.59:0/3961597749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec019d560 con 0x7efec0101de0 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.686+0000 7efec644f640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec0106f10 0x7efec019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:44.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.687+0000 7efec5c4e640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 0x7efec01985b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efebc005ab0 tx=0x7efebc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.687+0000 7efeb6ffd640 1 -- 172.21.15.59:0/3961597749 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc03f030 con 0x7efec0101de0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.687+0000 7efeb6ffd640 1 -- 172.21.15.59:0/3961597749 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efebc003ce0 con 0x7efec0101de0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.687+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec019d7f0 con 0x7efec0101de0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.687+0000 7efeb6ffd640 1 -- 172.21.15.59:0/3961597749 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc035070 con 0x7efec0101de0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.687+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec01a5130 con 0x7efec0101de0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.688+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec0102240 con 0x7efec0101de0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.689+0000 7efeb6ffd640 1 -- 172.21.15.59:0/3961597749 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efebc042030 con 0x7efec0101de0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.690+0000 7efeb6ffd640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efeac0a2c00 0x7efeac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.690+0000 7efec544d640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efeac0a2c00 0x7efeac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.690+0000 7efeb6ffd640 1 -- 172.21.15.59:0/3961597749 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7efebc0ef9f0 con 0x7efec0101de0 2024-09-10T10:59:44.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.690+0000 7efec544d640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efeac0a2c00 0x7efeac0a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efec00ffde0 tx=0x7efeb0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:44.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.694+0000 7efeb6ffd640 1 -- 172.21.15.59:0/3961597749 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efebc0bc8d0 con 0x7efec0101de0 2024-09-10T10:59:44.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.894+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7efec0062630 con 0x7efeac0a2c00 2024-09-10T10:59:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.921+0000 7efeb6ffd640 1 -- 172.21.15.59:0/3961597749 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efec0062630 con 0x7efeac0a2c00 2024-09-10T10:59:44.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efeac0a2c00 msgr2=0x7efeac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efeac0a2c00 0x7efeac0a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efec00ffde0 tx=0x7efeb0008040 comp rx=0 tx=0).stop 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 msgr2=0x7efec01985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 0x7efec01985b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efebc005ab0 tx=0x7efebc0042f0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 shutdown_connections 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efeac0a2c00 0x7efeac0a50c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec0106f10 0x7efec019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efec0102790 0x7efec0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 --2- 172.21.15.59:0/3961597749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efec0101de0 0x7efec01985b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 >> 172.21.15.59:0/3961597749 conn(0x7efec00fd8c0 msgr2=0x7efec00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 shutdown_connections 2024-09-10T10:59:44.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:44.923+0000 7efec7eb2640 1 -- 172.21.15.59:0/3961597749 wait complete. 2024-09-10T10:59:45.343 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:59:44 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:59:44.899+0000 7f51c05f4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:59:45.343 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:59:44 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:59:44.899+0000 7f51c05f4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:59:45.343 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:59:44 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:59:44.899+0000 7f51c05f4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:59:45.344 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:59:44 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:59:44.899+0000 7f51c05f4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:59:45.344 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 10:59:44 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T10:59:44.899+0000 7f51c05f4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:59:45.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T10:59:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:46.310 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:46 smithi059 ceph-mon[30978]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 3.0 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:46.310 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:46 smithi059 ceph-mon[30978]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:46.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.395+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3731043083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101200 msgr2=0x7f5d64101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:46.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.395+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3731043083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101200 0x7f5d64101660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009900 tx=0x7f5d4c02a410 comp rx=0 tx=0).stop 2024-09-10T10:59:46.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.395+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3731043083 shutdown_connections 2024-09-10T10:59:46.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.395+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3731043083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64101ba0 0x7f5d6410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:46.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.395+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3731043083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101200 0x7f5d64101660 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:46.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.395+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3731043083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d64105ad0 0x7f5d64105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:46.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.395+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3731043083 >> 172.21.15.59:0/3731043083 conn(0x7f5d64077210 msgr2=0x7f5d640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:46.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.396+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3731043083 shutdown_connections 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.396+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3731043083 wait complete. 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.396+0000 7f5d6a8df640 1 Processor -- start 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.396+0000 7f5d6a8df640 1 -- start start 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.396+0000 7f5d6a8df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64101200 0x7f5d64198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d6a8df640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101ba0 0x7f5d641989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d6a8df640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d64105ad0 0x7f5d6419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d6a8df640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d64110ef0 con 0x7f5d64101ba0 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d6a8df640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5d64110d70 con 0x7f5d64105ad0 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d6a8df640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5d64111070 con 0x7f5d64101200 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d5bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101ba0 0x7f5d641989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d5bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101ba0 0x7f5d641989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53538/0 (socket says 172.21.15.59:53538) 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d5bfff640 1 -- 172.21.15.59:0/3836482191 learned_addr learned my addr 172.21.15.59:0/3836482191 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:46.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d68e7c640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d64105ad0 0x7f5d6419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d63fff640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64101200 0x7f5d64198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d5bfff640 1 -- 172.21.15.59:0/3836482191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64101200 msgr2=0x7f5d64198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d5bfff640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64101200 0x7f5d64198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d5bfff640 1 -- 172.21.15.59:0/3836482191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d64105ad0 msgr2=0x7f5d6419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d5bfff640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d64105ad0 0x7f5d6419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d5bfff640 1 -- 172.21.15.59:0/3836482191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6419d430 con 0x7f5d64101ba0 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d63fff640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64101200 0x7f5d64198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d68e7c640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d64105ad0 0x7f5d6419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d5bfff640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101ba0 0x7f5d641989c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c006010 tx=0x7f5d4c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d61ffb640 1 -- 172.21.15.59:0/3836482191 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c03f070 con 0x7f5d64101ba0 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6419d6c0 con 0x7f5d64101ba0 2024-09-10T10:59:46.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d61ffb640 1 -- 172.21.15.59:0/3836482191 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d4c031e30 con 0x7f5d64101ba0 2024-09-10T10:59:46.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d61ffb640 1 -- 172.21.15.59:0/3836482191 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c035030 con 0x7f5d64101ba0 2024-09-10T10:59:46.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.397+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d641a5000 con 0x7f5d64101ba0 2024-09-10T10:59:46.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.398+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d64101660 con 0x7f5d64101ba0 2024-09-10T10:59:46.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.400+0000 7f5d61ffb640 1 -- 172.21.15.59:0/3836482191 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5d4c042070 con 0x7f5d64101ba0 2024-09-10T10:59:46.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.400+0000 7f5d61ffb640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d500a2b80 0x7f5d500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:46.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.401+0000 7f5d61ffb640 1 -- 172.21.15.59:0/3836482191 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f5d4c0f0050 con 0x7f5d64101ba0 2024-09-10T10:59:46.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.401+0000 7f5d63fff640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d500a2b80 0x7f5d500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:46.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.401+0000 7f5d63fff640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d500a2b80 0x7f5d500a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d54006fd0 tx=0x7f5d54008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:46.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.403+0000 7f5d61ffb640 1 -- 172.21.15.59:0/3836482191 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d4c0bd020 con 0x7f5d64101ba0 2024-09-10T10:59:46.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:46 smithi181 ceph-mon[35409]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 3.0 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:46.439 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:46 smithi181 ceph-mon[35409]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:46 smithi115 ceph-mon[34719]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 3.0 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:46 smithi115 ceph-mon[34719]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:46.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.605+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5d64062630 con 0x7f5d500a2b80 2024-09-10T10:59:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.630+0000 7f5d61ffb640 1 -- 172.21.15.59:0/3836482191 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5d64062630 con 0x7f5d500a2b80 2024-09-10T10:59:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d500a2b80 msgr2=0x7f5d500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d500a2b80 0x7f5d500a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d54006fd0 tx=0x7f5d54008040 comp rx=0 tx=0).stop 2024-09-10T10:59:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101ba0 msgr2=0x7f5d641989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101ba0 0x7f5d641989c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c006010 tx=0x7f5d4c003c80 comp rx=0 tx=0).stop 2024-09-10T10:59:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 shutdown_connections 2024-09-10T10:59:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d500a2b80 0x7f5d500a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d64105ad0 0x7f5d6419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d64101ba0 0x7f5d641989c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 --2- 172.21.15.59:0/3836482191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64101200 0x7f5d64198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 >> 172.21.15.59:0/3836482191 conn(0x7f5d64077210 msgr2=0x7f5d64100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 shutdown_connections 2024-09-10T10:59:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:46.632+0000 7f5d6a8df640 1 -- 172.21.15.59:0/3836482191 wait complete. 2024-09-10T10:59:47.306 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:47 smithi059 ceph-mon[30978]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:47.340 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T10:59:47.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:47 smithi115 ceph-mon[34719]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:47.603 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:47.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:47 smithi181 ceph-mon[35409]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:48.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.079+0000 7f07522c2640 1 -- 172.21.15.59:0/2846427804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102ef0 msgr2=0x7f074c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.079+0000 7f07522c2640 1 --2- 172.21.15.59:0/2846427804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102ef0 0x7f074c10da40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0744009ca0 tx=0x7f074402a950 comp rx=0 tx=0).stop 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.079+0000 7f07522c2640 1 -- 172.21.15.59:0/2846427804 shutdown_connections 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.079+0000 7f07522c2640 1 --2- 172.21.15.59:0/2846427804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102ef0 0x7f074c10da40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.079+0000 7f07522c2640 1 --2- 172.21.15.59:0/2846427804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c102570 0x7f074c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.079+0000 7f07522c2640 1 --2- 172.21.15.59:0/2846427804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f074c100e20 0x7f074c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.079+0000 7f07522c2640 1 -- 172.21.15.59:0/2846427804 >> 172.21.15.59:0/2846427804 conn(0x7f074c0fc7d0 msgr2=0x7f074c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.079+0000 7f07522c2640 1 -- 172.21.15.59:0/2846427804 shutdown_connections 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.079+0000 7f07522c2640 1 -- 172.21.15.59:0/2846427804 wait complete. 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f07522c2640 1 Processor -- start 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f07522c2640 1 -- start start 2024-09-10T10:59:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f07522c2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f074c100e20 0x7f074c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f07522c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102570 0x7f074c198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f07522c2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c102ef0 0x7f074c19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f07522c2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f074c111070 con 0x7f074c102570 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f07522c2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f074c110ef0 con 0x7f074c102ef0 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f07522c2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f074c1111f0 con 0x7f074c100e20 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f0743fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102570 0x7f074c198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f0743fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102570 0x7f074c198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50536/0 (socket says 172.21.15.59:50536) 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f0743fff640 1 -- 172.21.15.59:0/934392141 learned_addr learned my addr 172.21.15.59:0/934392141 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f074bfff640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f074c100e20 0x7f074c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f075085f640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c102ef0 0x7f074c19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f0743fff640 1 -- 172.21.15.59:0/934392141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f074c100e20 msgr2=0x7f074c198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f0743fff640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f074c100e20 0x7f074c198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f0743fff640 1 -- 172.21.15.59:0/934392141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c102ef0 msgr2=0x7f074c19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f0743fff640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c102ef0 0x7f074c19ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f0743fff640 1 -- 172.21.15.59:0/934392141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074c19d5b0 con 0x7f074c102570 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.080+0000 7f074bfff640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f074c100e20 0x7f074c198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.081+0000 7f0743fff640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102570 0x7f074c198b40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f073400b4a0 tx=0x7f073400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.081+0000 7f0749ffb640 1 -- 172.21.15.59:0/934392141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734014070 con 0x7f074c102570 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.081+0000 7f0749ffb640 1 -- 172.21.15.59:0/934392141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0734010af0 con 0x7f074c102570 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.081+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074c19d8a0 con 0x7f074c102570 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.081+0000 7f0749ffb640 1 -- 172.21.15.59:0/934392141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734017d10 con 0x7f074c102570 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.081+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074c1a5180 con 0x7f074c102570 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.082+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074c101280 con 0x7f074c102570 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.083+0000 7f0749ffb640 1 -- 172.21.15.59:0/934392141 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0734017070 con 0x7f074c102570 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.084+0000 7f0749ffb640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f07380a2c90 0x7f07380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.084+0000 7f074bfff640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f07380a2c90 0x7f07380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.084+0000 7f0749ffb640 1 -- 172.21.15.59:0/934392141 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f07340ce3d0 con 0x7f074c102570 2024-09-10T10:59:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.084+0000 7f074bfff640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f07380a2c90 0x7f07380a5150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f073c009930 tx=0x7f073c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.088+0000 7f0749ffb640 1 -- 172.21.15.59:0/934392141 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f073409b2c0 con 0x7f074c102570 2024-09-10T10:59:48.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.291+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f074c062630 con 0x7f07380a2c90 2024-09-10T10:59:48.293 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:48 smithi059 ceph-mon[30978]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:48.293 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:48 smithi059 ceph-mon[30978]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T10:59:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.296+0000 7f0749ffb640 1 -- 172.21.15.59:0/934392141 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f074c062630 con 0x7f07380a2c90 2024-09-10T10:59:48.298 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/qa/sv_0/2fea7f2c-eff9-45e6-a69c-3b72381a8a87 2024-09-10T10:59:48.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f07380a2c90 msgr2=0x7f07380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:48.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f07380a2c90 0x7f07380a5150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f073c009930 tx=0x7f073c008040 comp rx=0 tx=0).stop 2024-09-10T10:59:48.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102570 msgr2=0x7f074c198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:48.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102570 0x7f074c198b40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f073400b4a0 tx=0x7f073400b960 comp rx=0 tx=0).stop 2024-09-10T10:59:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 shutdown_connections 2024-09-10T10:59:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f07380a2c90 0x7f07380a5150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f074c102ef0 0x7f074c19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f074c102570 0x7f074c198b40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 --2- 172.21.15.59:0/934392141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f074c100e20 0x7f074c198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 >> 172.21.15.59:0/934392141 conn(0x7f074c0fc7d0 msgr2=0x7f074c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 shutdown_connections 2024-09-10T10:59:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:48.298+0000 7f07522c2640 1 -- 172.21.15.59:0/934392141 wait complete. 2024-09-10T10:59:48.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:48 smithi115 ceph-mon[34719]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:48.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:48 smithi115 ceph-mon[34719]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T10:59:48.587 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:48 smithi181 ceph-mon[35409]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:48.588 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:48 smithi181 ceph-mon[35409]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T10:59:49.150 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T10:59:49.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:49 smithi059 ceph-mon[30978]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:49.414 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:49.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:49 smithi115 ceph-mon[34719]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:49.603 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:49 smithi181 ceph-mon[35409]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 -- 172.21.15.59:0/152585083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8458101df0 msgr2=0x7f84581021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 --2- 172.21.15.59:0/152585083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8458101df0 0x7f84581021d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8448009900 tx=0x7f844802a410 comp rx=0 tx=0).stop 2024-09-10T10:59:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 -- 172.21.15.59:0/152585083 shutdown_connections 2024-09-10T10:59:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 --2- 172.21.15.59:0/152585083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8458106f20 0x7f845810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 --2- 172.21.15.59:0/152585083 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84581027a0 0x7f84581067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 --2- 172.21.15.59:0/152585083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8458101df0 0x7f84581021d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 -- 172.21.15.59:0/152585083 >> 172.21.15.59:0/152585083 conn(0x7f84580fd8f0 msgr2=0x7f84580ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 -- 172.21.15.59:0/152585083 shutdown_connections 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 -- 172.21.15.59:0/152585083 wait complete. 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 Processor -- start 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.913+0000 7f845e341640 1 -- start start 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f845e341640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8458101df0 0x7f8458198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f845e341640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84581027a0 0x7f84581989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f845e341640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8458106f20 0x7f845819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f845e341640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8458111f40 con 0x7f84581027a0 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f845e341640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8458111dc0 con 0x7f8458101df0 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f845e341640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84581120c0 con 0x7f8458106f20 2024-09-10T10:59:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f844ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84581027a0 0x7f84581989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f844ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84581027a0 0x7f84581989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50554/0 (socket says 172.21.15.59:50554) 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f844ffff640 1 -- 172.21.15.59:0/2628297457 learned_addr learned my addr 172.21.15.59:0/2628297457 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f845c8de640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8458106f20 0x7f845819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f8457fff640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8458101df0 0x7f8458198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f844ffff640 1 -- 172.21.15.59:0/2628297457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8458106f20 msgr2=0x7f845819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f844ffff640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8458106f20 0x7f845819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f844ffff640 1 -- 172.21.15.59:0/2628297457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8458101df0 msgr2=0x7f8458198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f844ffff640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8458101df0 0x7f8458198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f844ffff640 1 -- 172.21.15.59:0/2628297457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845819d410 con 0x7f84581027a0 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f844ffff640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84581027a0 0x7f84581989a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f844000d950 tx=0x7f844000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f8455ffb640 1 -- 172.21.15.59:0/2628297457 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440017030 con 0x7f84581027a0 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845819d700 con 0x7f84581027a0 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f8455ffb640 1 -- 172.21.15.59:0/2628297457 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8440004020 con 0x7f84581027a0 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.914+0000 7f8455ffb640 1 -- 172.21.15.59:0/2628297457 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84400047a0 con 0x7f84581027a0 2024-09-10T10:59:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.915+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84581a4fe0 con 0x7f84581027a0 2024-09-10T10:59:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.916+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84581021d0 con 0x7f84581027a0 2024-09-10T10:59:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.917+0000 7f8455ffb640 1 -- 172.21.15.59:0/2628297457 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f84400041d0 con 0x7f84581027a0 2024-09-10T10:59:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.917+0000 7f8455ffb640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f84440a2c10 0x7f84440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.917+0000 7f8455ffb640 1 -- 172.21.15.59:0/2628297457 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f84400ceb20 con 0x7f84581027a0 2024-09-10T10:59:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.917+0000 7f8457fff640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f84440a2c10 0x7f84440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.918+0000 7f8457fff640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f84440a2c10 0x7f84440a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8448009230 tx=0x7f84480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:49.922+0000 7f8455ffb640 1 -- 172.21.15.59:0/2628297457 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f844009b900 con 0x7f84581027a0 2024-09-10T10:59:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.122+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8458062630 con 0x7f84440a2c10 2024-09-10T10:59:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.148+0000 7f8455ffb640 1 -- 172.21.15.59:0/2628297457 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8458062630 con 0x7f84440a2c10 2024-09-10T10:59:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f84440a2c10 msgr2=0x7f84440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f84440a2c10 0x7f84440a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8448009230 tx=0x7f84480058d0 comp rx=0 tx=0).stop 2024-09-10T10:59:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84581027a0 msgr2=0x7f84581989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84581027a0 0x7f84581989a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f844000d950 tx=0x7f844000de10 comp rx=0 tx=0).stop 2024-09-10T10:59:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 shutdown_connections 2024-09-10T10:59:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f84440a2c10 0x7f84440a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8458106f20 0x7f845819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84581027a0 0x7f84581989a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 --2- 172.21.15.59:0/2628297457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8458101df0 0x7f8458198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 >> 172.21.15.59:0/2628297457 conn(0x7f84580fd8f0 msgr2=0x7f84580fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 shutdown_connections 2024-09-10T10:59:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:50.150+0000 7f845e341640 1 -- 172.21.15.59:0/2628297457 wait complete. 2024-09-10T10:59:50.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:50 smithi059 ceph-mon[30978]: pgmap v288: 97 pgs: 97 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:50.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:50 smithi115 ceph-mon[34719]: pgmap v288: 97 pgs: 97 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:50.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:50 smithi181 ceph-mon[35409]: pgmap v288: 97 pgs: 97 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:50.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T10:59:51.205 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:51.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:51 smithi115 ceph-mon[34719]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:51.462 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:51 smithi059 ceph-mon[30978]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:51.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:51 smithi181 ceph-mon[35409]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:51.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.704+0000 7faccd8ce640 1 -- 172.21.15.59:0/1316196728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8101de0 msgr2=0x7facc81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:51.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.704+0000 7faccd8ce640 1 --2- 172.21.15.59:0/1316196728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8101de0 0x7facc81021c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7facb8009900 tx=0x7facb802a410 comp rx=0 tx=0).stop 2024-09-10T10:59:51.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.704+0000 7faccd8ce640 1 -- 172.21.15.59:0/1316196728 shutdown_connections 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.704+0000 7faccd8ce640 1 --2- 172.21.15.59:0/1316196728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facc8106f10 0x7facc810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.704+0000 7faccd8ce640 1 --2- 172.21.15.59:0/1316196728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facc8102790 0x7facc81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.704+0000 7faccd8ce640 1 --2- 172.21.15.59:0/1316196728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8101de0 0x7facc81021c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.704+0000 7faccd8ce640 1 -- 172.21.15.59:0/1316196728 >> 172.21.15.59:0/1316196728 conn(0x7facc80fd8c0 msgr2=0x7facc80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.704+0000 7faccd8ce640 1 -- 172.21.15.59:0/1316196728 shutdown_connections 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.704+0000 7faccd8ce640 1 -- 172.21.15.59:0/1316196728 wait complete. 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.705+0000 7faccd8ce640 1 Processor -- start 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.705+0000 7faccd8ce640 1 -- start start 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.705+0000 7faccd8ce640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facc8101de0 0x7facc819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.705+0000 7faccd8ce640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facc8102790 0x7facc819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.705+0000 7faccd8ce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8106f10 0x7facc819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7faccd8ce640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facc8112000 con 0x7facc8106f10 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7faccd8ce640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7facc8111e80 con 0x7facc8102790 2024-09-10T10:59:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7faccd8ce640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7facc8112180 con 0x7facc8101de0 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8106f10 0x7facc819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8106f10 0x7facc819ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50560/0 (socket says 172.21.15.59:50560) 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc77fe640 1 -- 172.21.15.59:0/3099358482 learned_addr learned my addr 172.21.15.59:0/3099358482 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc6ffd640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facc8101de0 0x7facc819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc67fc640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facc8102790 0x7facc819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc77fe640 1 -- 172.21.15.59:0/3099358482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facc8101de0 msgr2=0x7facc819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc77fe640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facc8101de0 0x7facc819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc77fe640 1 -- 172.21.15.59:0/3099358482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facc8102790 msgr2=0x7facc819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc77fe640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facc8102790 0x7facc819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc77fe640 1 -- 172.21.15.59:0/3099358482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc819f650 con 0x7facc8106f10 2024-09-10T10:59:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc67fc640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facc8102790 0x7facc819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7facc77fe640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8106f10 0x7facc819ef70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7facc000b970 tx=0x7facc000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7faccc8cc640 1 -- 172.21.15.59:0/3099358482 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0019070 con 0x7facc8106f10 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7faccc8cc640 1 -- 172.21.15.59:0/3099358482 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facc000cb40 con 0x7facc8106f10 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc819f940 con 0x7facc8106f10 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7faccc8cc640 1 -- 172.21.15.59:0/3099358482 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0007650 con 0x7facc8106f10 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.706+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc81a7220 con 0x7facc8106f10 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.707+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc81021c0 con 0x7facc8106f10 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.709+0000 7faccc8cc640 1 -- 172.21.15.59:0/3099358482 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7facc001c070 con 0x7facc8106f10 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.709+0000 7faccc8cc640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7facb00a2c10 0x7facb00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.709+0000 7facc6ffd640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7facb00a2c10 0x7facb00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:51.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.709+0000 7faccc8cc640 1 -- 172.21.15.59:0/3099358482 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7facc00ce730 con 0x7facc8106f10 2024-09-10T10:59:51.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.710+0000 7facc6ffd640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7facb00a2c10 0x7facb00a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7facb8000c00 tx=0x7facb8005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:51.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.714+0000 7faccc8cc640 1 -- 172.21.15.59:0/3099358482 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facc009af70 con 0x7facc8106f10 2024-09-10T10:59:51.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.915+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7facc810de00 con 0x7facb00a2c10 2024-09-10T10:59:51.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.920+0000 7faccc8cc640 1 -- 172.21.15.59:0/3099358482 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7facc810de00 con 0x7facb00a2c10 2024-09-10T10:59:51.922 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/qa/sv_1/1635a070-6a40-4e0b-9e85-2e9c2735d50c 2024-09-10T10:59:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7facb00a2c10 msgr2=0x7facb00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7facb00a2c10 0x7facb00a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7facb8000c00 tx=0x7facb8005df0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8106f10 msgr2=0x7facc819ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8106f10 0x7facc819ef70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7facc000b970 tx=0x7facc000be30 comp rx=0 tx=0).stop 2024-09-10T10:59:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 shutdown_connections 2024-09-10T10:59:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7facb00a2c10 0x7facb00a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8106f10 0x7facc819ef70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facc8102790 0x7facc819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 --2- 172.21.15.59:0/3099358482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facc8101de0 0x7facc819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 >> 172.21.15.59:0/3099358482 conn(0x7facc80fd8c0 msgr2=0x7facc80feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 shutdown_connections 2024-09-10T10:59:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:51.922+0000 7faccd8ce640 1 -- 172.21.15.59:0/3099358482 wait complete. 2024-09-10T10:59:52.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:52 smithi115 ceph-mon[34719]: pgmap v289: 97 pgs: 97 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.8 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:52.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:52 smithi059 ceph-mon[30978]: pgmap v289: 97 pgs: 97 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.8 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:52.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:52 smithi181 ceph-mon[35409]: pgmap v289: 97 pgs: 97 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.8 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:52.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:59:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:53.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:53 smithi115 ceph-mon[34719]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:53.469 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:53 smithi059 ceph-mon[30978]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:53.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.549+0000 7fe8e29e6640 1 -- 172.21.15.59:0/3558851216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc102e00 msgr2=0x7fe8dc1031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.549+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/3558851216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc102e00 0x7fe8dc1031e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009900 tx=0x7fe8cc02a480 comp rx=0 tx=0).stop 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.550+0000 7fe8e29e6640 1 -- 172.21.15.59:0/3558851216 shutdown_connections 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.550+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/3558851216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8dc10c1a0 0x7fe8dc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.550+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/3558851216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8dc103720 0x7fe8dc10bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.550+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/3558851216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc102e00 0x7fe8dc1031e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.550+0000 7fe8e29e6640 1 -- 172.21.15.59:0/3558851216 >> 172.21.15.59:0/3558851216 conn(0x7fe8dc0fc7a0 msgr2=0x7fe8dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.550+0000 7fe8e29e6640 1 -- 172.21.15.59:0/3558851216 shutdown_connections 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.550+0000 7fe8e29e6640 1 -- 172.21.15.59:0/3558851216 wait complete. 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.550+0000 7fe8e29e6640 1 Processor -- start 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.550+0000 7fe8e29e6640 1 -- start start 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8e29e6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8dc102e00 0x7fe8dc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8e29e6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc103720 0x7fe8dc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8e29e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8dc10c1a0 0x7fe8dc19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8e29e6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc111fb0 con 0x7fe8dc103720 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8e29e6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc111e30 con 0x7fe8dc102e00 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8e29e6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc112130 con 0x7fe8dc10c1a0 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc103720 0x7fe8dc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc103720 0x7fe8dc1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50588/0 (socket says 172.21.15.59:50588) 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d3fff640 1 -- 172.21.15.59:0/903292913 learned_addr learned my addr 172.21.15.59:0/903292913 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8e0f83640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8dc10c1a0 0x7fe8dc19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8dbfff640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8dc102e00 0x7fe8dc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d3fff640 1 -- 172.21.15.59:0/903292913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8dc10c1a0 msgr2=0x7fe8dc19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d3fff640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8dc10c1a0 0x7fe8dc19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d3fff640 1 -- 172.21.15.59:0/903292913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8dc102e00 msgr2=0x7fe8dc198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d3fff640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8dc102e00 0x7fe8dc198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d3fff640 1 -- 172.21.15.59:0/903292913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc19d420 con 0x7fe8dc103720 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8e0f83640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8dc10c1a0 0x7fe8dc19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8dbfff640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8dc102e00 0x7fe8dc198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d3fff640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc103720 0x7fe8dc1989b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400b4a0 tx=0x7fe8c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d9ffb640 1 -- 172.21.15.59:0/903292913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4014070 con 0x7fe8dc103720 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8d9ffb640 1 -- 172.21.15.59:0/903292913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8c4010af0 con 0x7fe8dc103720 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.551+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc19d710 con 0x7fe8dc103720 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.552+0000 7fe8d9ffb640 1 -- 172.21.15.59:0/903292913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4017d10 con 0x7fe8dc103720 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.552+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc1a4ff0 con 0x7fe8dc103720 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.553+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc1031e0 con 0x7fe8dc103720 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.554+0000 7fe8d9ffb640 1 -- 172.21.15.59:0/903292913 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe8c4017070 con 0x7fe8dc103720 2024-09-10T10:59:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.554+0000 7fe8d9ffb640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8c80a2c90 0x7fe8c80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.555+0000 7fe8dbfff640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8c80a2c90 0x7fe8c80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.555+0000 7fe8d9ffb640 1 -- 172.21.15.59:0/903292913 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe8c40ce550 con 0x7fe8dc103720 2024-09-10T10:59:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.555+0000 7fe8dbfff640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8c80a2c90 0x7fe8c80a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc000c00 tx=0x7fe8cc032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.559+0000 7fe8d9ffb640 1 -- 172.21.15.59:0/903292913 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8c409b3e0 con 0x7fe8dc103720 2024-09-10T10:59:53.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:53 smithi181 ceph-mon[35409]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:59:53.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.769+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8dc02d7c0 con 0x7fe8dc103720 2024-09-10T10:59:53.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.770+0000 7fe8d9ffb640 1 -- 172.21.15.59:0/903292913 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7fe8c409ace0 con 0x7fe8dc103720 2024-09-10T10:59:53.772 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:53.772 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"btime":"2024-09-10T10:59:43:166834+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:59:31.833573+0000","modified":"2024-09-10T10:59:42.866432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24470,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/411505011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":411505011},{"type":"v1","addr":"172.21.15.115:6839","nonce":411505011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24466,24470,24497]},"id":1}]} 2024-09-10T10:59:53.772 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 24 2024-09-10T10:59:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8c80a2c90 msgr2=0x7fe8c80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8c80a2c90 0x7fe8c80a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc000c00 tx=0x7fe8cc032d50 comp rx=0 tx=0).stop 2024-09-10T10:59:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc103720 msgr2=0x7fe8dc1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc103720 0x7fe8dc1989b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400b4a0 tx=0x7fe8c400b960 comp rx=0 tx=0).stop 2024-09-10T10:59:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 shutdown_connections 2024-09-10T10:59:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8c80a2c90 0x7fe8c80a5150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8dc10c1a0 0x7fe8dc19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc103720 0x7fe8dc1989b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 --2- 172.21.15.59:0/903292913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8dc102e00 0x7fe8dc198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 >> 172.21.15.59:0/903292913 conn(0x7fe8dc0fc7a0 msgr2=0x7fe8dc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 shutdown_connections 2024-09-10T10:59:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:53.772+0000 7fe8e29e6640 1 -- 172.21.15.59:0/903292913 wait complete. 2024-09-10T10:59:54.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:59:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:54 smithi115 ceph-mon[34719]: pgmap v290: 97 pgs: 97 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:54 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/903292913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:54.637 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:54 smithi059 ceph-mon[30978]: pgmap v290: 97 pgs: 97 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:54.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:54 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/903292913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:54.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:54 smithi181 ceph-mon[35409]: pgmap v290: 97 pgs: 97 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.3 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:54.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:54 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/903292913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:59:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.161+0000 7f5d74713640 1 -- 172.21.15.59:0/3681614311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c101420 msgr2=0x7f5d6c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.161+0000 7f5d74713640 1 --2- 172.21.15.59:0/3681614311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c101420 0x7f5d6c10d950 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009cd0 tx=0x7f5d6402a8e0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.161+0000 7f5d74713640 1 -- 172.21.15.59:0/3681614311 shutdown_connections 2024-09-10T10:59:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.161+0000 7f5d74713640 1 --2- 172.21.15.59:0/3681614311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c101420 0x7f5d6c10d950 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.161+0000 7f5d74713640 1 --2- 172.21.15.59:0/3681614311 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d6c100a80 0x7f5d6c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.161+0000 7f5d74713640 1 --2- 172.21.15.59:0/3681614311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d6c106a80 0x7f5d6c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.161+0000 7f5d74713640 1 -- 172.21.15.59:0/3681614311 >> 172.21.15.59:0/3681614311 conn(0x7f5d6c0fc7a0 msgr2=0x7f5d6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.161+0000 7f5d74713640 1 -- 172.21.15.59:0/3681614311 shutdown_connections 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.161+0000 7f5d74713640 1 -- 172.21.15.59:0/3681614311 wait complete. 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d74713640 1 Processor -- start 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d74713640 1 -- start start 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d74713640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d6c100a80 0x7f5d6c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d74713640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d6c101420 0x7f5d6c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d74713640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c106a80 0x7f5d6c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d74713640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c110e80 con 0x7f5d6c106a80 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d74713640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c110d00 con 0x7f5d6c100a80 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d74713640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c111000 con 0x7f5d6c101420 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d72cb0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c106a80 0x7f5d6c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d72cb0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c106a80 0x7f5d6c19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50600/0 (socket says 172.21.15.59:50600) 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d72cb0640 1 -- 172.21.15.59:0/2324706360 learned_addr learned my addr 172.21.15.59:0/2324706360 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d724af640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d6c100a80 0x7f5d6c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.162+0000 7f5d71cae640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d6c101420 0x7f5d6c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d72cb0640 1 -- 172.21.15.59:0/2324706360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d6c101420 msgr2=0x7f5d6c1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d72cb0640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d6c101420 0x7f5d6c1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d72cb0640 1 -- 172.21.15.59:0/2324706360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d6c100a80 msgr2=0x7f5d6c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d72cb0640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d6c100a80 0x7f5d6c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d72cb0640 1 -- 172.21.15.59:0/2324706360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6c19d450 con 0x7f5d6c106a80 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d72cb0640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c106a80 0x7f5d6c19cd70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d64005cc0 tx=0x7f5d64003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d637fe640 1 -- 172.21.15.59:0/2324706360 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64004040 con 0x7f5d6c106a80 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d637fe640 1 -- 172.21.15.59:0/2324706360 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d640046c0 con 0x7f5d6c106a80 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d637fe640 1 -- 172.21.15.59:0/2324706360 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64046480 con 0x7f5d6c106a80 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6c19d6e0 con 0x7f5d6c106a80 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.163+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6c1a5020 con 0x7f5d6c106a80 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.164+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d6c100ee0 con 0x7f5d6c106a80 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.165+0000 7f5d637fe640 1 -- 172.21.15.59:0/2324706360 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5d640305a0 con 0x7f5d6c106a80 2024-09-10T10:59:55.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.166+0000 7f5d637fe640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d580a2c10 0x7f5d580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:55.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.166+0000 7f5d637fe640 1 -- 172.21.15.59:0/2324706360 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f5d6402e030 con 0x7f5d6c106a80 2024-09-10T10:59:55.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.166+0000 7f5d724af640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d580a2c10 0x7f5d580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:55.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.167+0000 7f5d724af640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d580a2c10 0x7f5d580a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800bb60 tx=0x7f5d6800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:55.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.170+0000 7f5d637fe640 1 -- 172.21.15.59:0/2324706360 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d6404b060 con 0x7f5d6c106a80 2024-09-10T10:59:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.347+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d6c10a020 con 0x7f5d6c106a80 2024-09-10T10:59:55.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.349+0000 7f5d637fe640 1 -- 172.21.15.59:0/2324706360 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22784 (secure 0 0 0) 0x7f5d640bd750 con 0x7f5d6c106a80 2024-09-10T10:59:55.351 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:55.351 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":83,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T10:59:40.138508+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:59:27.480743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:59:30.088912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:59:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d580a2c10 msgr2=0x7f5d580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d580a2c10 0x7f5d580a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800bb60 tx=0x7f5d6800b390 comp rx=0 tx=0).stop 2024-09-10T10:59:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c106a80 msgr2=0x7f5d6c19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c106a80 0x7f5d6c19cd70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d64005cc0 tx=0x7f5d64003970 comp rx=0 tx=0).stop 2024-09-10T10:59:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 shutdown_connections 2024-09-10T10:59:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5d580a2c10 0x7f5d580a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d6c106a80 0x7f5d6c19cd70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d6c101420 0x7f5d6c1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 --2- 172.21.15.59:0/2324706360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d6c100a80 0x7f5d6c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 >> 172.21.15.59:0/2324706360 conn(0x7f5d6c0fc7a0 msgr2=0x7f5d6c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 shutdown_connections 2024-09-10T10:59:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:55.351+0000 7f5d74713640 1 -- 172.21.15.59:0/2324706360 wait complete. 2024-09-10T10:59:56.063 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T10:59:56.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:59:56.323 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:56.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:56 smithi059 ceph-mon[30978]: pgmap v291: 97 pgs: 97 active+clean; 627 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.6 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:56 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2324706360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:59:56.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:56 smithi181 ceph-mon[35409]: pgmap v291: 97 pgs: 97 active+clean; 627 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.6 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:56.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:56 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2324706360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:59:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:56 smithi115 ceph-mon[34719]: pgmap v291: 97 pgs: 97 active+clean; 627 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.6 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T10:59:56.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:56 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2324706360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:59:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.824+0000 7f51ee885640 1 -- 172.21.15.59:0/2449625147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8106a90 msgr2=0x7f51e8106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.824+0000 7f51ee885640 1 --2- 172.21.15.59:0/2449625147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8106a90 0x7f51e8106e70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009930 tx=0x7f51d802a420 comp rx=0 tx=0).stop 2024-09-10T10:59:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.824+0000 7f51ee885640 1 -- 172.21.15.59:0/2449625147 shutdown_connections 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.824+0000 7f51ee885640 1 --2- 172.21.15.59:0/2449625147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51e8101430 0x7f51e810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.824+0000 7f51ee885640 1 --2- 172.21.15.59:0/2449625147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51e8100a90 0x7f51e8100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.824+0000 7f51ee885640 1 --2- 172.21.15.59:0/2449625147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8106a90 0x7f51e8106e70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.824+0000 7f51ee885640 1 -- 172.21.15.59:0/2449625147 >> 172.21.15.59:0/2449625147 conn(0x7f51e80fc7d0 msgr2=0x7f51e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.824+0000 7f51ee885640 1 -- 172.21.15.59:0/2449625147 shutdown_connections 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.824+0000 7f51ee885640 1 -- 172.21.15.59:0/2449625147 wait complete. 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51ee885640 1 Processor -- start 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51ee885640 1 -- start start 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51ee885640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51e8100a90 0x7f51e81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51ee885640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8101430 0x7f51e8199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51ee885640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51e8106a90 0x7f51e81a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51ee885640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8110e90 con 0x7f51e8101430 2024-09-10T10:59:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51ee885640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8110d10 con 0x7f51e8106a90 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51ee885640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8111010 con 0x7f51e8100a90 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51dffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8101430 0x7f51e8199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51dffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8101430 0x7f51e8199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44490/0 (socket says 172.21.15.59:44490) 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51dffff640 1 -- 172.21.15.59:0/261801457 learned_addr learned my addr 172.21.15.59:0/261801457 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51e7fff640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51e8100a90 0x7f51e81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51ece22640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51e8106a90 0x7f51e81a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51dffff640 1 -- 172.21.15.59:0/261801457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51e8100a90 msgr2=0x7f51e81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51dffff640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51e8100a90 0x7f51e81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51dffff640 1 -- 172.21.15.59:0/261801457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51e8106a90 msgr2=0x7f51e81a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51dffff640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51e8106a90 0x7f51e81a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.825+0000 7f51dffff640 1 -- 172.21.15.59:0/261801457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e81a48a0 con 0x7f51e8101430 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.826+0000 7f51dffff640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8101430 0x7f51e8199820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f51d000d950 tx=0x7f51d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.826+0000 7f51e5ffb640 1 -- 172.21.15.59:0/261801457 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0017070 con 0x7f51e8101430 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.826+0000 7f51e5ffb640 1 -- 172.21.15.59:0/261801457 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d0009c30 con 0x7f51e8101430 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.826+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e81a4a70 con 0x7f51e8101430 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.826+0000 7f51e5ffb640 1 -- 172.21.15.59:0/261801457 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d000f6b0 con 0x7f51e8101430 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.826+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e81a4f80 con 0x7f51e8101430 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.827+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e8100ef0 con 0x7f51e8101430 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.828+0000 7f51e5ffb640 1 -- 172.21.15.59:0/261801457 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f51d00109d0 con 0x7f51e8101430 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.829+0000 7f51e5ffb640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51d40a2c10 0x7f51d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.829+0000 7f51e7fff640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51d40a2c10 0x7f51d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.829+0000 7f51e5ffb640 1 -- 172.21.15.59:0/261801457 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f51d00cedd0 con 0x7f51e8101430 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.829+0000 7f51e7fff640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51d40a2c10 0x7f51d40a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009900 tx=0x7f51d80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:56.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:56.833+0000 7f51e5ffb640 1 -- 172.21.15.59:0/261801457 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51d0009de0 con 0x7f51e8101430 2024-09-10T10:59:57.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.008+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51e8109070 con 0x7f51d40a2c10 2024-09-10T10:59:57.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.018+0000 7f51e5ffb640 1 -- 172.21.15.59:0/261801457 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258912 (secure 0 0 0) 0x7f51d8031730 con 0x7f51d40a2c10 2024-09-10T10:59:57.022 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:57.023 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T10:59:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.021+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51d40a2c10 msgr2=0x7f51d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.021+0000 7f51ee885640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51d40a2c10 0x7f51d40a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009900 tx=0x7f51d80058d0 comp rx=0 tx=0).stop 2024-09-10T10:59:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8101430 msgr2=0x7f51e8199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8101430 0x7f51e8199820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f51d000d950 tx=0x7f51d000de10 comp rx=0 tx=0).stop 2024-09-10T10:59:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 shutdown_connections 2024-09-10T10:59:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f51d40a2c10 0x7f51d40a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51e8106a90 0x7f51e81a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e8101430 0x7f51e8199820 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 --2- 172.21.15.59:0/261801457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51e8100a90 0x7f51e81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:57.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 >> 172.21.15.59:0/261801457 conn(0x7f51e80fc7d0 msgr2=0x7f51e80fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:57.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 shutdown_connections 2024-09-10T10:59:57.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:57.022+0000 7f51ee885640 1 -- 172.21.15.59:0/261801457 wait complete. 2024-09-10T10:59:57.772 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-10T10:59:56.712781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641800,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":234,"num_read_kb":223,"num_write":332,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364432,"kb_used_data":11004,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577392,"statfs":{"total":1151940427776,"available":1151567249408,"internally_reserved":0,"allocated":11268096,"data_stored":7175472,"data_compressed":176979,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46210,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":79,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003499"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155754+0000","last_change":"2024-09-10T10:59:31.132551+0000","last_active":"2024-09-10T10:59:40.155754+0000","last_peered":"2024-09-10T10:59:40.155754+0000","last_clean":"2024-09-10T10:59:40.155754+0000","last_became_active":"2024-09-10T10:59:31.132002+0000","last_became_peered":"2024-09-10T10:59:31.132002+0000","last_unstale":"2024-09-10T10:59:40.155754+0000","last_undegraded":"2024-09-10T10:59:40.155754+0000","last_fullsized":"2024-09-10T10:59:40.155754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:14.696067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211064+0000","last_change":"2024-09-10T10:59:31.129868+0000","last_active":"2024-09-10T10:59:40.211064+0000","last_peered":"2024-09-10T10:59:40.211064+0000","last_clean":"2024-09-10T10:59:40.211064+0000","last_became_active":"2024-09-10T10:59:31.129566+0000","last_became_peered":"2024-09-10T10:59:31.129566+0000","last_unstale":"2024-09-10T10:59:40.211064+0000","last_undegraded":"2024-09-10T10:59:40.211064+0000","last_fullsized":"2024-09-10T10:59:40.211064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:30.890000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211128+0000","last_change":"2024-09-10T10:59:31.134021+0000","last_active":"2024-09-10T10:59:40.211128+0000","last_peered":"2024-09-10T10:59:40.211128+0000","last_clean":"2024-09-10T10:59:40.211128+0000","last_became_active":"2024-09-10T10:59:31.133378+0000","last_became_peered":"2024-09-10T10:59:31.133378+0000","last_unstale":"2024-09-10T10:59:40.211128+0000","last_undegraded":"2024-09-10T10:59:40.211128+0000","last_fullsized":"2024-09-10T10:59:40.211128+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:32.808518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.156639+0000","last_change":"2024-09-10T10:59:40.156045+0000","last_active":"2024-09-10T10:59:40.156639+0000","last_peered":"2024-09-10T10:59:40.156639+0000","last_clean":"2024-09-10T10:59:40.156639+0000","last_became_active":"2024-09-10T10:59:40.155722+0000","last_became_peered":"2024-09-10T10:59:40.155722+0000","last_unstale":"2024-09-10T10:59:40.156639+0000","last_undegraded":"2024-09-10T10:59:40.156639+0000","last_fullsized":"2024-09-10T10:59:40.156639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:55.413173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153086+0000","last_change":"2024-09-10T10:59:31.128308+0000","last_active":"2024-09-10T10:59:40.153086+0000","last_peered":"2024-09-10T10:59:40.153086+0000","last_clean":"2024-09-10T10:59:40.153086+0000","last_became_active":"2024-09-10T10:59:31.127937+0000","last_became_peered":"2024-09-10T10:59:31.127937+0000","last_unstale":"2024-09-10T10:59:40.153086+0000","last_undegraded":"2024-09-10T10:59:40.153086+0000","last_fullsized":"2024-09-10T10:59:40.153086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:37.977168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157396+0000","last_change":"2024-09-10T10:59:40.157396+0000","last_active":"2024-09-10T10:59:40.157396+0000","last_peered":"2024-09-10T10:59:40.157396+0000","last_clean":"2024-09-10T10:59:40.157396+0000","last_became_active":"2024-09-10T10:59:40.157003+0000","last_became_peered":"2024-09-10T10:59:40.157003+0000","last_unstale":"2024-09-10T10:59:40.157396+0000","last_undegraded":"2024-09-10T10:59:40.157396+0000","last_fullsized":"2024-09-10T10:59:40.157396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152495+0000","last_change":"2024-09-10T10:59:31.136045+0000","last_active":"2024-09-10T10:59:40.152495+0000","last_peered":"2024-09-10T10:59:40.152495+0000","last_clean":"2024-09-10T10:59:40.152495+0000","last_became_active":"2024-09-10T10:59:31.135295+0000","last_became_peered":"2024-09-10T10:59:31.135295+0000","last_unstale":"2024-09-10T10:59:40.152495+0000","last_undegraded":"2024-09-10T10:59:40.152495+0000","last_fullsized":"2024-09-10T10:59:40.152495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:04.306752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157288+0000","last_change":"2024-09-10T10:59:31.120953+0000","last_active":"2024-09-10T10:59:40.157288+0000","last_peered":"2024-09-10T10:59:40.157288+0000","last_clean":"2024-09-10T10:59:40.157288+0000","last_became_active":"2024-09-10T10:59:31.120647+0000","last_became_peered":"2024-09-10T10:59:31.120647+0000","last_unstale":"2024-09-10T10:59:40.157288+0000","last_undegraded":"2024-09-10T10:59:40.157288+0000","last_fullsized":"2024-09-10T10:59:40.157288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:53.689216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151033+0000","last_change":"2024-09-10T10:59:31.136326+0000","last_active":"2024-09-10T10:59:40.151033+0000","last_peered":"2024-09-10T10:59:40.151033+0000","last_clean":"2024-09-10T10:59:40.151033+0000","last_became_active":"2024-09-10T10:59:31.135129+0000","last_became_peered":"2024-09-10T10:59:31.135129+0000","last_unstale":"2024-09-10T10:59:40.151033+0000","last_undegraded":"2024-09-10T10:59:40.151033+0000","last_fullsized":"2024-09-10T10:59:40.151033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:05.510845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153822+0000","last_change":"2024-09-10T10:59:31.130680+0000","last_active":"2024-09-10T10:59:40.153822+0000","last_peered":"2024-09-10T10:59:40.153822+0000","last_clean":"2024-09-10T10:59:40.153822+0000","last_became_active":"2024-09-10T10:59:31.130356+0000","last_became_peered":"2024-09-10T10:59:31.130356+0000","last_unstale":"2024-09-10T10:59:40.153822+0000","last_undegraded":"2024-09-10T10:59:40.153822+0000","last_fullsized":"2024-09-10T10:59:40.153822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:50.450251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153064+0000","last_change":"2024-09-10T10:59:31.129938+0000","last_active":"2024-09-10T10:59:40.153064+0000","last_peered":"2024-09-10T10:59:40.153064+0000","last_clean":"2024-09-10T10:59:40.153064+0000","last_became_active":"2024-09-10T10:59:31.129527+0000","last_became_peered":"2024-09-10T10:59:31.129527+0000","last_unstale":"2024-09-10T10:59:40.153064+0000","last_undegraded":"2024-09-10T10:59:40.153064+0000","last_fullsized":"2024-09-10T10:59:40.153064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:06.373082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.156876+0000","last_change":"2024-09-10T10:59:40.156217+0000","last_active":"2024-09-10T10:59:40.156876+0000","last_peered":"2024-09-10T10:59:40.156876+0000","last_clean":"2024-09-10T10:59:40.156876+0000","last_became_active":"2024-09-10T10:59:40.155900+0000","last_became_peered":"2024-09-10T10:59:40.155900+0000","last_unstale":"2024-09-10T10:59:40.156876+0000","last_undegraded":"2024-09-10T10:59:40.156876+0000","last_fullsized":"2024-09-10T10:59:40.156876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:17.085474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153961+0000","last_change":"2024-09-10T10:59:31.135564+0000","last_active":"2024-09-10T10:59:40.153961+0000","last_peered":"2024-09-10T10:59:40.153961+0000","last_clean":"2024-09-10T10:59:40.153961+0000","last_became_active":"2024-09-10T10:59:31.135185+0000","last_became_peered":"2024-09-10T10:59:31.135185+0000","last_unstale":"2024-09-10T10:59:40.153961+0000","last_undegraded":"2024-09-10T10:59:40.153961+0000","last_fullsized":"2024-09-10T10:59:40.153961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:17.275533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211219+0000","last_change":"2024-09-10T10:59:31.130517+0000","last_active":"2024-09-10T10:59:40.211219+0000","last_peered":"2024-09-10T10:59:40.211219+0000","last_clean":"2024-09-10T10:59:40.211219+0000","last_became_active":"2024-09-10T10:59:31.130156+0000","last_became_peered":"2024-09-10T10:59:31.130156+0000","last_unstale":"2024-09-10T10:59:40.211219+0000","last_undegraded":"2024-09-10T10:59:40.211219+0000","last_fullsized":"2024-09-10T10:59:40.211219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:33.354812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.210915+0000","last_change":"2024-09-10T10:59:31.130701+0000","last_active":"2024-09-10T10:59:40.210915+0000","last_peered":"2024-09-10T10:59:40.210915+0000","last_clean":"2024-09-10T10:59:40.210915+0000","last_became_active":"2024-09-10T10:59:31.130379+0000","last_became_peered":"2024-09-10T10:59:31.130379+0000","last_unstale":"2024-09-10T10:59:40.210915+0000","last_undegraded":"2024-09-10T10:59:40.210915+0000","last_fullsized":"2024-09-10T10:59:40.210915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:24.787292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150433+0000","last_change":"2024-09-10T10:59:31.129583+0000","last_active":"2024-09-10T10:59:40.150433+0000","last_peered":"2024-09-10T10:59:40.150433+0000","last_clean":"2024-09-10T10:59:40.150433+0000","last_became_active":"2024-09-10T10:59:31.128559+0000","last_became_peered":"2024-09-10T10:59:31.128559+0000","last_unstale":"2024-09-10T10:59:40.150433+0000","last_undegraded":"2024-09-10T10:59:40.150433+0000","last_fullsized":"2024-09-10T10:59:40.150433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:20.139987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155807+0000","last_change":"2024-09-10T10:59:31.132579+0000","last_active":"2024-09-10T10:59:40.155807+0000","last_peered":"2024-09-10T10:59:40.155807+0000","last_clean":"2024-09-10T10:59:40.155807+0000","last_became_active":"2024-09-10T10:59:31.132256+0000","last_became_peered":"2024-09-10T10:59:31.132256+0000","last_unstale":"2024-09-10T10:59:40.155807+0000","last_undegraded":"2024-09-10T10:59:40.155807+0000","last_fullsized":"2024-09-10T10:59:40.155807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:54.771376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151638+0000","last_change":"2024-09-10T10:59:31.127666+0000","last_active":"2024-09-10T10:59:40.151638+0000","last_peered":"2024-09-10T10:59:40.151638+0000","last_clean":"2024-09-10T10:59:40.151638+0000","last_became_active":"2024-09-10T10:59:31.127354+0000","last_became_peered":"2024-09-10T10:59:31.127354+0000","last_unstale":"2024-09-10T10:59:40.151638+0000","last_undegraded":"2024-09-10T10:59:40.151638+0000","last_fullsized":"2024-09-10T10:59:40.151638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:25.089856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152482+0000","last_change":"2024-09-10T10:59:31.126146+0000","last_active":"2024-09-10T10:59:40.152482+0000","last_peered":"2024-09-10T10:59:40.152482+0000","last_clean":"2024-09-10T10:59:40.152482+0000","last_became_active":"2024-09-10T10:59:31.125821+0000","last_became_peered":"2024-09-10T10:59:31.125821+0000","last_unstale":"2024-09-10T10:59:40.152482+0000","last_undegraded":"2024-09-10T10:59:40.152482+0000","last_fullsized":"2024-09-10T10:59:40.152482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:14.442467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155662+0000","last_change":"2024-09-10T10:59:31.124783+0000","last_active":"2024-09-10T10:59:40.155662+0000","last_peered":"2024-09-10T10:59:40.155662+0000","last_clean":"2024-09-10T10:59:40.155662+0000","last_became_active":"2024-09-10T10:59:31.124461+0000","last_became_peered":"2024-09-10T10:59:31.124461+0000","last_unstale":"2024-09-10T10:59:40.155662+0000","last_undegraded":"2024-09-10T10:59:40.155662+0000","last_fullsized":"2024-09-10T10:59:40.155662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:30.312716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154045+0000","last_change":"2024-09-10T10:59:31.123118+0000","last_active":"2024-09-10T10:59:40.154045+0000","last_peered":"2024-09-10T10:59:40.154045+0000","last_clean":"2024-09-10T10:59:40.154045+0000","last_became_active":"2024-09-10T10:59:31.122802+0000","last_became_peered":"2024-09-10T10:59:31.122802+0000","last_unstale":"2024-09-10T10:59:40.154045+0000","last_undegraded":"2024-09-10T10:59:40.154045+0000","last_fullsized":"2024-09-10T10:59:40.154045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:38:30.274121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150564+0000","last_change":"2024-09-10T10:59:31.125163+0000","last_active":"2024-09-10T10:59:40.150564+0000","last_peered":"2024-09-10T10:59:40.150564+0000","last_clean":"2024-09-10T10:59:40.150564+0000","last_became_active":"2024-09-10T10:59:31.124823+0000","last_became_peered":"2024-09-10T10:59:31.124823+0000","last_unstale":"2024-09-10T10:59:40.150564+0000","last_undegraded":"2024-09-10T10:59:40.150564+0000","last_fullsized":"2024-09-10T10:59:40.150564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:06.479220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157045+0000","last_change":"2024-09-10T10:59:31.124892+0000","last_active":"2024-09-10T10:59:40.157045+0000","last_peered":"2024-09-10T10:59:40.157045+0000","last_clean":"2024-09-10T10:59:40.157045+0000","last_became_active":"2024-09-10T10:59:31.124575+0000","last_became_peered":"2024-09-10T10:59:31.124575+0000","last_unstale":"2024-09-10T10:59:40.157045+0000","last_undegraded":"2024-09-10T10:59:40.157045+0000","last_fullsized":"2024-09-10T10:59:40.157045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:54.562406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.159964+0000","last_change":"2024-09-10T10:59:40.159510+0000","last_active":"2024-09-10T10:59:40.159964+0000","last_peered":"2024-09-10T10:59:40.159964+0000","last_clean":"2024-09-10T10:59:40.159964+0000","last_became_active":"2024-09-10T10:59:40.159115+0000","last_became_peered":"2024-09-10T10:59:40.159115+0000","last_unstale":"2024-09-10T10:59:40.159964+0000","last_undegraded":"2024-09-10T10:59:40.159964+0000","last_fullsized":"2024-09-10T10:59:40.159964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:28.390308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158008+0000","last_change":"2024-09-10T10:59:31.125849+0000","last_active":"2024-09-10T10:59:40.158008+0000","last_peered":"2024-09-10T10:59:40.158008+0000","last_clean":"2024-09-10T10:59:40.158008+0000","last_became_active":"2024-09-10T10:59:31.125487+0000","last_became_peered":"2024-09-10T10:59:31.125487+0000","last_unstale":"2024-09-10T10:59:40.158008+0000","last_undegraded":"2024-09-10T10:59:40.158008+0000","last_fullsized":"2024-09-10T10:59:40.158008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:56.364182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152718+0000","last_change":"2024-09-10T10:59:31.132717+0000","last_active":"2024-09-10T10:59:40.152718+0000","last_peered":"2024-09-10T10:59:40.152718+0000","last_clean":"2024-09-10T10:59:40.152718+0000","last_became_active":"2024-09-10T10:59:31.132258+0000","last_became_peered":"2024-09-10T10:59:31.132258+0000","last_unstale":"2024-09-10T10:59:40.152718+0000","last_undegraded":"2024-09-10T10:59:40.152718+0000","last_fullsized":"2024-09-10T10:59:40.152718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:27.910065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155638+0000","last_change":"2024-09-10T10:59:31.136320+0000","last_active":"2024-09-10T10:59:40.155638+0000","last_peered":"2024-09-10T10:59:40.155638+0000","last_clean":"2024-09-10T10:59:40.155638+0000","last_became_active":"2024-09-10T10:59:31.135970+0000","last_became_peered":"2024-09-10T10:59:31.135970+0000","last_unstale":"2024-09-10T10:59:40.155638+0000","last_undegraded":"2024-09-10T10:59:40.155638+0000","last_fullsized":"2024-09-10T10:59:40.155638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:19.380754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153513+0000","last_change":"2024-09-10T10:59:31.123793+0000","last_active":"2024-09-10T10:59:40.153513+0000","last_peered":"2024-09-10T10:59:40.153513+0000","last_clean":"2024-09-10T10:59:40.153513+0000","last_became_active":"2024-09-10T10:59:31.123502+0000","last_became_peered":"2024-09-10T10:59:31.123502+0000","last_unstale":"2024-09-10T10:59:40.153513+0000","last_undegraded":"2024-09-10T10:59:40.153513+0000","last_fullsized":"2024-09-10T10:59:40.153513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:43.883652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211247+0000","last_change":"2024-09-10T10:59:31.127616+0000","last_active":"2024-09-10T10:59:40.211247+0000","last_peered":"2024-09-10T10:59:40.211247+0000","last_clean":"2024-09-10T10:59:40.211247+0000","last_became_active":"2024-09-10T10:59:31.127296+0000","last_became_peered":"2024-09-10T10:59:31.127296+0000","last_unstale":"2024-09-10T10:59:40.211247+0000","last_undegraded":"2024-09-10T10:59:40.211247+0000","last_fullsized":"2024-09-10T10:59:40.211247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:58.284180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212762+0000","last_change":"2024-09-10T10:59:40.212762+0000","last_active":"2024-09-10T10:59:40.212762+0000","last_peered":"2024-09-10T10:59:40.212762+0000","last_clean":"2024-09-10T10:59:40.212762+0000","last_became_active":"2024-09-10T10:59:40.212356+0000","last_became_peered":"2024-09-10T10:59:40.212356+0000","last_unstale":"2024-09-10T10:59:40.212762+0000","last_undegraded":"2024-09-10T10:59:40.212762+0000","last_fullsized":"2024-09-10T10:59:40.212762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:45.341432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.213553+0000","last_change":"2024-09-10T10:59:40.213553+0000","last_active":"2024-09-10T10:59:40.213553+0000","last_peered":"2024-09-10T10:59:40.213553+0000","last_clean":"2024-09-10T10:59:40.213553+0000","last_became_active":"2024-09-10T10:59:40.213104+0000","last_became_peered":"2024-09-10T10:59:40.213104+0000","last_unstale":"2024-09-10T10:59:40.213553+0000","last_undegraded":"2024-09-10T10:59:40.213553+0000","last_fullsized":"2024-09-10T10:59:40.213553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:24:09.901559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155007+0000","last_change":"2024-09-10T10:59:31.135637+0000","last_active":"2024-09-10T10:59:40.155007+0000","last_peered":"2024-09-10T10:59:40.155007+0000","last_clean":"2024-09-10T10:59:40.155007+0000","last_became_active":"2024-09-10T10:59:31.135286+0000","last_became_peered":"2024-09-10T10:59:31.135286+0000","last_unstale":"2024-09-10T10:59:40.155007+0000","last_undegraded":"2024-09-10T10:59:40.155007+0000","last_fullsized":"2024-09-10T10:59:40.155007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:44:56.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157927+0000","last_change":"2024-09-10T10:59:40.157927+0000","last_active":"2024-09-10T10:59:40.157927+0000","last_peered":"2024-09-10T10:59:40.157927+0000","last_clean":"2024-09-10T10:59:40.157927+0000","last_became_active":"2024-09-10T10:59:40.157506+0000","last_became_peered":"2024-09-10T10:59:40.157506+0000","last_unstale":"2024-09-10T10:59:40.157927+0000","last_undegraded":"2024-09-10T10:59:40.157927+0000","last_fullsized":"2024-09-10T10:59:40.157927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:18.848309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:52.188712+0000","last_change":"2024-09-10T10:59:28.980783+0000","last_active":"2024-09-10T10:59:52.188712+0000","last_peered":"2024-09-10T10:59:52.188712+0000","last_clean":"2024-09-10T10:59:52.188712+0000","last_became_active":"2024-09-10T10:59:28.980420+0000","last_became_peered":"2024-09-10T10:59:28.980420+0000","last_unstale":"2024-09-10T10:59:52.188712+0000","last_undegraded":"2024-09-10T10:59:52.188712+0000","last_fullsized":"2024-09-10T10:59:52.188712+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:58.575440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211462+0000","last_change":"2024-09-10T10:59:31.133661+0000","last_active":"2024-09-10T10:59:40.211462+0000","last_peered":"2024-09-10T10:59:40.211462+0000","last_clean":"2024-09-10T10:59:40.211462+0000","last_became_active":"2024-09-10T10:59:31.133323+0000","last_became_peered":"2024-09-10T10:59:31.133323+0000","last_unstale":"2024-09-10T10:59:40.211462+0000","last_undegraded":"2024-09-10T10:59:40.211462+0000","last_fullsized":"2024-09-10T10:59:40.211462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:37.498128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170086+0000","last_change":"2024-09-10T10:59:28.976329+0000","last_active":"2024-09-10T10:59:41.170086+0000","last_peered":"2024-09-10T10:59:41.170086+0000","last_clean":"2024-09-10T10:59:41.170086+0000","last_became_active":"2024-09-10T10:59:28.975937+0000","last_became_peered":"2024-09-10T10:59:28.975937+0000","last_unstale":"2024-09-10T10:59:41.170086+0000","last_undegraded":"2024-09-10T10:59:41.170086+0000","last_fullsized":"2024-09-10T10:59:41.170086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:46.118954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170624+0000","last_change":"2024-09-10T10:59:28.976853+0000","last_active":"2024-09-10T10:59:41.170624+0000","last_peered":"2024-09-10T10:59:41.170624+0000","last_clean":"2024-09-10T10:59:41.170624+0000","last_became_active":"2024-09-10T10:59:28.976524+0000","last_became_peered":"2024-09-10T10:59:28.976524+0000","last_unstale":"2024-09-10T10:59:41.170624+0000","last_undegraded":"2024-09-10T10:59:41.170624+0000","last_fullsized":"2024-09-10T10:59:41.170624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:27.473954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157400+0000","last_change":"2024-09-10T10:59:31.124533+0000","last_active":"2024-09-10T10:59:40.157400+0000","last_peered":"2024-09-10T10:59:40.157400+0000","last_clean":"2024-09-10T10:59:40.157400+0000","last_became_active":"2024-09-10T10:59:31.124179+0000","last_became_peered":"2024-09-10T10:59:31.124179+0000","last_unstale":"2024-09-10T10:59:40.157400+0000","last_undegraded":"2024-09-10T10:59:40.157400+0000","last_fullsized":"2024-09-10T10:59:40.157400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:23.114178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211738+0000","last_change":"2024-09-10T10:59:28.974785+0000","last_active":"2024-09-10T10:59:40.211738+0000","last_peered":"2024-09-10T10:59:40.211738+0000","last_clean":"2024-09-10T10:59:40.211738+0000","last_became_active":"2024-09-10T10:59:28.974499+0000","last_became_peered":"2024-09-10T10:59:28.974499+0000","last_unstale":"2024-09-10T10:59:40.211738+0000","last_undegraded":"2024-09-10T10:59:40.211738+0000","last_fullsized":"2024-09-10T10:59:40.211738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:18.551425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151294+0000","last_change":"2024-09-10T10:59:31.122040+0000","last_active":"2024-09-10T10:59:40.151294+0000","last_peered":"2024-09-10T10:59:40.151294+0000","last_clean":"2024-09-10T10:59:40.151294+0000","last_became_active":"2024-09-10T10:59:31.121683+0000","last_became_peered":"2024-09-10T10:59:31.121683+0000","last_unstale":"2024-09-10T10:59:40.151294+0000","last_undegraded":"2024-09-10T10:59:40.151294+0000","last_fullsized":"2024-09-10T10:59:40.151294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:42.783446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:52.187942+0000","last_change":"2024-09-10T10:59:28.979068+0000","last_active":"2024-09-10T10:59:52.187942+0000","last_peered":"2024-09-10T10:59:52.187942+0000","last_clean":"2024-09-10T10:59:52.187942+0000","last_became_active":"2024-09-10T10:59:28.978746+0000","last_became_peered":"2024-09-10T10:59:28.978746+0000","last_unstale":"2024-09-10T10:59:52.187942+0000","last_undegraded":"2024-09-10T10:59:52.187942+0000","last_fullsized":"2024-09-10T10:59:52.187942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:30.940050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150814+0000","last_change":"2024-09-10T10:59:31.130966+0000","last_active":"2024-09-10T10:59:40.150814+0000","last_peered":"2024-09-10T10:59:40.150814+0000","last_clean":"2024-09-10T10:59:40.150814+0000","last_became_active":"2024-09-10T10:59:31.130592+0000","last_became_peered":"2024-09-10T10:59:31.130592+0000","last_unstale":"2024-09-10T10:59:40.150814+0000","last_undegraded":"2024-09-10T10:59:40.150814+0000","last_fullsized":"2024-09-10T10:59:40.150814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:59.000694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.183919+0000","last_change":"2024-09-10T10:59:40.182217+0000","last_active":"2024-09-10T10:59:40.183919+0000","last_peered":"2024-09-10T10:59:40.183919+0000","last_clean":"2024-09-10T10:59:40.183919+0000","last_became_active":"2024-09-10T10:59:40.181771+0000","last_became_peered":"2024-09-10T10:59:40.181771+0000","last_unstale":"2024-09-10T10:59:40.183919+0000","last_undegraded":"2024-09-10T10:59:40.183919+0000","last_fullsized":"2024-09-10T10:59:40.183919+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:22.745512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211385+0000","last_change":"2024-09-10T10:59:31.123034+0000","last_active":"2024-09-10T10:59:40.211385+0000","last_peered":"2024-09-10T10:59:40.211385+0000","last_clean":"2024-09-10T10:59:40.211385+0000","last_became_active":"2024-09-10T10:59:31.122721+0000","last_became_peered":"2024-09-10T10:59:31.122721+0000","last_unstale":"2024-09-10T10:59:40.211385+0000","last_undegraded":"2024-09-10T10:59:40.211385+0000","last_fullsized":"2024-09-10T10:59:40.211385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:20.175740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212064+0000","last_change":"2024-09-10T10:59:29.230812+0000","last_active":"2024-09-10T10:59:40.212064+0000","last_peered":"2024-09-10T10:59:40.212064+0000","last_clean":"2024-09-10T10:59:40.212064+0000","last_became_active":"2024-09-10T10:59:29.230450+0000","last_became_peered":"2024-09-10T10:59:29.230450+0000","last_unstale":"2024-09-10T10:59:40.212064+0000","last_undegraded":"2024-09-10T10:59:40.212064+0000","last_fullsized":"2024-09-10T10:59:40.212064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:32.476465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150665+0000","last_change":"2024-09-10T10:59:31.129751+0000","last_active":"2024-09-10T10:59:40.150665+0000","last_peered":"2024-09-10T10:59:40.150665+0000","last_clean":"2024-09-10T10:59:40.150665+0000","last_became_active":"2024-09-10T10:59:31.129420+0000","last_became_peered":"2024-09-10T10:59:31.129420+0000","last_unstale":"2024-09-10T10:59:40.150665+0000","last_undegraded":"2024-09-10T10:59:40.150665+0000","last_fullsized":"2024-09-10T10:59:40.150665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:21.243051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'22","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:53.191695+0000","last_change":"2024-09-10T10:59:28.977234+0000","last_active":"2024-09-10T10:59:53.191695+0000","last_peered":"2024-09-10T10:59:53.191695+0000","last_clean":"2024-09-10T10:59:53.191695+0000","last_became_active":"2024-09-10T10:59:28.976897+0000","last_became_peered":"2024-09-10T10:59:28.976897+0000","last_unstale":"2024-09-10T10:59:53.191695+0000","last_undegraded":"2024-09-10T10:59:53.191695+0000","last_fullsized":"2024-09-10T10:59:53.191695+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.937110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":60,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154209+0000","last_change":"2024-09-10T10:59:31.125741+0000","last_active":"2024-09-10T10:59:40.154209+0000","last_peered":"2024-09-10T10:59:40.154209+0000","last_clean":"2024-09-10T10:59:40.154209+0000","last_became_active":"2024-09-10T10:59:31.125369+0000","last_became_peered":"2024-09-10T10:59:31.125369+0000","last_unstale":"2024-09-10T10:59:40.154209+0000","last_undegraded":"2024-09-10T10:59:40.154209+0000","last_fullsized":"2024-09-10T10:59:40.154209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:26.873331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.168438+0000","last_change":"2024-09-10T10:59:28.975326+0000","last_active":"2024-09-10T10:59:41.168438+0000","last_peered":"2024-09-10T10:59:41.168438+0000","last_clean":"2024-09-10T10:59:41.168438+0000","last_became_active":"2024-09-10T10:59:28.975004+0000","last_became_peered":"2024-09-10T10:59:28.975004+0000","last_unstale":"2024-09-10T10:59:41.168438+0000","last_undegraded":"2024-09-10T10:59:41.168438+0000","last_fullsized":"2024-09-10T10:59:41.168438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:11.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153138+0000","last_change":"2024-09-10T10:59:31.125916+0000","last_active":"2024-09-10T10:59:40.153138+0000","last_peered":"2024-09-10T10:59:40.153138+0000","last_clean":"2024-09-10T10:59:40.153138+0000","last_became_active":"2024-09-10T10:59:31.125591+0000","last_became_peered":"2024-09-10T10:59:31.125591+0000","last_unstale":"2024-09-10T10:59:40.153138+0000","last_undegraded":"2024-09-10T10:59:40.153138+0000","last_fullsized":"2024-09-10T10:59:40.153138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:19.512266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211706+0000","last_change":"2024-09-10T10:59:28.980967+0000","last_active":"2024-09-10T10:59:40.211706+0000","last_peered":"2024-09-10T10:59:40.211706+0000","last_clean":"2024-09-10T10:59:40.211706+0000","last_became_active":"2024-09-10T10:59:28.980176+0000","last_became_peered":"2024-09-10T10:59:28.980176+0000","last_unstale":"2024-09-10T10:59:40.211706+0000","last_undegraded":"2024-09-10T10:59:40.211706+0000","last_fullsized":"2024-09-10T10:59:40.211706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:56.327936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152737+0000","last_change":"2024-09-10T10:59:31.127819+0000","last_active":"2024-09-10T10:59:40.152737+0000","last_peered":"2024-09-10T10:59:40.152737+0000","last_clean":"2024-09-10T10:59:40.152737+0000","last_became_active":"2024-09-10T10:59:31.127503+0000","last_became_peered":"2024-09-10T10:59:31.127503+0000","last_unstale":"2024-09-10T10:59:40.152737+0000","last_undegraded":"2024-09-10T10:59:40.152737+0000","last_fullsized":"2024-09-10T10:59:40.152737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:17.014121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:52.189355+0000","last_change":"2024-09-10T10:59:28.980881+0000","last_active":"2024-09-10T10:59:52.189355+0000","last_peered":"2024-09-10T10:59:52.189355+0000","last_clean":"2024-09-10T10:59:52.189355+0000","last_became_active":"2024-09-10T10:59:28.980452+0000","last_became_peered":"2024-09-10T10:59:28.980452+0000","last_unstale":"2024-09-10T10:59:52.189355+0000","last_undegraded":"2024-09-10T10:59:52.189355+0000","last_fullsized":"2024-09-10T10:59:52.189355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:00.373348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152392+0000","last_change":"2024-09-10T10:59:31.120463+0000","last_active":"2024-09-10T10:59:40.152392+0000","last_peered":"2024-09-10T10:59:40.152392+0000","last_clean":"2024-09-10T10:59:40.152392+0000","last_became_active":"2024-09-10T10:59:31.120122+0000","last_became_peered":"2024-09-10T10:59:31.120122+0000","last_unstale":"2024-09-10T10:59:40.152392+0000","last_undegraded":"2024-09-10T10:59:40.152392+0000","last_fullsized":"2024-09-10T10:59:40.152392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:37.425553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170329+0000","last_change":"2024-09-10T10:59:29.230592+0000","last_active":"2024-09-10T10:59:41.170329+0000","last_peered":"2024-09-10T10:59:41.170329+0000","last_clean":"2024-09-10T10:59:41.170329+0000","last_became_active":"2024-09-10T10:59:29.230205+0000","last_became_peered":"2024-09-10T10:59:29.230205+0000","last_unstale":"2024-09-10T10:59:41.170329+0000","last_undegraded":"2024-09-10T10:59:41.170329+0000","last_fullsized":"2024-09-10T10:59:41.170329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:00.671805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211929+0000","last_change":"2024-09-10T10:59:31.132506+0000","last_active":"2024-09-10T10:59:40.211929+0000","last_peered":"2024-09-10T10:59:40.211929+0000","last_clean":"2024-09-10T10:59:40.211929+0000","last_became_active":"2024-09-10T10:59:31.132038+0000","last_became_peered":"2024-09-10T10:59:31.132038+0000","last_unstale":"2024-09-10T10:59:40.211929+0000","last_undegraded":"2024-09-10T10:59:40.211929+0000","last_fullsized":"2024-09-10T10:59:40.211929+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:09.872032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:42.164709+0000","last_change":"2024-09-10T10:59:28.976756+0000","last_active":"2024-09-10T10:59:42.164709+0000","last_peered":"2024-09-10T10:59:42.164709+0000","last_clean":"2024-09-10T10:59:42.164709+0000","last_became_active":"2024-09-10T10:59:28.976429+0000","last_became_peered":"2024-09-10T10:59:28.976429+0000","last_unstale":"2024-09-10T10:59:42.164709+0000","last_undegraded":"2024-09-10T10:59:42.164709+0000","last_fullsized":"2024-09-10T10:59:42.164709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:41.679474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155401+0000","last_change":"2024-09-10T10:59:31.135768+0000","last_active":"2024-09-10T10:59:40.155401+0000","last_peered":"2024-09-10T10:59:40.155401+0000","last_clean":"2024-09-10T10:59:40.155401+0000","last_became_active":"2024-09-10T10:59:31.135420+0000","last_became_peered":"2024-09-10T10:59:31.135420+0000","last_unstale":"2024-09-10T10:59:40.155401+0000","last_undegraded":"2024-09-10T10:59:40.155401+0000","last_fullsized":"2024-09-10T10:59:40.155401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:02.983500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153716+0000","last_change":"2024-09-10T10:59:28.972185+0000","last_active":"2024-09-10T10:59:40.153716+0000","last_peered":"2024-09-10T10:59:40.153716+0000","last_clean":"2024-09-10T10:59:40.153716+0000","last_became_active":"2024-09-10T10:59:28.971813+0000","last_became_peered":"2024-09-10T10:59:28.971813+0000","last_unstale":"2024-09-10T10:59:40.153716+0000","last_undegraded":"2024-09-10T10:59:40.153716+0000","last_fullsized":"2024-09-10T10:59:40.153716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:53.612465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152705+0000","last_change":"2024-09-10T10:59:31.130197+0000","last_active":"2024-09-10T10:59:40.152705+0000","last_peered":"2024-09-10T10:59:40.152705+0000","last_clean":"2024-09-10T10:59:40.152705+0000","last_became_active":"2024-09-10T10:59:31.129596+0000","last_became_peered":"2024-09-10T10:59:31.129596+0000","last_unstale":"2024-09-10T10:59:40.152705+0000","last_undegraded":"2024-09-10T10:59:40.152705+0000","last_fullsized":"2024-09-10T10:59:40.152705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:23.962924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212176+0000","last_change":"2024-09-10T10:59:28.973990+0000","last_active":"2024-09-10T10:59:40.212176+0000","last_peered":"2024-09-10T10:59:40.212176+0000","last_clean":"2024-09-10T10:59:40.212176+0000","last_became_active":"2024-09-10T10:59:28.973647+0000","last_became_peered":"2024-09-10T10:59:28.973647+0000","last_unstale":"2024-09-10T10:59:40.212176+0000","last_undegraded":"2024-09-10T10:59:40.212176+0000","last_fullsized":"2024-09-10T10:59:40.212176+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:25.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153427+0000","last_change":"2024-09-10T10:59:31.135603+0000","last_active":"2024-09-10T10:59:40.153427+0000","last_peered":"2024-09-10T10:59:40.153427+0000","last_clean":"2024-09-10T10:59:40.153427+0000","last_became_active":"2024-09-10T10:59:31.135208+0000","last_became_peered":"2024-09-10T10:59:31.135208+0000","last_unstale":"2024-09-10T10:59:40.153427+0000","last_undegraded":"2024-09-10T10:59:40.153427+0000","last_fullsized":"2024-09-10T10:59:40.153427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:50.578770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.476974+0000","last_change":"2024-09-10T10:59:40.212180+0000","last_active":"2024-09-10T10:59:41.476974+0000","last_peered":"2024-09-10T10:59:41.476974+0000","last_clean":"2024-09-10T10:59:41.476974+0000","last_became_active":"2024-09-10T10:59:40.211860+0000","last_became_peered":"2024-09-10T10:59:40.211860+0000","last_unstale":"2024-09-10T10:59:41.476974+0000","last_undegraded":"2024-09-10T10:59:41.476974+0000","last_fullsized":"2024-09-10T10:59:41.476974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:09.718612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153216+0000","last_change":"2024-09-10T10:59:31.126162+0000","last_active":"2024-09-10T10:59:40.153216+0000","last_peered":"2024-09-10T10:59:40.153216+0000","last_clean":"2024-09-10T10:59:40.153216+0000","last_became_active":"2024-09-10T10:59:31.125661+0000","last_became_peered":"2024-09-10T10:59:31.125661+0000","last_unstale":"2024-09-10T10:59:40.153216+0000","last_undegraded":"2024-09-10T10:59:40.153216+0000","last_fullsized":"2024-09-10T10:59:40.153216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:36.677732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152671+0000","last_change":"2024-09-10T10:58:17.630377+0000","last_active":"2024-09-10T10:59:40.152671+0000","last_peered":"2024-09-10T10:59:40.152671+0000","last_clean":"2024-09-10T10:59:40.152671+0000","last_became_active":"2024-09-10T10:58:17.629956+0000","last_became_peered":"2024-09-10T10:58:17.629956+0000","last_unstale":"2024-09-10T10:59:40.152671+0000","last_undegraded":"2024-09-10T10:59:40.152671+0000","last_fullsized":"2024-09-10T10:59:40.152671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:54:53.218596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:54:53.218596+0000","last_clean_scrub_stamp":"2024-09-10T10:54:53.218596+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:44.005115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:42.170755+0000","last_change":"2024-09-10T10:59:28.975307+0000","last_active":"2024-09-10T10:59:42.170755+0000","last_peered":"2024-09-10T10:59:42.170755+0000","last_clean":"2024-09-10T10:59:42.170755+0000","last_became_active":"2024-09-10T10:59:28.974959+0000","last_became_peered":"2024-09-10T10:59:28.974959+0000","last_unstale":"2024-09-10T10:59:42.170755+0000","last_undegraded":"2024-09-10T10:59:42.170755+0000","last_fullsized":"2024-09-10T10:59:42.170755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:59.923354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157346+0000","last_change":"2024-09-10T10:59:31.124267+0000","last_active":"2024-09-10T10:59:40.157346+0000","last_peered":"2024-09-10T10:59:40.157346+0000","last_clean":"2024-09-10T10:59:40.157346+0000","last_became_active":"2024-09-10T10:59:31.123894+0000","last_became_peered":"2024-09-10T10:59:31.123894+0000","last_unstale":"2024-09-10T10:59:40.157346+0000","last_undegraded":"2024-09-10T10:59:40.157346+0000","last_fullsized":"2024-09-10T10:59:40.157346+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:54.657970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.169251+0000","last_change":"2024-09-10T10:59:28.977213+0000","last_active":"2024-09-10T10:59:41.169251+0000","last_peered":"2024-09-10T10:59:41.169251+0000","last_clean":"2024-09-10T10:59:41.169251+0000","last_became_active":"2024-09-10T10:59:28.976909+0000","last_became_peered":"2024-09-10T10:59:28.976909+0000","last_unstale":"2024-09-10T10:59:41.169251+0000","last_undegraded":"2024-09-10T10:59:41.169251+0000","last_fullsized":"2024-09-10T10:59:41.169251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:24.640147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152773+0000","last_change":"2024-09-10T10:59:31.129703+0000","last_active":"2024-09-10T10:59:40.152773+0000","last_peered":"2024-09-10T10:59:40.152773+0000","last_clean":"2024-09-10T10:59:40.152773+0000","last_became_active":"2024-09-10T10:59:31.129401+0000","last_became_peered":"2024-09-10T10:59:31.129401+0000","last_unstale":"2024-09-10T10:59:40.152773+0000","last_undegraded":"2024-09-10T10:59:40.152773+0000","last_fullsized":"2024-09-10T10:59:40.152773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:37.431852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:52.188931+0000","last_change":"2024-09-10T10:59:29.230556+0000","last_active":"2024-09-10T10:59:52.188931+0000","last_peered":"2024-09-10T10:59:52.188931+0000","last_clean":"2024-09-10T10:59:52.188931+0000","last_became_active":"2024-09-10T10:59:29.230129+0000","last_became_peered":"2024-09-10T10:59:29.230129+0000","last_unstale":"2024-09-10T10:59:52.188931+0000","last_undegraded":"2024-09-10T10:59:52.188931+0000","last_fullsized":"2024-09-10T10:59:52.188931+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:31.903008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211592+0000","last_change":"2024-09-10T10:59:31.131687+0000","last_active":"2024-09-10T10:59:40.211592+0000","last_peered":"2024-09-10T10:59:40.211592+0000","last_clean":"2024-09-10T10:59:40.211592+0000","last_became_active":"2024-09-10T10:59:31.131373+0000","last_became_peered":"2024-09-10T10:59:31.131373+0000","last_unstale":"2024-09-10T10:59:40.211592+0000","last_undegraded":"2024-09-10T10:59:40.211592+0000","last_fullsized":"2024-09-10T10:59:40.211592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:03.923639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152936+0000","last_change":"2024-09-10T10:59:28.977557+0000","last_active":"2024-09-10T10:59:40.152936+0000","last_peered":"2024-09-10T10:59:40.152936+0000","last_clean":"2024-09-10T10:59:40.152936+0000","last_became_active":"2024-09-10T10:59:28.977203+0000","last_became_peered":"2024-09-10T10:59:28.977203+0000","last_unstale":"2024-09-10T10:59:40.152936+0000","last_undegraded":"2024-09-10T10:59:40.152936+0000","last_fullsized":"2024-09-10T10:59:40.152936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:25:29.880758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153759+0000","last_change":"2024-09-10T10:59:31.123998+0000","last_active":"2024-09-10T10:59:40.153759+0000","last_peered":"2024-09-10T10:59:40.153759+0000","last_clean":"2024-09-10T10:59:40.153759+0000","last_became_active":"2024-09-10T10:59:31.123645+0000","last_became_peered":"2024-09-10T10:59:31.123645+0000","last_unstale":"2024-09-10T10:59:40.153759+0000","last_undegraded":"2024-09-10T10:59:40.153759+0000","last_fullsized":"2024-09-10T10:59:40.153759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:47.607733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152223+0000","last_change":"2024-09-10T10:59:29.231291+0000","last_active":"2024-09-10T10:59:40.152223+0000","last_peered":"2024-09-10T10:59:40.152223+0000","last_clean":"2024-09-10T10:59:40.152223+0000","last_became_active":"2024-09-10T10:59:29.230946+0000","last_became_peered":"2024-09-10T10:59:29.230946+0000","last_unstale":"2024-09-10T10:59:40.152223+0000","last_undegraded":"2024-09-10T10:59:40.152223+0000","last_fullsized":"2024-09-10T10:59:40.152223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:55.268743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153274+0000","last_change":"2024-09-10T10:59:31.122359+0000","last_active":"2024-09-10T10:59:40.153274+0000","last_peered":"2024-09-10T10:59:40.153274+0000","last_clean":"2024-09-10T10:59:40.153274+0000","last_became_active":"2024-09-10T10:59:31.120741+0000","last_became_peered":"2024-09-10T10:59:31.120741+0000","last_unstale":"2024-09-10T10:59:40.153274+0000","last_undegraded":"2024-09-10T10:59:40.153274+0000","last_fullsized":"2024-09-10T10:59:40.153274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:02.827031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154484+0000","last_change":"2024-09-10T10:59:29.231008+0000","last_active":"2024-09-10T10:59:40.154484+0000","last_peered":"2024-09-10T10:59:40.154484+0000","last_clean":"2024-09-10T10:59:40.154484+0000","last_became_active":"2024-09-10T10:59:29.230638+0000","last_became_peered":"2024-09-10T10:59:29.230638+0000","last_unstale":"2024-09-10T10:59:40.154484+0000","last_undegraded":"2024-09-10T10:59:40.154484+0000","last_fullsized":"2024-09-10T10:59:40.154484+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.358831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153600+0000","last_change":"2024-09-10T10:59:31.129049+0000","last_active":"2024-09-10T10:59:40.153600+0000","last_peered":"2024-09-10T10:59:40.153600+0000","last_clean":"2024-09-10T10:59:40.153600+0000","last_became_active":"2024-09-10T10:59:31.128746+0000","last_became_peered":"2024-09-10T10:59:31.128746+0000","last_unstale":"2024-09-10T10:59:40.153600+0000","last_undegraded":"2024-09-10T10:59:40.153600+0000","last_fullsized":"2024-09-10T10:59:40.153600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:25.719609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:51.118218+0000","last_change":"2024-09-10T10:59:28.973043+0000","last_active":"2024-09-10T10:59:51.118218+0000","last_peered":"2024-09-10T10:59:51.118218+0000","last_clean":"2024-09-10T10:59:51.118218+0000","last_became_active":"2024-09-10T10:59:28.972633+0000","last_became_peered":"2024-09-10T10:59:28.972633+0000","last_unstale":"2024-09-10T10:59:51.118218+0000","last_undegraded":"2024-09-10T10:59:51.118218+0000","last_fullsized":"2024-09-10T10:59:51.118218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:51.858279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158104+0000","last_change":"2024-09-10T10:59:31.124663+0000","last_active":"2024-09-10T10:59:40.158104+0000","last_peered":"2024-09-10T10:59:40.158104+0000","last_clean":"2024-09-10T10:59:40.158104+0000","last_became_active":"2024-09-10T10:59:31.124312+0000","last_became_peered":"2024-09-10T10:59:31.124312+0000","last_unstale":"2024-09-10T10:59:40.158104+0000","last_undegraded":"2024-09-10T10:59:40.158104+0000","last_fullsized":"2024-09-10T10:59:40.158104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:03.530208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.180952+0000","last_change":"2024-09-10T10:59:29.461846+0000","last_active":"2024-09-10T10:59:40.180952+0000","last_peered":"2024-09-10T10:59:40.180952+0000","last_clean":"2024-09-10T10:59:40.180952+0000","last_became_active":"2024-09-10T10:59:29.461485+0000","last_became_peered":"2024-09-10T10:59:29.461485+0000","last_unstale":"2024-09-10T10:59:40.180952+0000","last_undegraded":"2024-09-10T10:59:40.180952+0000","last_fullsized":"2024-09-10T10:59:40.180952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:28.071947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211184+0000","last_change":"2024-09-10T10:59:31.122234+0000","last_active":"2024-09-10T10:59:40.211184+0000","last_peered":"2024-09-10T10:59:40.211184+0000","last_clean":"2024-09-10T10:59:40.211184+0000","last_became_active":"2024-09-10T10:59:31.121909+0000","last_became_peered":"2024-09-10T10:59:31.121909+0000","last_unstale":"2024-09-10T10:59:40.211184+0000","last_undegraded":"2024-09-10T10:59:40.211184+0000","last_fullsized":"2024-09-10T10:59:40.211184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:37.263257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150552+0000","last_change":"2024-09-10T10:59:29.230543+0000","last_active":"2024-09-10T10:59:40.150552+0000","last_peered":"2024-09-10T10:59:40.150552+0000","last_clean":"2024-09-10T10:59:40.150552+0000","last_became_active":"2024-09-10T10:59:29.230256+0000","last_became_peered":"2024-09-10T10:59:29.230256+0000","last_unstale":"2024-09-10T10:59:40.150552+0000","last_undegraded":"2024-09-10T10:59:40.150552+0000","last_fullsized":"2024-09-10T10:59:40.150552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:05.336402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153044+0000","last_change":"2024-09-10T10:59:31.121898+0000","last_active":"2024-09-10T10:59:40.153044+0000","last_peered":"2024-09-10T10:59:40.153044+0000","last_clean":"2024-09-10T10:59:40.153044+0000","last_became_active":"2024-09-10T10:59:31.121478+0000","last_became_peered":"2024-09-10T10:59:31.121478+0000","last_unstale":"2024-09-10T10:59:40.153044+0000","last_undegraded":"2024-09-10T10:59:40.153044+0000","last_fullsized":"2024-09-10T10:59:40.153044+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:01.805762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157141+0000","last_change":"2024-09-10T10:59:28.974086+0000","last_active":"2024-09-10T10:59:40.157141+0000","last_peered":"2024-09-10T10:59:40.157141+0000","last_clean":"2024-09-10T10:59:40.157141+0000","last_became_active":"2024-09-10T10:59:28.973801+0000","last_became_peered":"2024-09-10T10:59:28.973801+0000","last_unstale":"2024-09-10T10:59:40.157141+0000","last_undegraded":"2024-09-10T10:59:40.157141+0000","last_fullsized":"2024-09-10T10:59:40.157141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:10.338340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155611+0000","last_change":"2024-09-10T10:59:31.130301+0000","last_active":"2024-09-10T10:59:40.155611+0000","last_peered":"2024-09-10T10:59:40.155611+0000","last_clean":"2024-09-10T10:59:40.155611+0000","last_became_active":"2024-09-10T10:59:31.129959+0000","last_became_peered":"2024-09-10T10:59:31.129959+0000","last_unstale":"2024-09-10T10:59:40.155611+0000","last_undegraded":"2024-09-10T10:59:40.155611+0000","last_fullsized":"2024-09-10T10:59:40.155611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:32.131310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152650+0000","last_change":"2024-09-10T10:59:28.976683+0000","last_active":"2024-09-10T10:59:40.152650+0000","last_peered":"2024-09-10T10:59:40.152650+0000","last_clean":"2024-09-10T10:59:40.152650+0000","last_became_active":"2024-09-10T10:59:28.976278+0000","last_became_peered":"2024-09-10T10:59:28.976278+0000","last_unstale":"2024-09-10T10:59:40.152650+0000","last_undegraded":"2024-09-10T10:59:40.152650+0000","last_fullsized":"2024-09-10T10:59:40.152650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:49.100274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157441+0000","last_change":"2024-09-10T10:59:31.118400+0000","last_active":"2024-09-10T10:59:40.157441+0000","last_peered":"2024-09-10T10:59:40.157441+0000","last_clean":"2024-09-10T10:59:40.157441+0000","last_became_active":"2024-09-10T10:59:31.118067+0000","last_became_peered":"2024-09-10T10:59:31.118067+0000","last_unstale":"2024-09-10T10:59:40.157441+0000","last_undegraded":"2024-09-10T10:59:40.157441+0000","last_fullsized":"2024-09-10T10:59:40.157441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:03.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.162110+0000","last_change":"2024-09-10T10:59:40.161592+0000","last_active":"2024-09-10T10:59:40.162110+0000","last_peered":"2024-09-10T10:59:40.162110+0000","last_clean":"2024-09-10T10:59:40.162110+0000","last_became_active":"2024-09-10T10:59:40.156968+0000","last_became_peered":"2024-09-10T10:59:40.156968+0000","last_unstale":"2024-09-10T10:59:40.162110+0000","last_undegraded":"2024-09-10T10:59:40.162110+0000","last_fullsized":"2024-09-10T10:59:40.162110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:20.107251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152634+0000","last_change":"2024-09-10T10:59:31.132779+0000","last_active":"2024-09-10T10:59:40.152634+0000","last_peered":"2024-09-10T10:59:40.152634+0000","last_clean":"2024-09-10T10:59:40.152634+0000","last_became_active":"2024-09-10T10:59:31.132417+0000","last_became_peered":"2024-09-10T10:59:31.132417+0000","last_unstale":"2024-09-10T10:59:40.152634+0000","last_undegraded":"2024-09-10T10:59:40.152634+0000","last_fullsized":"2024-09-10T10:59:40.152634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:47.640774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211900+0000","last_change":"2024-09-10T10:59:31.133370+0000","last_active":"2024-09-10T10:59:40.211900+0000","last_peered":"2024-09-10T10:59:40.211900+0000","last_clean":"2024-09-10T10:59:40.211900+0000","last_became_active":"2024-09-10T10:59:31.133027+0000","last_became_peered":"2024-09-10T10:59:31.133027+0000","last_unstale":"2024-09-10T10:59:40.211900+0000","last_undegraded":"2024-09-10T10:59:40.211900+0000","last_fullsized":"2024-09-10T10:59:40.211900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:24.550987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154242+0000","last_change":"2024-09-10T10:59:28.973416+0000","last_active":"2024-09-10T10:59:40.154242+0000","last_peered":"2024-09-10T10:59:40.154242+0000","last_clean":"2024-09-10T10:59:40.154242+0000","last_became_active":"2024-09-10T10:59:28.973050+0000","last_became_peered":"2024-09-10T10:59:28.973050+0000","last_unstale":"2024-09-10T10:59:40.154242+0000","last_undegraded":"2024-09-10T10:59:40.154242+0000","last_fullsized":"2024-09-10T10:59:40.154242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:00.013173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150537+0000","last_change":"2024-09-10T10:59:31.132568+0000","last_active":"2024-09-10T10:59:40.150537+0000","last_peered":"2024-09-10T10:59:40.150537+0000","last_clean":"2024-09-10T10:59:40.150537+0000","last_became_active":"2024-09-10T10:59:31.132260+0000","last_became_peered":"2024-09-10T10:59:31.132260+0000","last_unstale":"2024-09-10T10:59:40.150537+0000","last_undegraded":"2024-09-10T10:59:40.150537+0000","last_fullsized":"2024-09-10T10:59:40.150537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:14.420293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.169008+0000","last_change":"2024-09-10T10:59:28.981404+0000","last_active":"2024-09-10T10:59:41.169008+0000","last_peered":"2024-09-10T10:59:41.169008+0000","last_clean":"2024-09-10T10:59:41.169008+0000","last_became_active":"2024-09-10T10:59:28.981066+0000","last_became_peered":"2024-09-10T10:59:28.981066+0000","last_unstale":"2024-09-10T10:59:41.169008+0000","last_undegraded":"2024-09-10T10:59:41.169008+0000","last_fullsized":"2024-09-10T10:59:41.169008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:16.075280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211311+0000","last_change":"2024-09-10T10:59:31.133696+0000","last_active":"2024-09-10T10:59:40.211311+0000","last_peered":"2024-09-10T10:59:40.211311+0000","last_clean":"2024-09-10T10:59:40.211311+0000","last_became_active":"2024-09-10T10:59:31.132978+0000","last_became_peered":"2024-09-10T10:59:31.132978+0000","last_unstale":"2024-09-10T10:59:40.211311+0000","last_undegraded":"2024-09-10T10:59:40.211311+0000","last_fullsized":"2024-09-10T10:59:40.211311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:37.273524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158089+0000","last_change":"2024-09-10T10:59:29.230472+0000","last_active":"2024-09-10T10:59:40.158089+0000","last_peered":"2024-09-10T10:59:40.158089+0000","last_clean":"2024-09-10T10:59:40.158089+0000","last_became_active":"2024-09-10T10:59:29.230128+0000","last_became_peered":"2024-09-10T10:59:29.230128+0000","last_unstale":"2024-09-10T10:59:40.158089+0000","last_undegraded":"2024-09-10T10:59:40.158089+0000","last_fullsized":"2024-09-10T10:59:40.158089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:26.116922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157847+0000","last_change":"2024-09-10T10:59:31.132406+0000","last_active":"2024-09-10T10:59:40.157847+0000","last_peered":"2024-09-10T10:59:40.157847+0000","last_clean":"2024-09-10T10:59:40.157847+0000","last_became_active":"2024-09-10T10:59:31.132088+0000","last_became_peered":"2024-09-10T10:59:31.132088+0000","last_unstale":"2024-09-10T10:59:40.157847+0000","last_undegraded":"2024-09-10T10:59:40.157847+0000","last_fullsized":"2024-09-10T10:59:40.157847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:47.222192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170194+0000","last_change":"2024-09-10T10:59:28.978103+0000","last_active":"2024-09-10T10:59:41.170194+0000","last_peered":"2024-09-10T10:59:41.170194+0000","last_clean":"2024-09-10T10:59:41.170194+0000","last_became_active":"2024-09-10T10:59:28.977918+0000","last_became_peered":"2024-09-10T10:59:28.977918+0000","last_unstale":"2024-09-10T10:59:41.170194+0000","last_undegraded":"2024-09-10T10:59:41.170194+0000","last_fullsized":"2024-09-10T10:59:41.170194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.157534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51198,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":98,"num_read_kb":104,"num_write":149,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":161746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":212318,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":438088,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":1076764,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438324,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168609,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438244,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030569,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":437713,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790000,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":1029860,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":438543,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438024,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":485469,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":484890,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":438984,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34293,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34293,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":55536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":47963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:59:57.776 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:59:58.035 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:59:58.460 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:58 smithi059 ceph-mon[30978]: pgmap v292: 97 pgs: 97 active+clean; 627 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T10:59:58.460 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 10:59:58 smithi059 ceph-mon[30978]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:59:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.540+0000 7fe359860640 1 -- 172.21.15.59:0/3637873072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe354101df0 msgr2=0x7fe3541021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.540+0000 7fe359860640 1 --2- 172.21.15.59:0/3637873072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe354101df0 0x7fe3541021d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe344009900 tx=0x7fe34402a410 comp rx=0 tx=0).stop 2024-09-10T10:59:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.540+0000 7fe359860640 1 -- 172.21.15.59:0/3637873072 shutdown_connections 2024-09-10T10:59:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.540+0000 7fe359860640 1 --2- 172.21.15.59:0/3637873072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe354106f20 0x7fe35410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.540+0000 7fe359860640 1 --2- 172.21.15.59:0/3637873072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3541027a0 0x7fe3541067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.540+0000 7fe359860640 1 --2- 172.21.15.59:0/3637873072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe354101df0 0x7fe3541021d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.540+0000 7fe359860640 1 -- 172.21.15.59:0/3637873072 >> 172.21.15.59:0/3637873072 conn(0x7fe3540fd8b0 msgr2=0x7fe3540ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.540+0000 7fe359860640 1 -- 172.21.15.59:0/3637873072 shutdown_connections 2024-09-10T10:59:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.540+0000 7fe359860640 1 -- 172.21.15.59:0/3637873072 wait complete. 2024-09-10T10:59:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.541+0000 7fe359860640 1 Processor -- start 2024-09-10T10:59:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.541+0000 7fe359860640 1 -- start start 2024-09-10T10:59:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.541+0000 7fe359860640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe354101df0 0x7fe354198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.541+0000 7fe359860640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3541027a0 0x7fe3541989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.541+0000 7fe359860640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe354106f20 0x7fe35419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.541+0000 7fe359860640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe354111f40 con 0x7fe3541027a0 2024-09-10T10:59:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.541+0000 7fe359860640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe354111dc0 con 0x7fe354101df0 2024-09-10T10:59:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.541+0000 7fe359860640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe3541120c0 con 0x7fe354106f20 2024-09-10T10:59:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.541+0000 7fe3527fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3541027a0 0x7fe3541989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe3527fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3541027a0 0x7fe3541989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44500/0 (socket says 172.21.15.59:44500) 2024-09-10T10:59:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe3527fc640 1 -- 172.21.15.59:0/2923877948 learned_addr learned my addr 172.21.15.59:0/2923877948 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T10:59:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe352ffd640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe354101df0 0x7fe354198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe3537fe640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe354106f20 0x7fe35419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe3527fc640 1 -- 172.21.15.59:0/2923877948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe354106f20 msgr2=0x7fe35419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe3527fc640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe354106f20 0x7fe35419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe3527fc640 1 -- 172.21.15.59:0/2923877948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe354101df0 msgr2=0x7fe354198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe3527fc640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe354101df0 0x7fe354198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe3527fc640 1 -- 172.21.15.59:0/2923877948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35419d430 con 0x7fe3541027a0 2024-09-10T10:59:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe352ffd640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe354101df0 0x7fe354198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:59:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe3527fc640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3541027a0 0x7fe3541989c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe34800d950 tx=0x7fe34800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe35885e640 1 -- 172.21.15.59:0/2923877948 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348017070 con 0x7fe3541027a0 2024-09-10T10:59:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35419d720 con 0x7fe3541027a0 2024-09-10T10:59:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe35885e640 1 -- 172.21.15.59:0/2923877948 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe348009c30 con 0x7fe3541027a0 2024-09-10T10:59:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe35885e640 1 -- 172.21.15.59:0/2923877948 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34800f6b0 con 0x7fe3541027a0 2024-09-10T10:59:58.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.542+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3541a5000 con 0x7fe3541027a0 2024-09-10T10:59:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.543+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3541021d0 con 0x7fe3541027a0 2024-09-10T10:59:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.544+0000 7fe35885e640 1 -- 172.21.15.59:0/2923877948 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe3480109d0 con 0x7fe3541027a0 2024-09-10T10:59:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.545+0000 7fe35885e640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe33c0a2c10 0x7fe33c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:59:58.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.545+0000 7fe352ffd640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe33c0a2c10 0x7fe33c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:59:58.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.545+0000 7fe35885e640 1 -- 172.21.15.59:0/2923877948 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe3480cef10 con 0x7fe3541027a0 2024-09-10T10:59:58.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.546+0000 7fe352ffd640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe33c0a2c10 0x7fe33c0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe344005ab0 tx=0x7fe344005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:59:58.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.550+0000 7fe35885e640 1 -- 172.21.15.59:0/2923877948 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe348009de0 con 0x7fe3541027a0 2024-09-10T10:59:58.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:58 smithi181 ceph-mon[35409]: pgmap v292: 97 pgs: 97 active+clean; 627 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T10:59:58.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 10:59:58 smithi181 ceph-mon[35409]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:59:58.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:58 smithi115 ceph-mon[34719]: pgmap v292: 97 pgs: 97 active+clean; 627 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T10:59:58.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 10:59:58 smithi115 ceph-mon[34719]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:59:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.723+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe35410a160 con 0x7fe33c0a2c10 2024-09-10T10:59:58.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.730+0000 7fe35885e640 1 -- 172.21.15.59:0/2923877948 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258918 (secure 0 0 0) 0x7fe35410a160 con 0x7fe33c0a2c10 2024-09-10T10:59:58.737 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T10:59:58.738 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T10:59:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe33c0a2c10 msgr2=0x7fe33c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe33c0a2c10 0x7fe33c0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe344005ab0 tx=0x7fe344005a20 comp rx=0 tx=0).stop 2024-09-10T10:59:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3541027a0 msgr2=0x7fe3541989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:59:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3541027a0 0x7fe3541989c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe34800d950 tx=0x7fe34800de10 comp rx=0 tx=0).stop 2024-09-10T10:59:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 shutdown_connections 2024-09-10T10:59:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe33c0a2c10 0x7fe33c0a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe354106f20 0x7fe35419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3541027a0 0x7fe3541989c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 --2- 172.21.15.59:0/2923877948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe354101df0 0x7fe354198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:59:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.733+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 >> 172.21.15.59:0/2923877948 conn(0x7fe3540fd8b0 msgr2=0x7fe3540fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:59:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.734+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 shutdown_connections 2024-09-10T10:59:58.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T10:59:58.734+0000 7fe359860640 1 -- 172.21.15.59:0/2923877948 wait complete. 2024-09-10T10:59:59.542 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-10T10:59:58.713181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649952,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":265,"num_read_kb":246,"num_write":341,"num_write_kb":3042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364448,"kb_used_data":11020,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577376,"statfs":{"total":1151940427776,"available":1151567233024,"internally_reserved":0,"allocated":11284480,"data_stored":7191776,"data_compressed":176979,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54362,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":101,"num_write":35,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003214"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155754+0000","last_change":"2024-09-10T10:59:31.132551+0000","last_active":"2024-09-10T10:59:40.155754+0000","last_peered":"2024-09-10T10:59:40.155754+0000","last_clean":"2024-09-10T10:59:40.155754+0000","last_became_active":"2024-09-10T10:59:31.132002+0000","last_became_peered":"2024-09-10T10:59:31.132002+0000","last_unstale":"2024-09-10T10:59:40.155754+0000","last_undegraded":"2024-09-10T10:59:40.155754+0000","last_fullsized":"2024-09-10T10:59:40.155754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:14.696067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211064+0000","last_change":"2024-09-10T10:59:31.129868+0000","last_active":"2024-09-10T10:59:40.211064+0000","last_peered":"2024-09-10T10:59:40.211064+0000","last_clean":"2024-09-10T10:59:40.211064+0000","last_became_active":"2024-09-10T10:59:31.129566+0000","last_became_peered":"2024-09-10T10:59:31.129566+0000","last_unstale":"2024-09-10T10:59:40.211064+0000","last_undegraded":"2024-09-10T10:59:40.211064+0000","last_fullsized":"2024-09-10T10:59:40.211064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:30.890000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211128+0000","last_change":"2024-09-10T10:59:31.134021+0000","last_active":"2024-09-10T10:59:40.211128+0000","last_peered":"2024-09-10T10:59:40.211128+0000","last_clean":"2024-09-10T10:59:40.211128+0000","last_became_active":"2024-09-10T10:59:31.133378+0000","last_became_peered":"2024-09-10T10:59:31.133378+0000","last_unstale":"2024-09-10T10:59:40.211128+0000","last_undegraded":"2024-09-10T10:59:40.211128+0000","last_fullsized":"2024-09-10T10:59:40.211128+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:32.808518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.156639+0000","last_change":"2024-09-10T10:59:40.156045+0000","last_active":"2024-09-10T10:59:40.156639+0000","last_peered":"2024-09-10T10:59:40.156639+0000","last_clean":"2024-09-10T10:59:40.156639+0000","last_became_active":"2024-09-10T10:59:40.155722+0000","last_became_peered":"2024-09-10T10:59:40.155722+0000","last_unstale":"2024-09-10T10:59:40.156639+0000","last_undegraded":"2024-09-10T10:59:40.156639+0000","last_fullsized":"2024-09-10T10:59:40.156639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:55.413173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153086+0000","last_change":"2024-09-10T10:59:31.128308+0000","last_active":"2024-09-10T10:59:40.153086+0000","last_peered":"2024-09-10T10:59:40.153086+0000","last_clean":"2024-09-10T10:59:40.153086+0000","last_became_active":"2024-09-10T10:59:31.127937+0000","last_became_peered":"2024-09-10T10:59:31.127937+0000","last_unstale":"2024-09-10T10:59:40.153086+0000","last_undegraded":"2024-09-10T10:59:40.153086+0000","last_fullsized":"2024-09-10T10:59:40.153086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:37.977168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157396+0000","last_change":"2024-09-10T10:59:40.157396+0000","last_active":"2024-09-10T10:59:40.157396+0000","last_peered":"2024-09-10T10:59:40.157396+0000","last_clean":"2024-09-10T10:59:40.157396+0000","last_became_active":"2024-09-10T10:59:40.157003+0000","last_became_peered":"2024-09-10T10:59:40.157003+0000","last_unstale":"2024-09-10T10:59:40.157396+0000","last_undegraded":"2024-09-10T10:59:40.157396+0000","last_fullsized":"2024-09-10T10:59:40.157396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152495+0000","last_change":"2024-09-10T10:59:31.136045+0000","last_active":"2024-09-10T10:59:40.152495+0000","last_peered":"2024-09-10T10:59:40.152495+0000","last_clean":"2024-09-10T10:59:40.152495+0000","last_became_active":"2024-09-10T10:59:31.135295+0000","last_became_peered":"2024-09-10T10:59:31.135295+0000","last_unstale":"2024-09-10T10:59:40.152495+0000","last_undegraded":"2024-09-10T10:59:40.152495+0000","last_fullsized":"2024-09-10T10:59:40.152495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:04.306752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157288+0000","last_change":"2024-09-10T10:59:31.120953+0000","last_active":"2024-09-10T10:59:40.157288+0000","last_peered":"2024-09-10T10:59:40.157288+0000","last_clean":"2024-09-10T10:59:40.157288+0000","last_became_active":"2024-09-10T10:59:31.120647+0000","last_became_peered":"2024-09-10T10:59:31.120647+0000","last_unstale":"2024-09-10T10:59:40.157288+0000","last_undegraded":"2024-09-10T10:59:40.157288+0000","last_fullsized":"2024-09-10T10:59:40.157288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:53.689216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151033+0000","last_change":"2024-09-10T10:59:31.136326+0000","last_active":"2024-09-10T10:59:40.151033+0000","last_peered":"2024-09-10T10:59:40.151033+0000","last_clean":"2024-09-10T10:59:40.151033+0000","last_became_active":"2024-09-10T10:59:31.135129+0000","last_became_peered":"2024-09-10T10:59:31.135129+0000","last_unstale":"2024-09-10T10:59:40.151033+0000","last_undegraded":"2024-09-10T10:59:40.151033+0000","last_fullsized":"2024-09-10T10:59:40.151033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:05.510845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153822+0000","last_change":"2024-09-10T10:59:31.130680+0000","last_active":"2024-09-10T10:59:40.153822+0000","last_peered":"2024-09-10T10:59:40.153822+0000","last_clean":"2024-09-10T10:59:40.153822+0000","last_became_active":"2024-09-10T10:59:31.130356+0000","last_became_peered":"2024-09-10T10:59:31.130356+0000","last_unstale":"2024-09-10T10:59:40.153822+0000","last_undegraded":"2024-09-10T10:59:40.153822+0000","last_fullsized":"2024-09-10T10:59:40.153822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:50.450251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153064+0000","last_change":"2024-09-10T10:59:31.129938+0000","last_active":"2024-09-10T10:59:40.153064+0000","last_peered":"2024-09-10T10:59:40.153064+0000","last_clean":"2024-09-10T10:59:40.153064+0000","last_became_active":"2024-09-10T10:59:31.129527+0000","last_became_peered":"2024-09-10T10:59:31.129527+0000","last_unstale":"2024-09-10T10:59:40.153064+0000","last_undegraded":"2024-09-10T10:59:40.153064+0000","last_fullsized":"2024-09-10T10:59:40.153064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:06.373082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.156876+0000","last_change":"2024-09-10T10:59:40.156217+0000","last_active":"2024-09-10T10:59:40.156876+0000","last_peered":"2024-09-10T10:59:40.156876+0000","last_clean":"2024-09-10T10:59:40.156876+0000","last_became_active":"2024-09-10T10:59:40.155900+0000","last_became_peered":"2024-09-10T10:59:40.155900+0000","last_unstale":"2024-09-10T10:59:40.156876+0000","last_undegraded":"2024-09-10T10:59:40.156876+0000","last_fullsized":"2024-09-10T10:59:40.156876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:17.085474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153961+0000","last_change":"2024-09-10T10:59:31.135564+0000","last_active":"2024-09-10T10:59:40.153961+0000","last_peered":"2024-09-10T10:59:40.153961+0000","last_clean":"2024-09-10T10:59:40.153961+0000","last_became_active":"2024-09-10T10:59:31.135185+0000","last_became_peered":"2024-09-10T10:59:31.135185+0000","last_unstale":"2024-09-10T10:59:40.153961+0000","last_undegraded":"2024-09-10T10:59:40.153961+0000","last_fullsized":"2024-09-10T10:59:40.153961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:17.275533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211219+0000","last_change":"2024-09-10T10:59:31.130517+0000","last_active":"2024-09-10T10:59:40.211219+0000","last_peered":"2024-09-10T10:59:40.211219+0000","last_clean":"2024-09-10T10:59:40.211219+0000","last_became_active":"2024-09-10T10:59:31.130156+0000","last_became_peered":"2024-09-10T10:59:31.130156+0000","last_unstale":"2024-09-10T10:59:40.211219+0000","last_undegraded":"2024-09-10T10:59:40.211219+0000","last_fullsized":"2024-09-10T10:59:40.211219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:33.354812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.210915+0000","last_change":"2024-09-10T10:59:31.130701+0000","last_active":"2024-09-10T10:59:40.210915+0000","last_peered":"2024-09-10T10:59:40.210915+0000","last_clean":"2024-09-10T10:59:40.210915+0000","last_became_active":"2024-09-10T10:59:31.130379+0000","last_became_peered":"2024-09-10T10:59:31.130379+0000","last_unstale":"2024-09-10T10:59:40.210915+0000","last_undegraded":"2024-09-10T10:59:40.210915+0000","last_fullsized":"2024-09-10T10:59:40.210915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:24.787292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150433+0000","last_change":"2024-09-10T10:59:31.129583+0000","last_active":"2024-09-10T10:59:40.150433+0000","last_peered":"2024-09-10T10:59:40.150433+0000","last_clean":"2024-09-10T10:59:40.150433+0000","last_became_active":"2024-09-10T10:59:31.128559+0000","last_became_peered":"2024-09-10T10:59:31.128559+0000","last_unstale":"2024-09-10T10:59:40.150433+0000","last_undegraded":"2024-09-10T10:59:40.150433+0000","last_fullsized":"2024-09-10T10:59:40.150433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:20.139987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155807+0000","last_change":"2024-09-10T10:59:31.132579+0000","last_active":"2024-09-10T10:59:40.155807+0000","last_peered":"2024-09-10T10:59:40.155807+0000","last_clean":"2024-09-10T10:59:40.155807+0000","last_became_active":"2024-09-10T10:59:31.132256+0000","last_became_peered":"2024-09-10T10:59:31.132256+0000","last_unstale":"2024-09-10T10:59:40.155807+0000","last_undegraded":"2024-09-10T10:59:40.155807+0000","last_fullsized":"2024-09-10T10:59:40.155807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:54.771376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151638+0000","last_change":"2024-09-10T10:59:31.127666+0000","last_active":"2024-09-10T10:59:40.151638+0000","last_peered":"2024-09-10T10:59:40.151638+0000","last_clean":"2024-09-10T10:59:40.151638+0000","last_became_active":"2024-09-10T10:59:31.127354+0000","last_became_peered":"2024-09-10T10:59:31.127354+0000","last_unstale":"2024-09-10T10:59:40.151638+0000","last_undegraded":"2024-09-10T10:59:40.151638+0000","last_fullsized":"2024-09-10T10:59:40.151638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:25.089856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152482+0000","last_change":"2024-09-10T10:59:31.126146+0000","last_active":"2024-09-10T10:59:40.152482+0000","last_peered":"2024-09-10T10:59:40.152482+0000","last_clean":"2024-09-10T10:59:40.152482+0000","last_became_active":"2024-09-10T10:59:31.125821+0000","last_became_peered":"2024-09-10T10:59:31.125821+0000","last_unstale":"2024-09-10T10:59:40.152482+0000","last_undegraded":"2024-09-10T10:59:40.152482+0000","last_fullsized":"2024-09-10T10:59:40.152482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:14.442467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155662+0000","last_change":"2024-09-10T10:59:31.124783+0000","last_active":"2024-09-10T10:59:40.155662+0000","last_peered":"2024-09-10T10:59:40.155662+0000","last_clean":"2024-09-10T10:59:40.155662+0000","last_became_active":"2024-09-10T10:59:31.124461+0000","last_became_peered":"2024-09-10T10:59:31.124461+0000","last_unstale":"2024-09-10T10:59:40.155662+0000","last_undegraded":"2024-09-10T10:59:40.155662+0000","last_fullsized":"2024-09-10T10:59:40.155662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:30.312716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154045+0000","last_change":"2024-09-10T10:59:31.123118+0000","last_active":"2024-09-10T10:59:40.154045+0000","last_peered":"2024-09-10T10:59:40.154045+0000","last_clean":"2024-09-10T10:59:40.154045+0000","last_became_active":"2024-09-10T10:59:31.122802+0000","last_became_peered":"2024-09-10T10:59:31.122802+0000","last_unstale":"2024-09-10T10:59:40.154045+0000","last_undegraded":"2024-09-10T10:59:40.154045+0000","last_fullsized":"2024-09-10T10:59:40.154045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:38:30.274121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150564+0000","last_change":"2024-09-10T10:59:31.125163+0000","last_active":"2024-09-10T10:59:40.150564+0000","last_peered":"2024-09-10T10:59:40.150564+0000","last_clean":"2024-09-10T10:59:40.150564+0000","last_became_active":"2024-09-10T10:59:31.124823+0000","last_became_peered":"2024-09-10T10:59:31.124823+0000","last_unstale":"2024-09-10T10:59:40.150564+0000","last_undegraded":"2024-09-10T10:59:40.150564+0000","last_fullsized":"2024-09-10T10:59:40.150564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:06.479220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157045+0000","last_change":"2024-09-10T10:59:31.124892+0000","last_active":"2024-09-10T10:59:40.157045+0000","last_peered":"2024-09-10T10:59:40.157045+0000","last_clean":"2024-09-10T10:59:40.157045+0000","last_became_active":"2024-09-10T10:59:31.124575+0000","last_became_peered":"2024-09-10T10:59:31.124575+0000","last_unstale":"2024-09-10T10:59:40.157045+0000","last_undegraded":"2024-09-10T10:59:40.157045+0000","last_fullsized":"2024-09-10T10:59:40.157045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:54.562406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.159964+0000","last_change":"2024-09-10T10:59:40.159510+0000","last_active":"2024-09-10T10:59:40.159964+0000","last_peered":"2024-09-10T10:59:40.159964+0000","last_clean":"2024-09-10T10:59:40.159964+0000","last_became_active":"2024-09-10T10:59:40.159115+0000","last_became_peered":"2024-09-10T10:59:40.159115+0000","last_unstale":"2024-09-10T10:59:40.159964+0000","last_undegraded":"2024-09-10T10:59:40.159964+0000","last_fullsized":"2024-09-10T10:59:40.159964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:28.390308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158008+0000","last_change":"2024-09-10T10:59:31.125849+0000","last_active":"2024-09-10T10:59:40.158008+0000","last_peered":"2024-09-10T10:59:40.158008+0000","last_clean":"2024-09-10T10:59:40.158008+0000","last_became_active":"2024-09-10T10:59:31.125487+0000","last_became_peered":"2024-09-10T10:59:31.125487+0000","last_unstale":"2024-09-10T10:59:40.158008+0000","last_undegraded":"2024-09-10T10:59:40.158008+0000","last_fullsized":"2024-09-10T10:59:40.158008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:56.364182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152718+0000","last_change":"2024-09-10T10:59:31.132717+0000","last_active":"2024-09-10T10:59:40.152718+0000","last_peered":"2024-09-10T10:59:40.152718+0000","last_clean":"2024-09-10T10:59:40.152718+0000","last_became_active":"2024-09-10T10:59:31.132258+0000","last_became_peered":"2024-09-10T10:59:31.132258+0000","last_unstale":"2024-09-10T10:59:40.152718+0000","last_undegraded":"2024-09-10T10:59:40.152718+0000","last_fullsized":"2024-09-10T10:59:40.152718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:27.910065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155638+0000","last_change":"2024-09-10T10:59:31.136320+0000","last_active":"2024-09-10T10:59:40.155638+0000","last_peered":"2024-09-10T10:59:40.155638+0000","last_clean":"2024-09-10T10:59:40.155638+0000","last_became_active":"2024-09-10T10:59:31.135970+0000","last_became_peered":"2024-09-10T10:59:31.135970+0000","last_unstale":"2024-09-10T10:59:40.155638+0000","last_undegraded":"2024-09-10T10:59:40.155638+0000","last_fullsized":"2024-09-10T10:59:40.155638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:19.380754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153513+0000","last_change":"2024-09-10T10:59:31.123793+0000","last_active":"2024-09-10T10:59:40.153513+0000","last_peered":"2024-09-10T10:59:40.153513+0000","last_clean":"2024-09-10T10:59:40.153513+0000","last_became_active":"2024-09-10T10:59:31.123502+0000","last_became_peered":"2024-09-10T10:59:31.123502+0000","last_unstale":"2024-09-10T10:59:40.153513+0000","last_undegraded":"2024-09-10T10:59:40.153513+0000","last_fullsized":"2024-09-10T10:59:40.153513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:43.883652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211247+0000","last_change":"2024-09-10T10:59:31.127616+0000","last_active":"2024-09-10T10:59:40.211247+0000","last_peered":"2024-09-10T10:59:40.211247+0000","last_clean":"2024-09-10T10:59:40.211247+0000","last_became_active":"2024-09-10T10:59:31.127296+0000","last_became_peered":"2024-09-10T10:59:31.127296+0000","last_unstale":"2024-09-10T10:59:40.211247+0000","last_undegraded":"2024-09-10T10:59:40.211247+0000","last_fullsized":"2024-09-10T10:59:40.211247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:58.284180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212762+0000","last_change":"2024-09-10T10:59:40.212762+0000","last_active":"2024-09-10T10:59:40.212762+0000","last_peered":"2024-09-10T10:59:40.212762+0000","last_clean":"2024-09-10T10:59:40.212762+0000","last_became_active":"2024-09-10T10:59:40.212356+0000","last_became_peered":"2024-09-10T10:59:40.212356+0000","last_unstale":"2024-09-10T10:59:40.212762+0000","last_undegraded":"2024-09-10T10:59:40.212762+0000","last_fullsized":"2024-09-10T10:59:40.212762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:45.341432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.213553+0000","last_change":"2024-09-10T10:59:40.213553+0000","last_active":"2024-09-10T10:59:40.213553+0000","last_peered":"2024-09-10T10:59:40.213553+0000","last_clean":"2024-09-10T10:59:40.213553+0000","last_became_active":"2024-09-10T10:59:40.213104+0000","last_became_peered":"2024-09-10T10:59:40.213104+0000","last_unstale":"2024-09-10T10:59:40.213553+0000","last_undegraded":"2024-09-10T10:59:40.213553+0000","last_fullsized":"2024-09-10T10:59:40.213553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:24:09.901559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155007+0000","last_change":"2024-09-10T10:59:31.135637+0000","last_active":"2024-09-10T10:59:40.155007+0000","last_peered":"2024-09-10T10:59:40.155007+0000","last_clean":"2024-09-10T10:59:40.155007+0000","last_became_active":"2024-09-10T10:59:31.135286+0000","last_became_peered":"2024-09-10T10:59:31.135286+0000","last_unstale":"2024-09-10T10:59:40.155007+0000","last_undegraded":"2024-09-10T10:59:40.155007+0000","last_fullsized":"2024-09-10T10:59:40.155007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:44:56.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157927+0000","last_change":"2024-09-10T10:59:40.157927+0000","last_active":"2024-09-10T10:59:40.157927+0000","last_peered":"2024-09-10T10:59:40.157927+0000","last_clean":"2024-09-10T10:59:40.157927+0000","last_became_active":"2024-09-10T10:59:40.157506+0000","last_became_peered":"2024-09-10T10:59:40.157506+0000","last_unstale":"2024-09-10T10:59:40.157927+0000","last_undegraded":"2024-09-10T10:59:40.157927+0000","last_fullsized":"2024-09-10T10:59:40.157927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:18.848309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:57.196474+0000","last_change":"2024-09-10T10:59:28.980783+0000","last_active":"2024-09-10T10:59:57.196474+0000","last_peered":"2024-09-10T10:59:57.196474+0000","last_clean":"2024-09-10T10:59:57.196474+0000","last_became_active":"2024-09-10T10:59:28.980420+0000","last_became_peered":"2024-09-10T10:59:28.980420+0000","last_unstale":"2024-09-10T10:59:57.196474+0000","last_undegraded":"2024-09-10T10:59:57.196474+0000","last_fullsized":"2024-09-10T10:59:57.196474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:58.575440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211462+0000","last_change":"2024-09-10T10:59:31.133661+0000","last_active":"2024-09-10T10:59:40.211462+0000","last_peered":"2024-09-10T10:59:40.211462+0000","last_clean":"2024-09-10T10:59:40.211462+0000","last_became_active":"2024-09-10T10:59:31.133323+0000","last_became_peered":"2024-09-10T10:59:31.133323+0000","last_unstale":"2024-09-10T10:59:40.211462+0000","last_undegraded":"2024-09-10T10:59:40.211462+0000","last_fullsized":"2024-09-10T10:59:40.211462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:37.498128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170086+0000","last_change":"2024-09-10T10:59:28.976329+0000","last_active":"2024-09-10T10:59:41.170086+0000","last_peered":"2024-09-10T10:59:41.170086+0000","last_clean":"2024-09-10T10:59:41.170086+0000","last_became_active":"2024-09-10T10:59:28.975937+0000","last_became_peered":"2024-09-10T10:59:28.975937+0000","last_unstale":"2024-09-10T10:59:41.170086+0000","last_undegraded":"2024-09-10T10:59:41.170086+0000","last_fullsized":"2024-09-10T10:59:41.170086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:46.118954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170624+0000","last_change":"2024-09-10T10:59:28.976853+0000","last_active":"2024-09-10T10:59:41.170624+0000","last_peered":"2024-09-10T10:59:41.170624+0000","last_clean":"2024-09-10T10:59:41.170624+0000","last_became_active":"2024-09-10T10:59:28.976524+0000","last_became_peered":"2024-09-10T10:59:28.976524+0000","last_unstale":"2024-09-10T10:59:41.170624+0000","last_undegraded":"2024-09-10T10:59:41.170624+0000","last_fullsized":"2024-09-10T10:59:41.170624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:27.473954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157400+0000","last_change":"2024-09-10T10:59:31.124533+0000","last_active":"2024-09-10T10:59:40.157400+0000","last_peered":"2024-09-10T10:59:40.157400+0000","last_clean":"2024-09-10T10:59:40.157400+0000","last_became_active":"2024-09-10T10:59:31.124179+0000","last_became_peered":"2024-09-10T10:59:31.124179+0000","last_unstale":"2024-09-10T10:59:40.157400+0000","last_undegraded":"2024-09-10T10:59:40.157400+0000","last_fullsized":"2024-09-10T10:59:40.157400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:23.114178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211738+0000","last_change":"2024-09-10T10:59:28.974785+0000","last_active":"2024-09-10T10:59:40.211738+0000","last_peered":"2024-09-10T10:59:40.211738+0000","last_clean":"2024-09-10T10:59:40.211738+0000","last_became_active":"2024-09-10T10:59:28.974499+0000","last_became_peered":"2024-09-10T10:59:28.974499+0000","last_unstale":"2024-09-10T10:59:40.211738+0000","last_undegraded":"2024-09-10T10:59:40.211738+0000","last_fullsized":"2024-09-10T10:59:40.211738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:18.551425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151294+0000","last_change":"2024-09-10T10:59:31.122040+0000","last_active":"2024-09-10T10:59:40.151294+0000","last_peered":"2024-09-10T10:59:40.151294+0000","last_clean":"2024-09-10T10:59:40.151294+0000","last_became_active":"2024-09-10T10:59:31.121683+0000","last_became_peered":"2024-09-10T10:59:31.121683+0000","last_unstale":"2024-09-10T10:59:40.151294+0000","last_undegraded":"2024-09-10T10:59:40.151294+0000","last_fullsized":"2024-09-10T10:59:40.151294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:42.783446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:57.195692+0000","last_change":"2024-09-10T10:59:28.979068+0000","last_active":"2024-09-10T10:59:57.195692+0000","last_peered":"2024-09-10T10:59:57.195692+0000","last_clean":"2024-09-10T10:59:57.195692+0000","last_became_active":"2024-09-10T10:59:28.978746+0000","last_became_peered":"2024-09-10T10:59:28.978746+0000","last_unstale":"2024-09-10T10:59:57.195692+0000","last_undegraded":"2024-09-10T10:59:57.195692+0000","last_fullsized":"2024-09-10T10:59:57.195692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:30.940050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150814+0000","last_change":"2024-09-10T10:59:31.130966+0000","last_active":"2024-09-10T10:59:40.150814+0000","last_peered":"2024-09-10T10:59:40.150814+0000","last_clean":"2024-09-10T10:59:40.150814+0000","last_became_active":"2024-09-10T10:59:31.130592+0000","last_became_peered":"2024-09-10T10:59:31.130592+0000","last_unstale":"2024-09-10T10:59:40.150814+0000","last_undegraded":"2024-09-10T10:59:40.150814+0000","last_fullsized":"2024-09-10T10:59:40.150814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:59.000694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.183919+0000","last_change":"2024-09-10T10:59:40.182217+0000","last_active":"2024-09-10T10:59:40.183919+0000","last_peered":"2024-09-10T10:59:40.183919+0000","last_clean":"2024-09-10T10:59:40.183919+0000","last_became_active":"2024-09-10T10:59:40.181771+0000","last_became_peered":"2024-09-10T10:59:40.181771+0000","last_unstale":"2024-09-10T10:59:40.183919+0000","last_undegraded":"2024-09-10T10:59:40.183919+0000","last_fullsized":"2024-09-10T10:59:40.183919+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:22.745512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211385+0000","last_change":"2024-09-10T10:59:31.123034+0000","last_active":"2024-09-10T10:59:40.211385+0000","last_peered":"2024-09-10T10:59:40.211385+0000","last_clean":"2024-09-10T10:59:40.211385+0000","last_became_active":"2024-09-10T10:59:31.122721+0000","last_became_peered":"2024-09-10T10:59:31.122721+0000","last_unstale":"2024-09-10T10:59:40.211385+0000","last_undegraded":"2024-09-10T10:59:40.211385+0000","last_fullsized":"2024-09-10T10:59:40.211385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:20.175740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212064+0000","last_change":"2024-09-10T10:59:29.230812+0000","last_active":"2024-09-10T10:59:40.212064+0000","last_peered":"2024-09-10T10:59:40.212064+0000","last_clean":"2024-09-10T10:59:40.212064+0000","last_became_active":"2024-09-10T10:59:29.230450+0000","last_became_peered":"2024-09-10T10:59:29.230450+0000","last_unstale":"2024-09-10T10:59:40.212064+0000","last_undegraded":"2024-09-10T10:59:40.212064+0000","last_fullsized":"2024-09-10T10:59:40.212064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:32.476465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150665+0000","last_change":"2024-09-10T10:59:31.129751+0000","last_active":"2024-09-10T10:59:40.150665+0000","last_peered":"2024-09-10T10:59:40.150665+0000","last_clean":"2024-09-10T10:59:40.150665+0000","last_became_active":"2024-09-10T10:59:31.129420+0000","last_became_peered":"2024-09-10T10:59:31.129420+0000","last_unstale":"2024-09-10T10:59:40.150665+0000","last_undegraded":"2024-09-10T10:59:40.150665+0000","last_fullsized":"2024-09-10T10:59:40.150665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:21.243051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'25","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:58.198095+0000","last_change":"2024-09-10T10:59:28.977234+0000","last_active":"2024-09-10T10:59:58.198095+0000","last_peered":"2024-09-10T10:59:58.198095+0000","last_clean":"2024-09-10T10:59:58.198095+0000","last_became_active":"2024-09-10T10:59:28.976897+0000","last_became_peered":"2024-09-10T10:59:28.976897+0000","last_unstale":"2024-09-10T10:59:58.198095+0000","last_undegraded":"2024-09-10T10:59:58.198095+0000","last_fullsized":"2024-09-10T10:59:58.198095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.937110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54954,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":73,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154209+0000","last_change":"2024-09-10T10:59:31.125741+0000","last_active":"2024-09-10T10:59:40.154209+0000","last_peered":"2024-09-10T10:59:40.154209+0000","last_clean":"2024-09-10T10:59:40.154209+0000","last_became_active":"2024-09-10T10:59:31.125369+0000","last_became_peered":"2024-09-10T10:59:31.125369+0000","last_unstale":"2024-09-10T10:59:40.154209+0000","last_undegraded":"2024-09-10T10:59:40.154209+0000","last_fullsized":"2024-09-10T10:59:40.154209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:26.873331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.168438+0000","last_change":"2024-09-10T10:59:28.975326+0000","last_active":"2024-09-10T10:59:41.168438+0000","last_peered":"2024-09-10T10:59:41.168438+0000","last_clean":"2024-09-10T10:59:41.168438+0000","last_became_active":"2024-09-10T10:59:28.975004+0000","last_became_peered":"2024-09-10T10:59:28.975004+0000","last_unstale":"2024-09-10T10:59:41.168438+0000","last_undegraded":"2024-09-10T10:59:41.168438+0000","last_fullsized":"2024-09-10T10:59:41.168438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:11.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153138+0000","last_change":"2024-09-10T10:59:31.125916+0000","last_active":"2024-09-10T10:59:40.153138+0000","last_peered":"2024-09-10T10:59:40.153138+0000","last_clean":"2024-09-10T10:59:40.153138+0000","last_became_active":"2024-09-10T10:59:31.125591+0000","last_became_peered":"2024-09-10T10:59:31.125591+0000","last_unstale":"2024-09-10T10:59:40.153138+0000","last_undegraded":"2024-09-10T10:59:40.153138+0000","last_fullsized":"2024-09-10T10:59:40.153138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:19.512266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211706+0000","last_change":"2024-09-10T10:59:28.980967+0000","last_active":"2024-09-10T10:59:40.211706+0000","last_peered":"2024-09-10T10:59:40.211706+0000","last_clean":"2024-09-10T10:59:40.211706+0000","last_became_active":"2024-09-10T10:59:28.980176+0000","last_became_peered":"2024-09-10T10:59:28.980176+0000","last_unstale":"2024-09-10T10:59:40.211706+0000","last_undegraded":"2024-09-10T10:59:40.211706+0000","last_fullsized":"2024-09-10T10:59:40.211706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:56.327936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152737+0000","last_change":"2024-09-10T10:59:31.127819+0000","last_active":"2024-09-10T10:59:40.152737+0000","last_peered":"2024-09-10T10:59:40.152737+0000","last_clean":"2024-09-10T10:59:40.152737+0000","last_became_active":"2024-09-10T10:59:31.127503+0000","last_became_peered":"2024-09-10T10:59:31.127503+0000","last_unstale":"2024-09-10T10:59:40.152737+0000","last_undegraded":"2024-09-10T10:59:40.152737+0000","last_fullsized":"2024-09-10T10:59:40.152737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:17.014121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:57.196802+0000","last_change":"2024-09-10T10:59:28.980881+0000","last_active":"2024-09-10T10:59:57.196802+0000","last_peered":"2024-09-10T10:59:57.196802+0000","last_clean":"2024-09-10T10:59:57.196802+0000","last_became_active":"2024-09-10T10:59:28.980452+0000","last_became_peered":"2024-09-10T10:59:28.980452+0000","last_unstale":"2024-09-10T10:59:57.196802+0000","last_undegraded":"2024-09-10T10:59:57.196802+0000","last_fullsized":"2024-09-10T10:59:57.196802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:00.373348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152392+0000","last_change":"2024-09-10T10:59:31.120463+0000","last_active":"2024-09-10T10:59:40.152392+0000","last_peered":"2024-09-10T10:59:40.152392+0000","last_clean":"2024-09-10T10:59:40.152392+0000","last_became_active":"2024-09-10T10:59:31.120122+0000","last_became_peered":"2024-09-10T10:59:31.120122+0000","last_unstale":"2024-09-10T10:59:40.152392+0000","last_undegraded":"2024-09-10T10:59:40.152392+0000","last_fullsized":"2024-09-10T10:59:40.152392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:37.425553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170329+0000","last_change":"2024-09-10T10:59:29.230592+0000","last_active":"2024-09-10T10:59:41.170329+0000","last_peered":"2024-09-10T10:59:41.170329+0000","last_clean":"2024-09-10T10:59:41.170329+0000","last_became_active":"2024-09-10T10:59:29.230205+0000","last_became_peered":"2024-09-10T10:59:29.230205+0000","last_unstale":"2024-09-10T10:59:41.170329+0000","last_undegraded":"2024-09-10T10:59:41.170329+0000","last_fullsized":"2024-09-10T10:59:41.170329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:00.671805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211929+0000","last_change":"2024-09-10T10:59:31.132506+0000","last_active":"2024-09-10T10:59:40.211929+0000","last_peered":"2024-09-10T10:59:40.211929+0000","last_clean":"2024-09-10T10:59:40.211929+0000","last_became_active":"2024-09-10T10:59:31.132038+0000","last_became_peered":"2024-09-10T10:59:31.132038+0000","last_unstale":"2024-09-10T10:59:40.211929+0000","last_undegraded":"2024-09-10T10:59:40.211929+0000","last_fullsized":"2024-09-10T10:59:40.211929+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:09.872032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:42.164709+0000","last_change":"2024-09-10T10:59:28.976756+0000","last_active":"2024-09-10T10:59:42.164709+0000","last_peered":"2024-09-10T10:59:42.164709+0000","last_clean":"2024-09-10T10:59:42.164709+0000","last_became_active":"2024-09-10T10:59:28.976429+0000","last_became_peered":"2024-09-10T10:59:28.976429+0000","last_unstale":"2024-09-10T10:59:42.164709+0000","last_undegraded":"2024-09-10T10:59:42.164709+0000","last_fullsized":"2024-09-10T10:59:42.164709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:41.679474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155401+0000","last_change":"2024-09-10T10:59:31.135768+0000","last_active":"2024-09-10T10:59:40.155401+0000","last_peered":"2024-09-10T10:59:40.155401+0000","last_clean":"2024-09-10T10:59:40.155401+0000","last_became_active":"2024-09-10T10:59:31.135420+0000","last_became_peered":"2024-09-10T10:59:31.135420+0000","last_unstale":"2024-09-10T10:59:40.155401+0000","last_undegraded":"2024-09-10T10:59:40.155401+0000","last_fullsized":"2024-09-10T10:59:40.155401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:02.983500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153716+0000","last_change":"2024-09-10T10:59:28.972185+0000","last_active":"2024-09-10T10:59:40.153716+0000","last_peered":"2024-09-10T10:59:40.153716+0000","last_clean":"2024-09-10T10:59:40.153716+0000","last_became_active":"2024-09-10T10:59:28.971813+0000","last_became_peered":"2024-09-10T10:59:28.971813+0000","last_unstale":"2024-09-10T10:59:40.153716+0000","last_undegraded":"2024-09-10T10:59:40.153716+0000","last_fullsized":"2024-09-10T10:59:40.153716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:53.612465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152705+0000","last_change":"2024-09-10T10:59:31.130197+0000","last_active":"2024-09-10T10:59:40.152705+0000","last_peered":"2024-09-10T10:59:40.152705+0000","last_clean":"2024-09-10T10:59:40.152705+0000","last_became_active":"2024-09-10T10:59:31.129596+0000","last_became_peered":"2024-09-10T10:59:31.129596+0000","last_unstale":"2024-09-10T10:59:40.152705+0000","last_undegraded":"2024-09-10T10:59:40.152705+0000","last_fullsized":"2024-09-10T10:59:40.152705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:23.962924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212176+0000","last_change":"2024-09-10T10:59:28.973990+0000","last_active":"2024-09-10T10:59:40.212176+0000","last_peered":"2024-09-10T10:59:40.212176+0000","last_clean":"2024-09-10T10:59:40.212176+0000","last_became_active":"2024-09-10T10:59:28.973647+0000","last_became_peered":"2024-09-10T10:59:28.973647+0000","last_unstale":"2024-09-10T10:59:40.212176+0000","last_undegraded":"2024-09-10T10:59:40.212176+0000","last_fullsized":"2024-09-10T10:59:40.212176+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:25.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153427+0000","last_change":"2024-09-10T10:59:31.135603+0000","last_active":"2024-09-10T10:59:40.153427+0000","last_peered":"2024-09-10T10:59:40.153427+0000","last_clean":"2024-09-10T10:59:40.153427+0000","last_became_active":"2024-09-10T10:59:31.135208+0000","last_became_peered":"2024-09-10T10:59:31.135208+0000","last_unstale":"2024-09-10T10:59:40.153427+0000","last_undegraded":"2024-09-10T10:59:40.153427+0000","last_fullsized":"2024-09-10T10:59:40.153427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:50.578770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.476974+0000","last_change":"2024-09-10T10:59:40.212180+0000","last_active":"2024-09-10T10:59:41.476974+0000","last_peered":"2024-09-10T10:59:41.476974+0000","last_clean":"2024-09-10T10:59:41.476974+0000","last_became_active":"2024-09-10T10:59:40.211860+0000","last_became_peered":"2024-09-10T10:59:40.211860+0000","last_unstale":"2024-09-10T10:59:41.476974+0000","last_undegraded":"2024-09-10T10:59:41.476974+0000","last_fullsized":"2024-09-10T10:59:41.476974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:09.718612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153216+0000","last_change":"2024-09-10T10:59:31.126162+0000","last_active":"2024-09-10T10:59:40.153216+0000","last_peered":"2024-09-10T10:59:40.153216+0000","last_clean":"2024-09-10T10:59:40.153216+0000","last_became_active":"2024-09-10T10:59:31.125661+0000","last_became_peered":"2024-09-10T10:59:31.125661+0000","last_unstale":"2024-09-10T10:59:40.153216+0000","last_undegraded":"2024-09-10T10:59:40.153216+0000","last_fullsized":"2024-09-10T10:59:40.153216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:36.677732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152671+0000","last_change":"2024-09-10T10:58:17.630377+0000","last_active":"2024-09-10T10:59:40.152671+0000","last_peered":"2024-09-10T10:59:40.152671+0000","last_clean":"2024-09-10T10:59:40.152671+0000","last_became_active":"2024-09-10T10:58:17.629956+0000","last_became_peered":"2024-09-10T10:58:17.629956+0000","last_unstale":"2024-09-10T10:59:40.152671+0000","last_undegraded":"2024-09-10T10:59:40.152671+0000","last_fullsized":"2024-09-10T10:59:40.152671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:54:53.218596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:54:53.218596+0000","last_clean_scrub_stamp":"2024-09-10T10:54:53.218596+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:44.005115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:42.170755+0000","last_change":"2024-09-10T10:59:28.975307+0000","last_active":"2024-09-10T10:59:42.170755+0000","last_peered":"2024-09-10T10:59:42.170755+0000","last_clean":"2024-09-10T10:59:42.170755+0000","last_became_active":"2024-09-10T10:59:28.974959+0000","last_became_peered":"2024-09-10T10:59:28.974959+0000","last_unstale":"2024-09-10T10:59:42.170755+0000","last_undegraded":"2024-09-10T10:59:42.170755+0000","last_fullsized":"2024-09-10T10:59:42.170755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:59.923354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157346+0000","last_change":"2024-09-10T10:59:31.124267+0000","last_active":"2024-09-10T10:59:40.157346+0000","last_peered":"2024-09-10T10:59:40.157346+0000","last_clean":"2024-09-10T10:59:40.157346+0000","last_became_active":"2024-09-10T10:59:31.123894+0000","last_became_peered":"2024-09-10T10:59:31.123894+0000","last_unstale":"2024-09-10T10:59:40.157346+0000","last_undegraded":"2024-09-10T10:59:40.157346+0000","last_fullsized":"2024-09-10T10:59:40.157346+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:54.657970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.169251+0000","last_change":"2024-09-10T10:59:28.977213+0000","last_active":"2024-09-10T10:59:41.169251+0000","last_peered":"2024-09-10T10:59:41.169251+0000","last_clean":"2024-09-10T10:59:41.169251+0000","last_became_active":"2024-09-10T10:59:28.976909+0000","last_became_peered":"2024-09-10T10:59:28.976909+0000","last_unstale":"2024-09-10T10:59:41.169251+0000","last_undegraded":"2024-09-10T10:59:41.169251+0000","last_fullsized":"2024-09-10T10:59:41.169251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:24.640147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152773+0000","last_change":"2024-09-10T10:59:31.129703+0000","last_active":"2024-09-10T10:59:40.152773+0000","last_peered":"2024-09-10T10:59:40.152773+0000","last_clean":"2024-09-10T10:59:40.152773+0000","last_became_active":"2024-09-10T10:59:31.129401+0000","last_became_peered":"2024-09-10T10:59:31.129401+0000","last_unstale":"2024-09-10T10:59:40.152773+0000","last_undegraded":"2024-09-10T10:59:40.152773+0000","last_fullsized":"2024-09-10T10:59:40.152773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:37.431852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:57.196287+0000","last_change":"2024-09-10T10:59:29.230556+0000","last_active":"2024-09-10T10:59:57.196287+0000","last_peered":"2024-09-10T10:59:57.196287+0000","last_clean":"2024-09-10T10:59:57.196287+0000","last_became_active":"2024-09-10T10:59:29.230129+0000","last_became_peered":"2024-09-10T10:59:29.230129+0000","last_unstale":"2024-09-10T10:59:57.196287+0000","last_undegraded":"2024-09-10T10:59:57.196287+0000","last_fullsized":"2024-09-10T10:59:57.196287+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:31.903008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211592+0000","last_change":"2024-09-10T10:59:31.131687+0000","last_active":"2024-09-10T10:59:40.211592+0000","last_peered":"2024-09-10T10:59:40.211592+0000","last_clean":"2024-09-10T10:59:40.211592+0000","last_became_active":"2024-09-10T10:59:31.131373+0000","last_became_peered":"2024-09-10T10:59:31.131373+0000","last_unstale":"2024-09-10T10:59:40.211592+0000","last_undegraded":"2024-09-10T10:59:40.211592+0000","last_fullsized":"2024-09-10T10:59:40.211592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:03.923639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152936+0000","last_change":"2024-09-10T10:59:28.977557+0000","last_active":"2024-09-10T10:59:40.152936+0000","last_peered":"2024-09-10T10:59:40.152936+0000","last_clean":"2024-09-10T10:59:40.152936+0000","last_became_active":"2024-09-10T10:59:28.977203+0000","last_became_peered":"2024-09-10T10:59:28.977203+0000","last_unstale":"2024-09-10T10:59:40.152936+0000","last_undegraded":"2024-09-10T10:59:40.152936+0000","last_fullsized":"2024-09-10T10:59:40.152936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:25:29.880758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153759+0000","last_change":"2024-09-10T10:59:31.123998+0000","last_active":"2024-09-10T10:59:40.153759+0000","last_peered":"2024-09-10T10:59:40.153759+0000","last_clean":"2024-09-10T10:59:40.153759+0000","last_became_active":"2024-09-10T10:59:31.123645+0000","last_became_peered":"2024-09-10T10:59:31.123645+0000","last_unstale":"2024-09-10T10:59:40.153759+0000","last_undegraded":"2024-09-10T10:59:40.153759+0000","last_fullsized":"2024-09-10T10:59:40.153759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:47.607733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152223+0000","last_change":"2024-09-10T10:59:29.231291+0000","last_active":"2024-09-10T10:59:40.152223+0000","last_peered":"2024-09-10T10:59:40.152223+0000","last_clean":"2024-09-10T10:59:40.152223+0000","last_became_active":"2024-09-10T10:59:29.230946+0000","last_became_peered":"2024-09-10T10:59:29.230946+0000","last_unstale":"2024-09-10T10:59:40.152223+0000","last_undegraded":"2024-09-10T10:59:40.152223+0000","last_fullsized":"2024-09-10T10:59:40.152223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:55.268743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153274+0000","last_change":"2024-09-10T10:59:31.122359+0000","last_active":"2024-09-10T10:59:40.153274+0000","last_peered":"2024-09-10T10:59:40.153274+0000","last_clean":"2024-09-10T10:59:40.153274+0000","last_became_active":"2024-09-10T10:59:31.120741+0000","last_became_peered":"2024-09-10T10:59:31.120741+0000","last_unstale":"2024-09-10T10:59:40.153274+0000","last_undegraded":"2024-09-10T10:59:40.153274+0000","last_fullsized":"2024-09-10T10:59:40.153274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:02.827031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154484+0000","last_change":"2024-09-10T10:59:29.231008+0000","last_active":"2024-09-10T10:59:40.154484+0000","last_peered":"2024-09-10T10:59:40.154484+0000","last_clean":"2024-09-10T10:59:40.154484+0000","last_became_active":"2024-09-10T10:59:29.230638+0000","last_became_peered":"2024-09-10T10:59:29.230638+0000","last_unstale":"2024-09-10T10:59:40.154484+0000","last_undegraded":"2024-09-10T10:59:40.154484+0000","last_fullsized":"2024-09-10T10:59:40.154484+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.358831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153600+0000","last_change":"2024-09-10T10:59:31.129049+0000","last_active":"2024-09-10T10:59:40.153600+0000","last_peered":"2024-09-10T10:59:40.153600+0000","last_clean":"2024-09-10T10:59:40.153600+0000","last_became_active":"2024-09-10T10:59:31.128746+0000","last_became_peered":"2024-09-10T10:59:31.128746+0000","last_unstale":"2024-09-10T10:59:40.153600+0000","last_undegraded":"2024-09-10T10:59:40.153600+0000","last_fullsized":"2024-09-10T10:59:40.153600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:25.719609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:56.119318+0000","last_change":"2024-09-10T10:59:28.973043+0000","last_active":"2024-09-10T10:59:56.119318+0000","last_peered":"2024-09-10T10:59:56.119318+0000","last_clean":"2024-09-10T10:59:56.119318+0000","last_became_active":"2024-09-10T10:59:28.972633+0000","last_became_peered":"2024-09-10T10:59:28.972633+0000","last_unstale":"2024-09-10T10:59:56.119318+0000","last_undegraded":"2024-09-10T10:59:56.119318+0000","last_fullsized":"2024-09-10T10:59:56.119318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:51.858279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158104+0000","last_change":"2024-09-10T10:59:31.124663+0000","last_active":"2024-09-10T10:59:40.158104+0000","last_peered":"2024-09-10T10:59:40.158104+0000","last_clean":"2024-09-10T10:59:40.158104+0000","last_became_active":"2024-09-10T10:59:31.124312+0000","last_became_peered":"2024-09-10T10:59:31.124312+0000","last_unstale":"2024-09-10T10:59:40.158104+0000","last_undegraded":"2024-09-10T10:59:40.158104+0000","last_fullsized":"2024-09-10T10:59:40.158104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:03.530208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.180952+0000","last_change":"2024-09-10T10:59:29.461846+0000","last_active":"2024-09-10T10:59:40.180952+0000","last_peered":"2024-09-10T10:59:40.180952+0000","last_clean":"2024-09-10T10:59:40.180952+0000","last_became_active":"2024-09-10T10:59:29.461485+0000","last_became_peered":"2024-09-10T10:59:29.461485+0000","last_unstale":"2024-09-10T10:59:40.180952+0000","last_undegraded":"2024-09-10T10:59:40.180952+0000","last_fullsized":"2024-09-10T10:59:40.180952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:28.071947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211184+0000","last_change":"2024-09-10T10:59:31.122234+0000","last_active":"2024-09-10T10:59:40.211184+0000","last_peered":"2024-09-10T10:59:40.211184+0000","last_clean":"2024-09-10T10:59:40.211184+0000","last_became_active":"2024-09-10T10:59:31.121909+0000","last_became_peered":"2024-09-10T10:59:31.121909+0000","last_unstale":"2024-09-10T10:59:40.211184+0000","last_undegraded":"2024-09-10T10:59:40.211184+0000","last_fullsized":"2024-09-10T10:59:40.211184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:37.263257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150552+0000","last_change":"2024-09-10T10:59:29.230543+0000","last_active":"2024-09-10T10:59:40.150552+0000","last_peered":"2024-09-10T10:59:40.150552+0000","last_clean":"2024-09-10T10:59:40.150552+0000","last_became_active":"2024-09-10T10:59:29.230256+0000","last_became_peered":"2024-09-10T10:59:29.230256+0000","last_unstale":"2024-09-10T10:59:40.150552+0000","last_undegraded":"2024-09-10T10:59:40.150552+0000","last_fullsized":"2024-09-10T10:59:40.150552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:05.336402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153044+0000","last_change":"2024-09-10T10:59:31.121898+0000","last_active":"2024-09-10T10:59:40.153044+0000","last_peered":"2024-09-10T10:59:40.153044+0000","last_clean":"2024-09-10T10:59:40.153044+0000","last_became_active":"2024-09-10T10:59:31.121478+0000","last_became_peered":"2024-09-10T10:59:31.121478+0000","last_unstale":"2024-09-10T10:59:40.153044+0000","last_undegraded":"2024-09-10T10:59:40.153044+0000","last_fullsized":"2024-09-10T10:59:40.153044+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:01.805762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157141+0000","last_change":"2024-09-10T10:59:28.974086+0000","last_active":"2024-09-10T10:59:40.157141+0000","last_peered":"2024-09-10T10:59:40.157141+0000","last_clean":"2024-09-10T10:59:40.157141+0000","last_became_active":"2024-09-10T10:59:28.973801+0000","last_became_peered":"2024-09-10T10:59:28.973801+0000","last_unstale":"2024-09-10T10:59:40.157141+0000","last_undegraded":"2024-09-10T10:59:40.157141+0000","last_fullsized":"2024-09-10T10:59:40.157141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:10.338340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155611+0000","last_change":"2024-09-10T10:59:31.130301+0000","last_active":"2024-09-10T10:59:40.155611+0000","last_peered":"2024-09-10T10:59:40.155611+0000","last_clean":"2024-09-10T10:59:40.155611+0000","last_became_active":"2024-09-10T10:59:31.129959+0000","last_became_peered":"2024-09-10T10:59:31.129959+0000","last_unstale":"2024-09-10T10:59:40.155611+0000","last_undegraded":"2024-09-10T10:59:40.155611+0000","last_fullsized":"2024-09-10T10:59:40.155611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:32.131310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152650+0000","last_change":"2024-09-10T10:59:28.976683+0000","last_active":"2024-09-10T10:59:40.152650+0000","last_peered":"2024-09-10T10:59:40.152650+0000","last_clean":"2024-09-10T10:59:40.152650+0000","last_became_active":"2024-09-10T10:59:28.976278+0000","last_became_peered":"2024-09-10T10:59:28.976278+0000","last_unstale":"2024-09-10T10:59:40.152650+0000","last_undegraded":"2024-09-10T10:59:40.152650+0000","last_fullsized":"2024-09-10T10:59:40.152650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:49.100274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157441+0000","last_change":"2024-09-10T10:59:31.118400+0000","last_active":"2024-09-10T10:59:40.157441+0000","last_peered":"2024-09-10T10:59:40.157441+0000","last_clean":"2024-09-10T10:59:40.157441+0000","last_became_active":"2024-09-10T10:59:31.118067+0000","last_became_peered":"2024-09-10T10:59:31.118067+0000","last_unstale":"2024-09-10T10:59:40.157441+0000","last_undegraded":"2024-09-10T10:59:40.157441+0000","last_fullsized":"2024-09-10T10:59:40.157441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:03.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.162110+0000","last_change":"2024-09-10T10:59:40.161592+0000","last_active":"2024-09-10T10:59:40.162110+0000","last_peered":"2024-09-10T10:59:40.162110+0000","last_clean":"2024-09-10T10:59:40.162110+0000","last_became_active":"2024-09-10T10:59:40.156968+0000","last_became_peered":"2024-09-10T10:59:40.156968+0000","last_unstale":"2024-09-10T10:59:40.162110+0000","last_undegraded":"2024-09-10T10:59:40.162110+0000","last_fullsized":"2024-09-10T10:59:40.162110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:20.107251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152634+0000","last_change":"2024-09-10T10:59:31.132779+0000","last_active":"2024-09-10T10:59:40.152634+0000","last_peered":"2024-09-10T10:59:40.152634+0000","last_clean":"2024-09-10T10:59:40.152634+0000","last_became_active":"2024-09-10T10:59:31.132417+0000","last_became_peered":"2024-09-10T10:59:31.132417+0000","last_unstale":"2024-09-10T10:59:40.152634+0000","last_undegraded":"2024-09-10T10:59:40.152634+0000","last_fullsized":"2024-09-10T10:59:40.152634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:47.640774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211900+0000","last_change":"2024-09-10T10:59:31.133370+0000","last_active":"2024-09-10T10:59:40.211900+0000","last_peered":"2024-09-10T10:59:40.211900+0000","last_clean":"2024-09-10T10:59:40.211900+0000","last_became_active":"2024-09-10T10:59:31.133027+0000","last_became_peered":"2024-09-10T10:59:31.133027+0000","last_unstale":"2024-09-10T10:59:40.211900+0000","last_undegraded":"2024-09-10T10:59:40.211900+0000","last_fullsized":"2024-09-10T10:59:40.211900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:24.550987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154242+0000","last_change":"2024-09-10T10:59:28.973416+0000","last_active":"2024-09-10T10:59:40.154242+0000","last_peered":"2024-09-10T10:59:40.154242+0000","last_clean":"2024-09-10T10:59:40.154242+0000","last_became_active":"2024-09-10T10:59:28.973050+0000","last_became_peered":"2024-09-10T10:59:28.973050+0000","last_unstale":"2024-09-10T10:59:40.154242+0000","last_undegraded":"2024-09-10T10:59:40.154242+0000","last_fullsized":"2024-09-10T10:59:40.154242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:00.013173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150537+0000","last_change":"2024-09-10T10:59:31.132568+0000","last_active":"2024-09-10T10:59:40.150537+0000","last_peered":"2024-09-10T10:59:40.150537+0000","last_clean":"2024-09-10T10:59:40.150537+0000","last_became_active":"2024-09-10T10:59:31.132260+0000","last_became_peered":"2024-09-10T10:59:31.132260+0000","last_unstale":"2024-09-10T10:59:40.150537+0000","last_undegraded":"2024-09-10T10:59:40.150537+0000","last_fullsized":"2024-09-10T10:59:40.150537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:14.420293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.169008+0000","last_change":"2024-09-10T10:59:28.981404+0000","last_active":"2024-09-10T10:59:41.169008+0000","last_peered":"2024-09-10T10:59:41.169008+0000","last_clean":"2024-09-10T10:59:41.169008+0000","last_became_active":"2024-09-10T10:59:28.981066+0000","last_became_peered":"2024-09-10T10:59:28.981066+0000","last_unstale":"2024-09-10T10:59:41.169008+0000","last_undegraded":"2024-09-10T10:59:41.169008+0000","last_fullsized":"2024-09-10T10:59:41.169008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:16.075280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211311+0000","last_change":"2024-09-10T10:59:31.133696+0000","last_active":"2024-09-10T10:59:40.211311+0000","last_peered":"2024-09-10T10:59:40.211311+0000","last_clean":"2024-09-10T10:59:40.211311+0000","last_became_active":"2024-09-10T10:59:31.132978+0000","last_became_peered":"2024-09-10T10:59:31.132978+0000","last_unstale":"2024-09-10T10:59:40.211311+0000","last_undegraded":"2024-09-10T10:59:40.211311+0000","last_fullsized":"2024-09-10T10:59:40.211311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:37.273524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158089+0000","last_change":"2024-09-10T10:59:29.230472+0000","last_active":"2024-09-10T10:59:40.158089+0000","last_peered":"2024-09-10T10:59:40.158089+0000","last_clean":"2024-09-10T10:59:40.158089+0000","last_became_active":"2024-09-10T10:59:29.230128+0000","last_became_peered":"2024-09-10T10:59:29.230128+0000","last_unstale":"2024-09-10T10:59:40.158089+0000","last_undegraded":"2024-09-10T10:59:40.158089+0000","last_fullsized":"2024-09-10T10:59:40.158089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:26.116922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157847+0000","last_change":"2024-09-10T10:59:31.132406+0000","last_active":"2024-09-10T10:59:40.157847+0000","last_peered":"2024-09-10T10:59:40.157847+0000","last_clean":"2024-09-10T10:59:40.157847+0000","last_became_active":"2024-09-10T10:59:31.132088+0000","last_became_peered":"2024-09-10T10:59:31.132088+0000","last_unstale":"2024-09-10T10:59:40.157847+0000","last_undegraded":"2024-09-10T10:59:40.157847+0000","last_fullsized":"2024-09-10T10:59:40.157847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:47.222192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170194+0000","last_change":"2024-09-10T10:59:28.978103+0000","last_active":"2024-09-10T10:59:41.170194+0000","last_peered":"2024-09-10T10:59:41.170194+0000","last_clean":"2024-09-10T10:59:41.170194+0000","last_became_active":"2024-09-10T10:59:28.977918+0000","last_became_peered":"2024-09-10T10:59:28.977918+0000","last_unstale":"2024-09-10T10:59:41.170194+0000","last_undegraded":"2024-09-10T10:59:41.170194+0000","last_fullsized":"2024-09-10T10:59:41.170194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.157534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59350,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":158,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":178050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":212318,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":438088,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":1084916,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438324,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168610,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438244,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030569,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561068,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":437713,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790001,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":1029860,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":438543,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438024,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":493621,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":484890,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":438984,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34293,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34293,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":55536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":56115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:59:59.546 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T10:59:59.547 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T10:59:59.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T10:59:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 -- 172.21.15.59:0/3734814188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc101c00 msgr2=0x7f20dc102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 --2- 172.21.15.59:0/3734814188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc101c00 0x7f20dc102000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009900 tx=0x7f20d002a3f0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 -- 172.21.15.59:0/3734814188 shutdown_connections 2024-09-10T11:00:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 --2- 172.21.15.59:0/3734814188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20dc1037c0 0x7f20dc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 --2- 172.21.15.59:0/3734814188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20dc102e00 0x7f20dc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 --2- 172.21.15.59:0/3734814188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc101c00 0x7f20dc102000 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 -- 172.21.15.59:0/3734814188 >> 172.21.15.59:0/3734814188 conn(0x7f20dc0fd390 msgr2=0x7f20dc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 -- 172.21.15.59:0/3734814188 shutdown_connections 2024-09-10T11:00:00.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 -- 172.21.15.59:0/3734814188 wait complete. 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.327+0000 7f20e2f38640 1 Processor -- start 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e2f38640 1 -- start start 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e2f38640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20dc101c00 0x7f20dc197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e2f38640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20dc102e00 0x7f20dc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e2f38640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc1037c0 0x7f20dc19f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e2f38640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10d860 con 0x7f20dc1037c0 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e2f38640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10d6e0 con 0x7f20dc101c00 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e2f38640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10d9e0 con 0x7f20dc102e00 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e14d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc1037c0 0x7f20dc19f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e14d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc1037c0 0x7f20dc19f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44522/0 (socket says 172.21.15.59:44522) 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e14d5640 1 -- 172.21.15.59:0/1182539492 learned_addr learned my addr 172.21.15.59:0/1182539492 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:00.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20dbfff640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20dc102e00 0x7f20dc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e0cd4640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20dc101c00 0x7f20dc197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e14d5640 1 -- 172.21.15.59:0/1182539492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20dc102e00 msgr2=0x7f20dc198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e14d5640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20dc102e00 0x7f20dc198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e14d5640 1 -- 172.21.15.59:0/1182539492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20dc101c00 msgr2=0x7f20dc197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e14d5640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20dc101c00 0x7f20dc197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e14d5640 1 -- 172.21.15.59:0/1182539492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc19fa50 con 0x7f20dc1037c0 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e0cd4640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20dc101c00 0x7f20dc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20dbfff640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20dc102e00 0x7f20dc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.328+0000 7f20e14d5640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc1037c0 0x7f20dc19f3e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f20d400cce0 tx=0x7f20d400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.329+0000 7f20d9ffb640 1 -- 172.21.15.59:0/1182539492 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d400f450 con 0x7f20dc1037c0 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.329+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc19fd40 con 0x7f20dc1037c0 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.329+0000 7f20d9ffb640 1 -- 172.21.15.59:0/1182539492 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d400fad0 con 0x7f20dc1037c0 2024-09-10T11:00:00.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.329+0000 7f20d9ffb640 1 -- 172.21.15.59:0/1182539492 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d4018c10 con 0x7f20dc1037c0 2024-09-10T11:00:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.329+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc1a0220 con 0x7f20dc1037c0 2024-09-10T11:00:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.330+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc108f30 con 0x7f20dc1037c0 2024-09-10T11:00:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.331+0000 7f20d9ffb640 1 -- 172.21.15.59:0/1182539492 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f20d400f5f0 con 0x7f20dc1037c0 2024-09-10T11:00:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.331+0000 7f20d9ffb640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20cc0a2c40 0x7f20cc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.332+0000 7f20e0cd4640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20cc0a2c40 0x7f20cc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.332+0000 7f20d9ffb640 1 -- 172.21.15.59:0/1182539492 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f20d40cf990 con 0x7f20dc1037c0 2024-09-10T11:00:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.332+0000 7f20e0cd4640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20cc0a2c40 0x7f20cc0a5100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f20d0000c00 tx=0x7f20d0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:00.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.336+0000 7f20d9ffb640 1 -- 172.21.15.59:0/1182539492 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20d4014030 con 0x7f20dc1037c0 2024-09-10T11:00:00.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.579+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f20dc062e90 con 0x7f20dc1037c0 2024-09-10T11:00:00.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.582+0000 7f20d9ffb640 1 -- 172.21.15.59:0/1182539492 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f20d409c710 con 0x7f20dc1037c0 2024-09-10T11:00:00.583 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-09-10T11:00:00.584 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCwJuBmi8SsIhAATb7BMZu3PfLINRCxzUrRUQ== 2024-09-10T11:00:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20cc0a2c40 msgr2=0x7f20cc0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20cc0a2c40 0x7f20cc0a5100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f20d0000c00 tx=0x7f20d0031400 comp rx=0 tx=0).stop 2024-09-10T11:00:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc1037c0 msgr2=0x7f20dc19f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc1037c0 0x7f20dc19f3e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f20d400cce0 tx=0x7f20d400a620 comp rx=0 tx=0).stop 2024-09-10T11:00:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 shutdown_connections 2024-09-10T11:00:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f20cc0a2c40 0x7f20cc0a5100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20dc1037c0 0x7f20dc19f3e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f20dc102e00 0x7f20dc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 --2- 172.21.15.59:0/1182539492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20dc101c00 0x7f20dc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 >> 172.21.15.59:0/1182539492 conn(0x7f20dc0fd390 msgr2=0x7f20dc106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 shutdown_connections 2024-09-10T11:00:00.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:00.584+0000 7f20e2f38640 1 -- 172.21.15.59:0/1182539492 wait complete. 2024-09-10T11:00:00.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:00 smithi181 ceph-mon[35409]: pgmap v293: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-10T11:00:00.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:00 smithi181 ceph-mon[35409]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:00:00.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:00 smithi181 ceph-mon[35409]: overall HEALTH_OK 2024-09-10T11:00:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:00 smithi059 ceph-mon[30978]: pgmap v293: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-10T11:00:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:00 smithi059 ceph-mon[30978]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:00:00.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:00 smithi059 ceph-mon[30978]: overall HEALTH_OK 2024-09-10T11:00:00.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:00 smithi115 ceph-mon[34719]: pgmap v293: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-10T11:00:00.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:00 smithi115 ceph-mon[34719]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:00:00.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:00 smithi115 ceph-mon[34719]: overall HEALTH_OK 2024-09-10T11:00:01.304 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T11:00:01.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T11:00:01.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T11:00:01.344 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T11:00:01.344 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T11:00:01.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T11:00:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:01.817 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:01 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1182539492' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T11:00:01.817 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:01 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1182539492' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T11:00:01.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:01 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1182539492' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T11:00:01.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:01 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1182539492' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T11:00:01.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:01 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1182539492' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T11:00:01.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:01 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1182539492' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T11:00:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.142+0000 7f2d12719640 1 -- 172.21.15.59:0/1843761978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c102790 msgr2=0x7f2d0c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.142+0000 7f2d12719640 1 --2- 172.21.15.59:0/1843761978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c102790 0x7f2d0c1067e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009900 tx=0x7f2d0002a410 comp rx=0 tx=0).stop 2024-09-10T11:00:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.142+0000 7f2d12719640 1 -- 172.21.15.59:0/1843761978 shutdown_connections 2024-09-10T11:00:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.142+0000 7f2d12719640 1 --2- 172.21.15.59:0/1843761978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d0c106f10 0x7f2d0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.142+0000 7f2d12719640 1 --2- 172.21.15.59:0/1843761978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c102790 0x7f2d0c1067e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.142+0000 7f2d12719640 1 --2- 172.21.15.59:0/1843761978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c101de0 0x7f2d0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:02.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.142+0000 7f2d12719640 1 -- 172.21.15.59:0/1843761978 >> 172.21.15.59:0/1843761978 conn(0x7f2d0c0fd8c0 msgr2=0x7f2d0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.142+0000 7f2d12719640 1 -- 172.21.15.59:0/1843761978 shutdown_connections 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.142+0000 7f2d12719640 1 -- 172.21.15.59:0/1843761978 wait complete. 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.143+0000 7f2d12719640 1 Processor -- start 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.143+0000 7f2d12719640 1 -- start start 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d12719640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c101de0 0x7f2d0c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d12719640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d0c102790 0x7f2d0c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d12719640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c106f10 0x7f2d0c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d12719640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c111f30 con 0x7f2d0c106f10 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d12719640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c111db0 con 0x7f2d0c101de0 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d12719640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c1120b0 con 0x7f2d0c102790 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d10cb6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c106f10 0x7f2d0c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d10cb6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c106f10 0x7f2d0c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44544/0 (socket says 172.21.15.59:44544) 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d10cb6640 1 -- 172.21.15.59:0/1893196986 learned_addr learned my addr 172.21.15.59:0/1893196986 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:02.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d0b7fe640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d0c102790 0x7f2d0c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d0bfff640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c101de0 0x7f2d0c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d10cb6640 1 -- 172.21.15.59:0/1893196986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d0c102790 msgr2=0x7f2d0c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d10cb6640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d0c102790 0x7f2d0c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d10cb6640 1 -- 172.21.15.59:0/1893196986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c101de0 msgr2=0x7f2d0c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d10cb6640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c101de0 0x7f2d0c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d10cb6640 1 -- 172.21.15.59:0/1893196986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c19d3c0 con 0x7f2d0c106f10 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d0bfff640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c101de0 0x7f2d0c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.144+0000 7f2d10cb6640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c106f10 0x7f2d0c19cce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400cad0 tx=0x7f2d0400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.145+0000 7f2d097fa640 1 -- 172.21.15.59:0/1893196986 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400ae20 con 0x7f2d0c106f10 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.145+0000 7f2d097fa640 1 -- 172.21.15.59:0/1893196986 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04005020 con 0x7f2d0c106f10 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.145+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0c19d6b0 con 0x7f2d0c106f10 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.145+0000 7f2d097fa640 1 -- 172.21.15.59:0/1893196986 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400f6f0 con 0x7f2d0c106f10 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.145+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0c1a4f90 con 0x7f2d0c106f10 2024-09-10T11:00:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.146+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d0c1021c0 con 0x7f2d0c106f10 2024-09-10T11:00:02.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.147+0000 7f2d097fa640 1 -- 172.21.15.59:0/1893196986 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2d040051d0 con 0x7f2d0c106f10 2024-09-10T11:00:02.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.148+0000 7f2d097fa640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2cf40a2c10 0x7f2cf40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:02.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.148+0000 7f2d0bfff640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2cf40a2c10 0x7f2cf40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:02.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.148+0000 7f2d097fa640 1 -- 172.21.15.59:0/1893196986 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f2d040cf5a0 con 0x7f2d0c106f10 2024-09-10T11:00:02.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.148+0000 7f2d0bfff640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2cf40a2c10 0x7f2cf40a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00baa0 tx=0x7f2cfc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:02.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.151+0000 7f2d097fa640 1 -- 172.21.15.59:0/1893196986 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d04014030 con 0x7f2d0c106f10 2024-09-10T11:00:02.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.375+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2d0c10a120 con 0x7f2d0c106f10 2024-09-10T11:00:02.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.380+0000 7f2d097fa640 1 -- 172.21.15.59:0/1893196986 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263200 (secure 0 0 0) 0x7f2d0409c380 con 0x7f2d0c106f10 2024-09-10T11:00:02.385 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2cf40a2c10 msgr2=0x7f2cf40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2cf40a2c10 0x7f2cf40a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00baa0 tx=0x7f2cfc005d90 comp rx=0 tx=0).stop 2024-09-10T11:00:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c106f10 msgr2=0x7f2d0c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c106f10 0x7f2d0c19cce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400cad0 tx=0x7f2d0400cf90 comp rx=0 tx=0).stop 2024-09-10T11:00:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 shutdown_connections 2024-09-10T11:00:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2cf40a2c10 0x7f2cf40a50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0c106f10 0x7f2d0c19cce0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d0c102790 0x7f2d0c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 --2- 172.21.15.59:0/1893196986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d0c101de0 0x7f2d0c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 >> 172.21.15.59:0/1893196986 conn(0x7f2d0c0fd8c0 msgr2=0x7f2d0c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 shutdown_connections 2024-09-10T11:00:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:02.384+0000 7f2d12719640 1 -- 172.21.15.59:0/1893196986 wait complete. 2024-09-10T11:00:02.840 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:02 smithi059 ceph-mon[30978]: pgmap v294: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-10T11:00:02.840 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:02 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1893196986' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T11:00:02.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:02 smithi181 ceph-mon[35409]: pgmap v294: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-10T11:00:02.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:02 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1893196986' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T11:00:02.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:02 smithi115 ceph-mon[34719]: pgmap v294: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-10T11:00:02.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:02 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1893196986' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T11:00:03.272 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":3145930564},{"type":"v1","addr":"172.21.15.59:6801","nonce":3145930564}]},"active_addr":"172.21.15.59:6801/3145930564","active_change":"2024-09-10T10:52:38.625697+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.59:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2665068071}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2362644310}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":626509906}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2735068879}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3521158887}]}]} 2024-09-10T11:00:03.279 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T11:00:03.279 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T11:00:03.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:00:03.538 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.041+0000 7fa78f10f640 1 -- 172.21.15.59:0/2394694366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788100a80 msgr2=0x7fa788100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.041+0000 7fa78f10f640 1 --2- 172.21.15.59:0/2394694366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788100a80 0x7fa788100ee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa778009cd0 tx=0x7fa77802a8e0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.041+0000 7fa78f10f640 1 -- 172.21.15.59:0/2394694366 shutdown_connections 2024-09-10T11:00:04.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.041+0000 7fa78f10f640 1 --2- 172.21.15.59:0/2394694366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa788101420 0x7fa78810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.041+0000 7fa78f10f640 1 --2- 172.21.15.59:0/2394694366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788100a80 0x7fa788100ee0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.041+0000 7fa78f10f640 1 --2- 172.21.15.59:0/2394694366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa788106a80 0x7fa788106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.041+0000 7fa78f10f640 1 -- 172.21.15.59:0/2394694366 >> 172.21.15.59:0/2394694366 conn(0x7fa7880fc7a0 msgr2=0x7fa7880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.041+0000 7fa78f10f640 1 -- 172.21.15.59:0/2394694366 shutdown_connections 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.041+0000 7fa78f10f640 1 -- 172.21.15.59:0/2394694366 wait complete. 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78f10f640 1 Processor -- start 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78f10f640 1 -- start start 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78f10f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa788100a80 0x7fa788198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78f10f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788101420 0x7fa7881989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78f10f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa788106a80 0x7fa78819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78f10f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa788110e40 con 0x7fa788101420 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78f10f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa788110cc0 con 0x7fa788106a80 2024-09-10T11:00:04.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78f10f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa788110fc0 con 0x7fa788100a80 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa787fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788101420 0x7fa7881989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa787fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788101420 0x7fa7881989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44558/0 (socket says 172.21.15.59:44558) 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa787fff640 1 -- 172.21.15.59:0/1006848100 learned_addr learned my addr 172.21.15.59:0/1006848100 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78ceab640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa788100a80 0x7fa788198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.042+0000 7fa78d6ac640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa788106a80 0x7fa78819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa787fff640 1 -- 172.21.15.59:0/1006848100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa788100a80 msgr2=0x7fa788198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa787fff640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa788100a80 0x7fa788198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa787fff640 1 -- 172.21.15.59:0/1006848100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa788106a80 msgr2=0x7fa78819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa787fff640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa788106a80 0x7fa78819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa787fff640 1 -- 172.21.15.59:0/1006848100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78819d390 con 0x7fa788101420 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa78d6ac640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa788106a80 0x7fa78819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa787fff640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788101420 0x7fa7881989c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa77802ae00 tx=0x7fa778003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa785ffb640 1 -- 172.21.15.59:0/1006848100 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778004040 con 0x7fa788101420 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78819d620 con 0x7fa788101420 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa785ffb640 1 -- 172.21.15.59:0/1006848100 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7780046c0 con 0x7fa788101420 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa785ffb640 1 -- 172.21.15.59:0/1006848100 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778030e70 con 0x7fa788101420 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.043+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7881a4f60 con 0x7fa788101420 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.044+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa788100ee0 con 0x7fa788101420 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.046+0000 7fa785ffb640 1 -- 172.21.15.59:0/1006848100 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa7780305a0 con 0x7fa788101420 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.046+0000 7fa785ffb640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7740a2c10 0x7fa7740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.046+0000 7fa785ffb640 1 -- 172.21.15.59:0/1006848100 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fa77802e030 con 0x7fa788101420 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.046+0000 7fa78ceab640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7740a2c10 0x7fa7740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.047+0000 7fa78ceab640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7740a2c10 0x7fa7740a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa77000ab60 tx=0x7fa77000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.049+0000 7fa785ffb640 1 -- 172.21.15.59:0/1006848100 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa77804b060 con 0x7fa788101420 2024-09-10T11:00:04.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.227+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7881a51c0 con 0x7fa788101420 2024-09-10T11:00:04.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.229+0000 7fa785ffb640 1 -- 172.21.15.59:0/1006848100 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22784 (secure 0 0 0) 0x7fa7780bd980 con 0x7fa788101420 2024-09-10T11:00:04.231 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:04.232 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":83,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T10:59:40.138508+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:59:27.480743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:59:30.088912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:00:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7740a2c10 msgr2=0x7fa7740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7740a2c10 0x7fa7740a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa77000ab60 tx=0x7fa77000a2d0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788101420 msgr2=0x7fa7881989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788101420 0x7fa7881989c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa77802ae00 tx=0x7fa778003970 comp rx=0 tx=0).stop 2024-09-10T11:00:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 shutdown_connections 2024-09-10T11:00:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa7740a2c10 0x7fa7740a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa788106a80 0x7fa78819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa788101420 0x7fa7881989c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 --2- 172.21.15.59:0/1006848100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa788100a80 0x7fa788198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:04.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 >> 172.21.15.59:0/1006848100 conn(0x7fa7880fc7a0 msgr2=0x7fa7881047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:04.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 shutdown_connections 2024-09-10T11:00:04.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:04.232+0000 7fa78f10f640 1 -- 172.21.15.59:0/1006848100 wait complete. 2024-09-10T11:00:04.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:04 smithi059 ceph-mon[30978]: pgmap v295: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-10T11:00:04.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:04 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1006848100' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:00:04.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:04 smithi181 ceph-mon[35409]: pgmap v295: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-10T11:00:04.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:04 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1006848100' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:00:04.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:04 smithi115 ceph-mon[34719]: pgmap v295: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-10T11:00:04.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:04 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1006848100' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:00:05.070 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T11:00:05.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:00:05.335 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.851+0000 7f13ed2ea640 1 -- 172.21.15.59:0/1790917306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8106a80 msgr2=0x7f13e8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.851+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/1790917306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8106a80 0x7f13e8106e60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009930 tx=0x7f13d802a420 comp rx=0 tx=0).stop 2024-09-10T11:00:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.851+0000 7f13ed2ea640 1 -- 172.21.15.59:0/1790917306 shutdown_connections 2024-09-10T11:00:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.851+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/1790917306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13e8101420 0x7f13e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.851+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/1790917306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e8100a80 0x7f13e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.851+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/1790917306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8106a80 0x7f13e8106e60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.851+0000 7f13ed2ea640 1 -- 172.21.15.59:0/1790917306 >> 172.21.15.59:0/1790917306 conn(0x7f13e80fc7a0 msgr2=0x7f13e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.851+0000 7f13ed2ea640 1 -- 172.21.15.59:0/1790917306 shutdown_connections 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.851+0000 7f13ed2ea640 1 -- 172.21.15.59:0/1790917306 wait complete. 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13ed2ea640 1 Processor -- start 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13ed2ea640 1 -- start start 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13ed2ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8100a80 0x7f13e8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13ed2ea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13e8101420 0x7f13e8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13ed2ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e8106a80 0x7f13e819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13ed2ea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f13e8110ea0 con 0x7f13e8100a80 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13ed2ea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f13e8110d20 con 0x7f13e8106a80 2024-09-10T11:00:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13ed2ea640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f13e8111020 con 0x7f13e8101420 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13e6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8100a80 0x7f13e8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13e6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8100a80 0x7f13e8198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44572/0 (socket says 172.21.15.59:44572) 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13e6ffd640 1 -- 172.21.15.59:0/3202239541 learned_addr learned my addr 172.21.15.59:0/3202239541 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.852+0000 7f13e77fe640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e8106a80 0x7f13e819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13e67fc640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13e8101420 0x7f13e8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13e6ffd640 1 -- 172.21.15.59:0/3202239541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13e8101420 msgr2=0x7f13e8198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13e6ffd640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13e8101420 0x7f13e8198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13e6ffd640 1 -- 172.21.15.59:0/3202239541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e8106a80 msgr2=0x7f13e819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13e6ffd640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e8106a80 0x7f13e819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13e6ffd640 1 -- 172.21.15.59:0/3202239541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e819d510 con 0x7f13e8100a80 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13e67fc640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13e8101420 0x7f13e8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13e6ffd640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8100a80 0x7f13e8198560 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009230 tx=0x7f13d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13cffff640 1 -- 172.21.15.59:0/3202239541 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d803f030 con 0x7f13e8100a80 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13cffff640 1 -- 172.21.15.59:0/3202239541 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13d8003ad0 con 0x7f13e8100a80 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e819d7a0 con 0x7f13e8100a80 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13cffff640 1 -- 172.21.15.59:0/3202239541 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8035070 con 0x7f13e8100a80 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.853+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e81a50e0 con 0x7f13e8100a80 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.854+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e81021c0 con 0x7f13e8100a80 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.855+0000 7f13cffff640 1 -- 172.21.15.59:0/3202239541 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f13d8042030 con 0x7f13e8100a80 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.856+0000 7f13cffff640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f13d00a2c10 0x7f13d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.856+0000 7f13e67fc640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f13d00a2c10 0x7f13d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.856+0000 7f13cffff640 1 -- 172.21.15.59:0/3202239541 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f13d80ef740 con 0x7f13e8100a80 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.856+0000 7f13e67fc640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f13d00a2c10 0x7f13d00a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0058c0 tx=0x7f13dc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:05.860+0000 7f13cffff640 1 -- 172.21.15.59:0/3202239541 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13d80bc4c0 con 0x7f13e8100a80 2024-09-10T11:00:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.035+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13e81a52b0 con 0x7f13e8100a80 2024-09-10T11:00:06.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.036+0000 7f13cffff640 1 -- 172.21.15.59:0/3202239541 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22784 (secure 0 0 0) 0x7f13d80bbdc0 con 0x7f13e8100a80 2024-09-10T11:00:06.038 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:06.038 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":83,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T10:59:40.138508+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:59:27.480743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:59:30.088912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:00:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f13d00a2c10 msgr2=0x7f13d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f13d00a2c10 0x7f13d00a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0058c0 tx=0x7f13dc005850 comp rx=0 tx=0).stop 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8100a80 msgr2=0x7f13e8198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8100a80 0x7f13e8198560 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009230 tx=0x7f13d8004270 comp rx=0 tx=0).stop 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 shutdown_connections 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f13d00a2c10 0x7f13d00a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e8106a80 0x7f13e819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13e8101420 0x7f13e8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 --2- 172.21.15.59:0/3202239541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13e8100a80 0x7f13e8198560 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 >> 172.21.15.59:0/3202239541 conn(0x7f13e80fc7a0 msgr2=0x7f13e806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 shutdown_connections 2024-09-10T11:00:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:06.039+0000 7f13ed2ea640 1 -- 172.21.15.59:0/3202239541 wait complete. 2024-09-10T11:00:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:06 smithi059 ceph-mon[30978]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-10T11:00:06.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:06 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3202239541' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:00:06.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T11:00:06.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T11:00:06.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T11:00:06.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T11:00:06.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T11:00:06.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T11:00:06.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T11:00:06.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T11:00:06.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T11:00:06.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T11:00:06.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T11:00:06.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T11:00:06.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:06 smithi181 ceph-mon[35409]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-10T11:00:06.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:06 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3202239541' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:00:06.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:06 smithi115 ceph-mon[34719]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-10T11:00:06.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:06 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3202239541' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:00:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:07.515 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.437+0000 7fdf02e14640 1 -- 172.21.15.59:0/1070766354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc102570 msgr2=0x7fdefc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.437+0000 7fdf02e14640 1 --2- 172.21.15.59:0/1070766354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc102570 0x7fdefc1029b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009900 tx=0x7fdee402a480 comp rx=0 tx=0).stop 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.437+0000 7fdf02e14640 1 -- 172.21.15.59:0/1070766354 shutdown_connections 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.437+0000 7fdf02e14640 1 --2- 172.21.15.59:0/1070766354 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdefc102ef0 0x7fdefc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.437+0000 7fdf02e14640 1 --2- 172.21.15.59:0/1070766354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc102570 0x7fdefc1029b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.437+0000 7fdf02e14640 1 --2- 172.21.15.59:0/1070766354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdefc100e20 0x7fdefc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.437+0000 7fdf02e14640 1 -- 172.21.15.59:0/1070766354 >> 172.21.15.59:0/1070766354 conn(0x7fdefc0fc7d0 msgr2=0x7fdefc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.437+0000 7fdf02e14640 1 -- 172.21.15.59:0/1070766354 shutdown_connections 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.437+0000 7fdf02e14640 1 -- 172.21.15.59:0/1070766354 wait complete. 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf02e14640 1 Processor -- start 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf02e14640 1 -- start start 2024-09-10T11:00:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf02e14640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc100e20 0x7fdefc199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf02e14640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdefc102570 0x7fdefc199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf02e14640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdefc102ef0 0x7fdefc1a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf02e14640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc110f80 con 0x7fdefc100e20 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf02e14640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc110e00 con 0x7fdefc102570 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf02e14640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc111100 con 0x7fdefc102ef0 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf00bb0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc100e20 0x7fdefc199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf00bb0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc100e20 0x7fdefc199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44368/0 (socket says 172.21.15.59:44368) 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf00bb0640 1 -- 172.21.15.59:0/3869150483 learned_addr learned my addr 172.21.15.59:0/3869150483 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdefbfff640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdefc102570 0x7fdefc199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.438+0000 7fdf013b1640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdefc102ef0 0x7fdefc1a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdf00bb0640 1 -- 172.21.15.59:0/3869150483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdefc102ef0 msgr2=0x7fdefc1a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdf00bb0640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdefc102ef0 0x7fdefc1a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdf00bb0640 1 -- 172.21.15.59:0/3869150483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdefc102570 msgr2=0x7fdefc199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdf00bb0640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdefc102570 0x7fdefc199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdf00bb0640 1 -- 172.21.15.59:0/3869150483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc1a48e0 con 0x7fdefc100e20 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdf013b1640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdefc102ef0 0x7fdefc1a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdf00bb0640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc100e20 0x7fdefc199320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdef400e9f0 tx=0x7fdef400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdef9ffb640 1 -- 172.21.15.59:0/3869150483 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef400cd80 con 0x7fdefc100e20 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdefc1a4ab0 con 0x7fdefc100e20 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdef9ffb640 1 -- 172.21.15.59:0/3869150483 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef4010910 con 0x7fdefc100e20 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdef9ffb640 1 -- 172.21.15.59:0/3869150483 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef40188f0 con 0x7fdefc100e20 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.439+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdefc1a5010 con 0x7fdefc100e20 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.440+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdefc062980 con 0x7fdefc100e20 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.442+0000 7fdef9ffb640 1 -- 172.21.15.59:0/3869150483 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdef4010ac0 con 0x7fdefc100e20 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.442+0000 7fdef9ffb640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdee80a2c10 0x7fdee80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.442+0000 7fdefbfff640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdee80a2c10 0x7fdee80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.442+0000 7fdef9ffb640 1 -- 172.21.15.59:0/3869150483 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fdef40cfcb0 con 0x7fdefc100e20 2024-09-10T11:00:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.443+0000 7fdef9ffb640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] conn(0x7fdee80ac8c0 0x7fdee80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.443+0000 7fdef9ffb640 1 -- 172.21.15.59:0/3869150483 --> [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdee80af430 con 0x7fdee80ac8c0 2024-09-10T11:00:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.443+0000 7fdef9ffb640 1 -- 172.21.15.59:0/3869150483 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fdef40d0100 con 0x7fdefc100e20 2024-09-10T11:00:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.443+0000 7fdefbfff640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdee80a2c10 0x7fdee80a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009230 tx=0x7fdee40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.443+0000 7fdf013b1640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] conn(0x7fdee80ac8c0 0x7fdee80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.443+0000 7fdf013b1640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] conn(0x7fdee80ac8c0 0x7fdee80aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.444+0000 7fdef9ffb640 1 -- 172.21.15.59:0/3869150483 <== osd.2 v2:172.21.15.181:6800/1826637197 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdee80af430 con 0x7fdee80ac8c0 2024-09-10T11:00:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.458+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 --> [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdefc062e00 con 0x7fdee80ac8c0 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdef9ffb640 1 -- 172.21.15.59:0/3869150483 <== osd.2 v2:172.21.15.181:6800/1826637197 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdefc062e00 con 0x7fdee80ac8c0 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 >> [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] conn(0x7fdee80ac8c0 msgr2=0x7fdee80aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] conn(0x7fdee80ac8c0 0x7fdee80aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdee80a2c10 msgr2=0x7fdee80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fdee80a2c10 0x7fdee80a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009230 tx=0x7fdee40058d0 comp rx=0 tx=0).stop 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc100e20 msgr2=0x7fdefc199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 --2- 172.21.15.59:0/3869150483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc100e20 0x7fdefc199320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdef400e9f0 tx=0x7fdef400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf013b1640 1 -- 172.21.15.59:0/3869150483 reap_dead start 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 shutdown_connections 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 >> 172.21.15.59:0/3869150483 conn(0x7fdefc0fc7d0 msgr2=0x7fdefc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 shutdown_connections 2024-09-10T11:00:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.459+0000 7fdf02e14640 1 -- 172.21.15.59:0/3869150483 wait complete. 2024-09-10T11:00:08.865 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:08 smithi059 ceph-mon[30978]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T11:00:08.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:08 smithi181 ceph-mon[35409]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T11:00:08.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:08 smithi115 ceph-mon[34719]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T11:00:09.260 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:09.261 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:09.271 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:09.273 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:09.290 INFO:teuthology.orchestra.run.smithi059.stdout:77309411394 2024-09-10T11:00:09.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T11:00:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 -- 172.21.15.59:0/914627286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e0106f20 msgr2=0x7f90e010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 --2- 172.21.15.59:0/914627286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e0106f20 0x7f90e010eaa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009900 tx=0x7f90d802a410 comp rx=0 tx=0).stop 2024-09-10T11:00:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 -- 172.21.15.59:0/914627286 shutdown_connections 2024-09-10T11:00:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 --2- 172.21.15.59:0/914627286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e0106f20 0x7f90e010eaa0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 --2- 172.21.15.59:0/914627286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90e01027a0 0x7f90e01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 --2- 172.21.15.59:0/914627286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90e0101df0 0x7f90e01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 -- 172.21.15.59:0/914627286 >> 172.21.15.59:0/914627286 conn(0x7f90e00fd8b0 msgr2=0x7f90e00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 -- 172.21.15.59:0/914627286 shutdown_connections 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 -- 172.21.15.59:0/914627286 wait complete. 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 Processor -- start 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.333+0000 7f90e779b640 1 -- start start 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e779b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90e0101df0 0x7f90e01983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e779b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e01027a0 0x7f90e0198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e779b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90e0106f20 0x7f90e019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e779b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0111f80 con 0x7f90e01027a0 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e779b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0111e00 con 0x7f90e0106f20 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e779b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0112100 con 0x7f90e0101df0 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e4d36640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e01027a0 0x7f90e0198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e4d36640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e01027a0 0x7f90e0198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44346/0 (socket says 172.21.15.59:44346) 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e4d36640 1 -- 172.21.15.59:0/3945274392 learned_addr learned my addr 172.21.15.59:0/3945274392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e5537640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90e0101df0 0x7f90e01983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e5d38640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90e0106f20 0x7f90e019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e4d36640 1 -- 172.21.15.59:0/3945274392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90e0101df0 msgr2=0x7f90e01983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e4d36640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f90e0101df0 0x7f90e01983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e4d36640 1 -- 172.21.15.59:0/3945274392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90e0106f20 msgr2=0x7f90e019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e4d36640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90e0106f20 0x7f90e019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e4d36640 1 -- 172.21.15.59:0/3945274392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e019d390 con 0x7f90e01027a0 2024-09-10T11:00:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e5d38640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90e0106f20 0x7f90e019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:00:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e4d36640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e01027a0 0x7f90e0198920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c970 tx=0x7f90d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90de7fc640 1 -- 172.21.15.59:0/3945274392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d4007bb0 con 0x7f90e01027a0 2024-09-10T11:00:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.334+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e019d680 con 0x7f90e01027a0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.335+0000 7f90de7fc640 1 -- 172.21.15.59:0/3945274392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90d4007d50 con 0x7f90e01027a0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.335+0000 7f90de7fc640 1 -- 172.21.15.59:0/3945274392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d400f450 con 0x7f90e01027a0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.335+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e01a4f60 con 0x7f90e01027a0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.335+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90e0062940 con 0x7f90e01027a0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.337+0000 7f90de7fc640 1 -- 172.21.15.59:0/3945274392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f90d4004fa0 con 0x7f90e01027a0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.337+0000 7f90de7fc640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f90c80a2c10 0x7f90c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.337+0000 7f90de7fc640 1 -- 172.21.15.59:0/3945274392 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f90d40cf350 con 0x7f90e01027a0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.337+0000 7f90e5537640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f90c80a2c10 0x7f90c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.338+0000 7f90de7fc640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] conn(0x7f90c80ac8c0 0x7f90c80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.338+0000 7f90de7fc640 1 -- 172.21.15.59:0/3945274392 --> [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90d4012ec0 con 0x7f90c80ac8c0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.338+0000 7f90de7fc640 1 -- 172.21.15.59:0/3945274392 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f90d40cf7a0 con 0x7f90e01027a0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.338+0000 7f90e5537640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f90c80a2c10 0x7f90c80a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f90d0005fd0 tx=0x7f90d0009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.338+0000 7f90e5d38640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] conn(0x7f90c80ac8c0 0x7f90c80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.338+0000 7f90e5d38640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] conn(0x7f90c80ac8c0 0x7f90c80aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.339+0000 7f90de7fc640 1 -- 172.21.15.59:0/3945274392 <== osd.1 v2:172.21.15.115:6800/2214288825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90d4012ec0 con 0x7f90c80ac8c0 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.353+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 --> [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f90e0062dc0 con 0x7f90c80ac8c0 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90de7fc640 1 -- 172.21.15.59:0/3945274392 <== osd.1 v2:172.21.15.115:6800/2214288825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f90e0062dc0 con 0x7f90c80ac8c0 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 >> [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] conn(0x7f90c80ac8c0 msgr2=0x7f90c80aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90e779b640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] conn(0x7f90c80ac8c0 0x7f90c80aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f90c80a2c10 msgr2=0x7f90c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90e779b640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f90c80a2c10 0x7f90c80a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f90d0005fd0 tx=0x7f90d0009680 comp rx=0 tx=0).stop 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e01027a0 msgr2=0x7f90e0198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90e779b640 1 --2- 172.21.15.59:0/3945274392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e01027a0 0x7f90e0198920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c970 tx=0x7f90d400ce30 comp rx=0 tx=0).stop 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90e5d38640 1 -- 172.21.15.59:0/3945274392 reap_dead start 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 shutdown_connections 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.354+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 >> 172.21.15.59:0/3945274392 conn(0x7f90e00fd8b0 msgr2=0x7f90e00feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.355+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 shutdown_connections 2024-09-10T11:00:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:08.355+0000 7f90e779b640 1 -- 172.21.15.59:0/3945274392 wait complete. 2024-09-10T11:00:10.150 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:10.189 INFO:teuthology.orchestra.run.smithi059.stdout:55834574918 2024-09-10T11:00:10.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T11:00:10.686 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:10 smithi059 ceph-mon[30978]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-10T11:00:10.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:10 smithi181 ceph-mon[35409]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-10T11:00:10.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:10 smithi115 ceph-mon[34719]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-10T11:00:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/3383177871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5d8102790 msgr2=0x7fd5d81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 --2- 172.21.15.59:0/3383177871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5d8102790 0x7fd5d81067e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009900 tx=0x7fd5c002a410 comp rx=0 tx=0).stop 2024-09-10T11:00:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/3383177871 shutdown_connections 2024-09-10T11:00:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 --2- 172.21.15.59:0/3383177871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d8106f10 0x7fd5d810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:10.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 --2- 172.21.15.59:0/3383177871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5d8102790 0x7fd5d81067e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 --2- 172.21.15.59:0/3383177871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d8101de0 0x7fd5d81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/3383177871 >> 172.21.15.59:0/3383177871 conn(0x7fd5d80fd880 msgr2=0x7fd5d80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/3383177871 shutdown_connections 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/3383177871 wait complete. 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 Processor -- start 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.958+0000 7fd5dd2e8640 1 -- start start 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5dd2e8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d8101de0 0x7fd5d80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5dd2e8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5d8102790 0x7fd5d8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5dd2e8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d8106f10 0x7fd5d8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5dd2e8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8111f70 con 0x7fd5d8102790 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5dd2e8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8111df0 con 0x7fd5d8101de0 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5dd2e8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d81120f0 con 0x7fd5d8106f10 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5d8102790 0x7fd5d8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5d8102790 0x7fd5d8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44418/0 (socket says 172.21.15.59:44418) 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d67fc640 1 -- 172.21.15.59:0/2084829326 learned_addr learned my addr 172.21.15.59:0/2084829326 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d6ffd640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d8101de0 0x7fd5d80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d67fc640 1 -- 172.21.15.59:0/2084829326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d8106f10 msgr2=0x7fd5d8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d67fc640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd5d8106f10 0x7fd5d8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d67fc640 1 -- 172.21.15.59:0/2084829326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d8101de0 msgr2=0x7fd5d80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d67fc640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5d8101de0 0x7fd5d80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d67fc640 1 -- 172.21.15.59:0/2084829326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d81a6890 con 0x7fd5d8102790 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5d67fc640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5d8102790 0x7fd5d8074a30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0005ab0 tx=0x7fd5c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5cffff640 1 -- 172.21.15.59:0/2084829326 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c003f030 con 0x7fd5d8102790 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.959+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d81a6b20 con 0x7fd5d8102790 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.960+0000 7fd5cffff640 1 -- 172.21.15.59:0/2084829326 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5c0003ce0 con 0x7fd5d8102790 2024-09-10T11:00:10.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.960+0000 7fd5cffff640 1 -- 172.21.15.59:0/2084829326 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0035070 con 0x7fd5d8102790 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.960+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d81a7050 con 0x7fd5d8102790 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.960+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5d8062900 con 0x7fd5d8102790 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.962+0000 7fd5cffff640 1 -- 172.21.15.59:0/2084829326 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd5c0042030 con 0x7fd5d8102790 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.962+0000 7fd5cffff640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd5c40a2c10 0x7fd5c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.962+0000 7fd5d6ffd640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd5c40a2c10 0x7fd5c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.963+0000 7fd5cffff640 1 -- 172.21.15.59:0/2084829326 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fd5c00efe90 con 0x7fd5d8102790 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.963+0000 7fd5cffff640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] conn(0x7fd5c40ac8c0 0x7fd5c40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.963+0000 7fd5cffff640 1 -- 172.21.15.59:0/2084829326 --> [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5c40af430 con 0x7fd5c40ac8c0 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.963+0000 7fd5cffff640 1 -- 172.21.15.59:0/2084829326 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fd5c00f02e0 con 0x7fd5d8102790 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.963+0000 7fd5d77fe640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] conn(0x7fd5c40ac8c0 0x7fd5c40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.963+0000 7fd5d6ffd640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd5c40a2c10 0x7fd5c40a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000ba40 tx=0x7fd5d0005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.963+0000 7fd5d77fe640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] conn(0x7fd5c40ac8c0 0x7fd5c40aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:10.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.964+0000 7fd5cffff640 1 -- 172.21.15.59:0/2084829326 <== osd.3 v2:172.21.15.59:6810/1709553083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5c40af430 con 0x7fd5c40ac8c0 2024-09-10T11:00:10.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 --> [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd5d8062d00 con 0x7fd5c40ac8c0 2024-09-10T11:00:10.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5cffff640 1 -- 172.21.15.59:0/2084829326 <== osd.3 v2:172.21.15.59:6810/1709553083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd5d8062d00 con 0x7fd5c40ac8c0 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] conn(0x7fd5c40ac8c0 msgr2=0x7fd5c40aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5dd2e8640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] conn(0x7fd5c40ac8c0 0x7fd5c40aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd5c40a2c10 msgr2=0x7fd5c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5dd2e8640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd5c40a2c10 0x7fd5c40a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000ba40 tx=0x7fd5d0005cc0 comp rx=0 tx=0).stop 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5d8102790 msgr2=0x7fd5d8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5dd2e8640 1 --2- 172.21.15.59:0/2084829326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5d8102790 0x7fd5d8074a30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0005ab0 tx=0x7fd5c00042f0 comp rx=0 tx=0).stop 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5d77fe640 1 -- 172.21.15.59:0/2084829326 reap_dead start 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 shutdown_connections 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.978+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 >> 172.21.15.59:0/2084829326 conn(0x7fd5d80fd880 msgr2=0x7fd5d80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.979+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 shutdown_connections 2024-09-10T11:00:10.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.979+0000 7fd5dd2e8640 1 -- 172.21.15.59:0/2084829326 wait complete. 2024-09-10T11:00:12.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.059+0000 7ff5c7385640 1 -- 172.21.15.59:0/3687289569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c0100a80 msgr2=0x7ff5c0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:12.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.059+0000 7ff5c7385640 1 --2- 172.21.15.59:0/3687289569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c0100a80 0x7ff5c0100ee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009930 tx=0x7ff5b002a420 comp rx=0 tx=0).stop 2024-09-10T11:00:12.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.059+0000 7ff5c7385640 1 -- 172.21.15.59:0/3687289569 shutdown_connections 2024-09-10T11:00:12.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.059+0000 7ff5c7385640 1 --2- 172.21.15.59:0/3687289569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5c0101420 0x7ff5c010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.059+0000 7ff5c7385640 1 --2- 172.21.15.59:0/3687289569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c0100a80 0x7ff5c0100ee0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.059+0000 7ff5c7385640 1 --2- 172.21.15.59:0/3687289569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c0106a80 0x7ff5c0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.059+0000 7ff5c7385640 1 -- 172.21.15.59:0/3687289569 >> 172.21.15.59:0/3687289569 conn(0x7ff5c00fc7a0 msgr2=0x7ff5c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.059+0000 7ff5c7385640 1 -- 172.21.15.59:0/3687289569 shutdown_connections 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.059+0000 7ff5c7385640 1 -- 172.21.15.59:0/3687289569 wait complete. 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.060+0000 7ff5c7385640 1 Processor -- start 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.060+0000 7ff5c7385640 1 -- start start 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.060+0000 7ff5c7385640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c0100a80 0x7ff5c0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.060+0000 7ff5c7385640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c0101420 0x7ff5c01988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.060+0000 7ff5c7385640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5c0106a80 0x7ff5c019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.060+0000 7ff5c7385640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0110e80 con 0x7ff5c0100a80 2024-09-10T11:00:12.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.060+0000 7ff5c7385640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0110d00 con 0x7ff5c0101420 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.060+0000 7ff5c7385640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0111000 con 0x7ff5c0106a80 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c5121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c0100a80 0x7ff5c0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c5121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c0100a80 0x7ff5c0198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44426/0 (socket says 172.21.15.59:44426) 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c5121640 1 -- 172.21.15.59:0/2742332915 learned_addr learned my addr 172.21.15.59:0/2742332915 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c5121640 1 -- 172.21.15.59:0/2742332915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5c0106a80 msgr2=0x7ff5c019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c5121640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5c0106a80 0x7ff5c019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c5121640 1 -- 172.21.15.59:0/2742332915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c0101420 msgr2=0x7ff5c01988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c5121640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5c0101420 0x7ff5c01988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c5121640 1 -- 172.21.15.59:0/2742332915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c019d340 con 0x7ff5c0100a80 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c5121640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c0100a80 0x7ff5c0198390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00c920 tx=0x7ff5bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5b67fc640 1 -- 172.21.15.59:0/2742332915 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc007c70 con 0x7ff5c0100a80 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5b67fc640 1 -- 172.21.15.59:0/2742332915 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5bc007e10 con 0x7ff5c0100a80 2024-09-10T11:00:12.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c019d630 con 0x7ff5c0100a80 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5b67fc640 1 -- 172.21.15.59:0/2742332915 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc018890 con 0x7ff5c0100a80 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.061+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c01a4f10 con 0x7ff5c0100a80 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.062+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5c0062980 con 0x7ff5c0100a80 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.063+0000 7ff5b67fc640 1 -- 172.21.15.59:0/2742332915 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff5bc018a70 con 0x7ff5c0100a80 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.064+0000 7ff5b67fc640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5ac0a2c90 0x7ff5ac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.064+0000 7ff5c4920640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5ac0a2c90 0x7ff5ac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.064+0000 7ff5b67fc640 1 -- 172.21.15.59:0/2742332915 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7ff5bc0cf340 con 0x7ff5c0100a80 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.064+0000 7ff5b67fc640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] conn(0x7ff5ac0ac940 0x7ff5ac0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.064+0000 7ff5b67fc640 1 -- 172.21.15.59:0/2742332915 --> [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5bc012ec0 con 0x7ff5ac0ac940 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.064+0000 7ff5b67fc640 1 -- 172.21.15.59:0/2742332915 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff5bc0d6050 con 0x7ff5c0100a80 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.064+0000 7ff5c4920640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5ac0a2c90 0x7ff5ac0a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5b002a940 tx=0x7ff5b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.065+0000 7ff5c5922640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] conn(0x7ff5ac0ac940 0x7ff5ac0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:12.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.065+0000 7ff5c5922640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] conn(0x7ff5ac0ac940 0x7ff5ac0aede0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:12.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.066+0000 7ff5b67fc640 1 -- 172.21.15.59:0/2742332915 <== osd.4 v2:172.21.15.115:6808/65991145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5bc012ec0 con 0x7ff5ac0ac940 2024-09-10T11:00:12.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.079+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 --> [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5c0062d80 con 0x7ff5ac0ac940 2024-09-10T11:00:12.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5b67fc640 1 -- 172.21.15.59:0/2742332915 <== osd.4 v2:172.21.15.115:6808/65991145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff5c0062d80 con 0x7ff5ac0ac940 2024-09-10T11:00:12.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 >> [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] conn(0x7ff5ac0ac940 msgr2=0x7ff5ac0aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:12.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] conn(0x7ff5ac0ac940 0x7ff5ac0aede0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:12.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5ac0a2c90 msgr2=0x7ff5ac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:12.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff5ac0a2c90 0x7ff5ac0a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5b002a940 tx=0x7ff5b0000bc0 comp rx=0 tx=0).stop 2024-09-10T11:00:12.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c0100a80 msgr2=0x7ff5c0198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:12.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 --2- 172.21.15.59:0/2742332915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5c0100a80 0x7ff5c0198390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00c920 tx=0x7ff5bc00cde0 comp rx=0 tx=0).stop 2024-09-10T11:00:12.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c5922640 1 -- 172.21.15.59:0/2742332915 reap_dead start 2024-09-10T11:00:12.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 shutdown_connections 2024-09-10T11:00:12.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 >> 172.21.15.59:0/2742332915 conn(0x7ff5c00fc7a0 msgr2=0x7ff5c006a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:12.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 shutdown_connections 2024-09-10T11:00:12.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:12.080+0000 7ff5c7385640 1 -- 172.21.15.59:0/2742332915 wait complete. 2024-09-10T11:00:12.883 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:12 smithi059 ceph-mon[30978]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T11:00:12.915 INFO:teuthology.orchestra.run.smithi059.stdout:137438953529 2024-09-10T11:00:12.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T11:00:12.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:12 smithi181 ceph-mon[35409]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T11:00:12.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:12 smithi115 ceph-mon[34719]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T11:00:13.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.336+0000 7f3c7b52b640 1 -- 172.21.15.59:0/2538943342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7410e480 msgr2=0x7f3c74110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.336+0000 7f3c7b52b640 1 --2- 172.21.15.59:0/2538943342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7410e480 0x7f3c74110870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009ca0 tx=0x7f3c6c02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.336+0000 7f3c7b52b640 1 -- 172.21.15.59:0/2538943342 shutdown_connections 2024-09-10T11:00:13.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.336+0000 7f3c7b52b640 1 --2- 172.21.15.59:0/2538943342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c7410e480 0x7f3c74110870 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.336+0000 7f3c7b52b640 1 --2- 172.21.15.59:0/2538943342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c74101280 0x7f3c7410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.336+0000 7f3c7b52b640 1 --2- 172.21.15.59:0/2538943342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c741008d0 0x7f3c74100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.336+0000 7f3c7b52b640 1 -- 172.21.15.59:0/2538943342 >> 172.21.15.59:0/2538943342 conn(0x7f3c740fc7a0 msgr2=0x7f3c740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:13.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.336+0000 7f3c7b52b640 1 -- 172.21.15.59:0/2538943342 shutdown_connections 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.336+0000 7f3c7b52b640 1 -- 172.21.15.59:0/2538943342 wait complete. 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c7b52b640 1 Processor -- start 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c7b52b640 1 -- start start 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c7b52b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c741008d0 0x7f3c7419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c7b52b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c74101280 0x7f3c7419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c7b52b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c7410e480 0x7f3c7419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c7b52b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c741141d0 con 0x7f3c74101280 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c7b52b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74114050 con 0x7f3c741008d0 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c7b52b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74114350 con 0x7f3c7410e480 2024-09-10T11:00:13.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c78ac6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c74101280 0x7f3c7419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c78ac6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c74101280 0x7f3c7419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44440/0 (socket says 172.21.15.59:44440) 2024-09-10T11:00:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c78ac6640 1 -- 172.21.15.59:0/583797282 learned_addr learned my addr 172.21.15.59:0/583797282 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c792c7640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c741008d0 0x7f3c7419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.337+0000 7f3c79ac8640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c7410e480 0x7f3c7419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c78ac6640 1 -- 172.21.15.59:0/583797282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c7410e480 msgr2=0x7f3c7419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c78ac6640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c7410e480 0x7f3c7419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c78ac6640 1 -- 172.21.15.59:0/583797282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c741008d0 msgr2=0x7f3c7419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c78ac6640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c741008d0 0x7f3c7419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c78ac6640 1 -- 172.21.15.59:0/583797282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7419f5e0 con 0x7f3c74101280 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c78ac6640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c74101280 0x7f3c7419ab70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400c920 tx=0x7f3c6400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c6a7fc640 1 -- 172.21.15.59:0/583797282 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64007bb0 con 0x7f3c74101280 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c6a7fc640 1 -- 172.21.15.59:0/583797282 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c64007d50 con 0x7f3c74101280 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7419f8d0 con 0x7f3c74101280 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c6a7fc640 1 -- 172.21.15.59:0/583797282 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c640187d0 con 0x7f3c74101280 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.338+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c741a71b0 con 0x7f3c74101280 2024-09-10T11:00:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.339+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c7410fa50 con 0x7f3c74101280 2024-09-10T11:00:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.340+0000 7f3c6a7fc640 1 -- 172.21.15.59:0/583797282 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3c6400f450 con 0x7f3c74101280 2024-09-10T11:00:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.341+0000 7f3c6a7fc640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3c600a2c90 0x7f3c600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.341+0000 7f3c792c7640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3c600a2c90 0x7f3c600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.341+0000 7f3c6a7fc640 1 -- 172.21.15.59:0/583797282 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f3c640cf6d0 con 0x7f3c74101280 2024-09-10T11:00:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.341+0000 7f3c6a7fc640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] conn(0x7f3c600ac940 0x7f3c600aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.341+0000 7f3c6a7fc640 1 -- 172.21.15.59:0/583797282 --> [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c600af4b0 con 0x7f3c600ac940 2024-09-10T11:00:13.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.341+0000 7f3c6a7fc640 1 -- 172.21.15.59:0/583797282 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f3c640cfb20 con 0x7f3c74101280 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.341+0000 7f3c792c7640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3c600a2c90 0x7f3c600a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009990 tx=0x7f3c70009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.341+0000 7f3c79ac8640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] conn(0x7f3c600ac940 0x7f3c600aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.342+0000 7f3c79ac8640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] conn(0x7f3c600ac940 0x7f3c600aede0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.343+0000 7f3c6a7fc640 1 -- 172.21.15.59:0/583797282 <== osd.5 v2:172.21.15.181:6808/361358873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c600af4b0 con 0x7f3c600ac940 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.356+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 --> [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c7406b070 con 0x7f3c600ac940 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c6a7fc640 1 -- 172.21.15.59:0/583797282 <== osd.5 v2:172.21.15.181:6808/361358873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3c7406b070 con 0x7f3c600ac940 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 >> [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] conn(0x7f3c600ac940 msgr2=0x7f3c600aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c7b52b640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] conn(0x7f3c600ac940 0x7f3c600aede0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3c600a2c90 msgr2=0x7f3c600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c7b52b640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3c600a2c90 0x7f3c600a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009990 tx=0x7f3c70009110 comp rx=0 tx=0).stop 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c74101280 msgr2=0x7f3c7419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c7b52b640 1 --2- 172.21.15.59:0/583797282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c74101280 0x7f3c7419ab70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400c920 tx=0x7f3c6400cd20 comp rx=0 tx=0).stop 2024-09-10T11:00:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c79ac8640 1 -- 172.21.15.59:0/583797282 reap_dead start 2024-09-10T11:00:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 shutdown_connections 2024-09-10T11:00:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.357+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 >> 172.21.15.59:0/583797282 conn(0x7f3c740fc7a0 msgr2=0x7f3c740feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.358+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 shutdown_connections 2024-09-10T11:00:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.358+0000 7f3c7b52b640 1 -- 172.21.15.59:0/583797282 wait complete. 2024-09-10T11:00:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.823+0000 7f9b430ea640 1 -- 172.21.15.59:0/3399510325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3c112b90 msgr2=0x7f9b3c114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.823+0000 7f9b430ea640 1 --2- 172.21.15.59:0/3399510325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3c112b90 0x7f9b3c114f80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009ca0 tx=0x7f9b3402a950 comp rx=0 tx=0).stop 2024-09-10T11:00:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.823+0000 7f9b430ea640 1 -- 172.21.15.59:0/3399510325 shutdown_connections 2024-09-10T11:00:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.823+0000 7f9b430ea640 1 --2- 172.21.15.59:0/3399510325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3c112b90 0x7f9b3c114f80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.823+0000 7f9b430ea640 1 --2- 172.21.15.59:0/3399510325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b3c074eb0 0x7f9b3c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.823+0000 7f9b430ea640 1 --2- 172.21.15.59:0/3399510325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b3c074590 0x7f9b3c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.823+0000 7f9b430ea640 1 -- 172.21.15.59:0/3399510325 >> 172.21.15.59:0/3399510325 conn(0x7f9b3c0fd8c0 msgr2=0x7f9b3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.823+0000 7f9b430ea640 1 -- 172.21.15.59:0/3399510325 shutdown_connections 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.823+0000 7f9b430ea640 1 -- 172.21.15.59:0/3399510325 wait complete. 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b430ea640 1 Processor -- start 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b430ea640 1 -- start start 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b430ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b3c074590 0x7f9b3c1a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b430ea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b3c074eb0 0x7f9b3c1a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b430ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3c112b90 0x7f9b3c19e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b430ea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c118570 con 0x7f9b3c112b90 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b430ea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c1183f0 con 0x7f9b3c074590 2024-09-10T11:00:13.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b430ea640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c1186f0 con 0x7f9b3c074eb0 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b41687640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3c112b90 0x7f9b3c19e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b41687640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3c112b90 0x7f9b3c19e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44452/0 (socket says 172.21.15.59:44452) 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b41687640 1 -- 172.21.15.59:0/724307516 learned_addr learned my addr 172.21.15.59:0/724307516 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b3bfff640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b3c074eb0 0x7f9b3c1a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b40e86640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b3c074590 0x7f9b3c1a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b41687640 1 -- 172.21.15.59:0/724307516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b3c074eb0 msgr2=0x7f9b3c1a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b41687640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b3c074eb0 0x7f9b3c1a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b41687640 1 -- 172.21.15.59:0/724307516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b3c074590 msgr2=0x7f9b3c1a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b41687640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b3c074590 0x7f9b3c1a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b41687640 1 -- 172.21.15.59:0/724307516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c19efe0 con 0x7f9b3c112b90 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b3bfff640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b3c074eb0 0x7f9b3c1a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.824+0000 7f9b40e86640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b3c074590 0x7f9b3c1a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:13.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.825+0000 7f9b41687640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3c112b90 0x7f9b3c19e840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9b34006010 tx=0x7f9b3402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.825+0000 7f9b39ffb640 1 -- 172.21.15.59:0/724307516 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34034040 con 0x7f9b3c112b90 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.825+0000 7f9b39ffb640 1 -- 172.21.15.59:0/724307516 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b34003e00 con 0x7f9b3c112b90 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.825+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c19f270 con 0x7f9b3c112b90 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.825+0000 7f9b39ffb640 1 -- 172.21.15.59:0/724307516 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b340456e0 con 0x7f9b3c112b90 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.825+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c1ab520 con 0x7f9b3c112b90 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.826+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b3c0ff990 con 0x7f9b3c112b90 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.827+0000 7f9b39ffb640 1 -- 172.21.15.59:0/724307516 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9b34037020 con 0x7f9b3c112b90 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.828+0000 7f9b39ffb640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9b2c0a2c10 0x7f9b2c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.828+0000 7f9b40e86640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9b2c0a2c10 0x7f9b2c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.828+0000 7f9b39ffb640 1 -- 172.21.15.59:0/724307516 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f9b340f03f0 con 0x7f9b3c112b90 2024-09-10T11:00:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.828+0000 7f9b39ffb640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] conn(0x7f9b2c0ac8c0 0x7f9b2c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.828+0000 7f9b39ffb640 1 -- 172.21.15.59:0/724307516 --> [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b34033e50 con 0x7f9b2c0ac8c0 2024-09-10T11:00:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.828+0000 7f9b39ffb640 1 -- 172.21.15.59:0/724307516 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f9b340f0840 con 0x7f9b3c112b90 2024-09-10T11:00:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.828+0000 7f9b40e86640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9b2c0a2c10 0x7f9b2c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000abe0 tx=0x7f9b3000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.828+0000 7f9b3bfff640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] conn(0x7f9b2c0ac8c0 0x7f9b2c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.829+0000 7f9b3bfff640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] conn(0x7f9b2c0ac8c0 0x7f9b2c0aed60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:13.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.830+0000 7f9b39ffb640 1 -- 172.21.15.59:0/724307516 <== osd.8 v2:172.21.15.181:6816/2351101787 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b34033e50 con 0x7f9b2c0ac8c0 2024-09-10T11:00:13.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.843+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 --> [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b3c075cd0 con 0x7f9b2c0ac8c0 2024-09-10T11:00:13.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.844+0000 7f9b39ffb640 1 -- 172.21.15.59:0/724307516 <== osd.8 v2:172.21.15.181:6816/2351101787 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9b3c075cd0 con 0x7f9b2c0ac8c0 2024-09-10T11:00:13.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.844+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 >> [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] conn(0x7f9b2c0ac8c0 msgr2=0x7f9b2c0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.844+0000 7f9b430ea640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] conn(0x7f9b2c0ac8c0 0x7f9b2c0aed60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.844+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9b2c0a2c10 msgr2=0x7f9b2c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.844+0000 7f9b430ea640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f9b2c0a2c10 0x7f9b2c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000abe0 tx=0x7f9b3000a5c0 comp rx=0 tx=0).stop 2024-09-10T11:00:13.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.845+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3c112b90 msgr2=0x7f9b3c19e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:13.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.845+0000 7f9b430ea640 1 --2- 172.21.15.59:0/724307516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3c112b90 0x7f9b3c19e840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9b34006010 tx=0x7f9b3402f710 comp rx=0 tx=0).stop 2024-09-10T11:00:13.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.845+0000 7f9b41687640 1 -- 172.21.15.59:0/724307516 reap_dead start 2024-09-10T11:00:13.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.845+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 shutdown_connections 2024-09-10T11:00:13.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.845+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 >> 172.21.15.59:0/724307516 conn(0x7f9b3c0fd8c0 msgr2=0x7f9b3c0fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:13.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.845+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 shutdown_connections 2024-09-10T11:00:13.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:13.845+0000 7f9b430ea640 1 -- 172.21.15.59:0/724307516 wait complete. 2024-09-10T11:00:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.849+0000 7fe32fb42640 1 -- 172.21.15.59:0/1503583370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3281027a0 msgr2=0x7fe3281067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.849+0000 7fe32fb42640 1 --2- 172.21.15.59:0/1503583370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3281027a0 0x7fe3281067f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe318009900 tx=0x7fe31802a410 comp rx=0 tx=0).stop 2024-09-10T11:00:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.849+0000 7fe32fb42640 1 -- 172.21.15.59:0/1503583370 shutdown_connections 2024-09-10T11:00:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.849+0000 7fe32fb42640 1 --2- 172.21.15.59:0/1503583370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328106f20 0x7fe32810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.849+0000 7fe32fb42640 1 --2- 172.21.15.59:0/1503583370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3281027a0 0x7fe3281067f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.849+0000 7fe32fb42640 1 --2- 172.21.15.59:0/1503583370 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe328101df0 0x7fe3281021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.849+0000 7fe32fb42640 1 -- 172.21.15.59:0/1503583370 >> 172.21.15.59:0/1503583370 conn(0x7fe3280fd8f0 msgr2=0x7fe3280ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.849+0000 7fe32fb42640 1 -- 172.21.15.59:0/1503583370 shutdown_connections 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.849+0000 7fe32fb42640 1 -- 172.21.15.59:0/1503583370 wait complete. 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32fb42640 1 Processor -- start 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32fb42640 1 -- start start 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32fb42640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328101df0 0x7fe3280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32fb42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3281027a0 0x7fe328074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32fb42640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328106f20 0x7fe328074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32fb42640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe328111f80 con 0x7fe328106f20 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32fb42640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe328111e00 con 0x7fe328101df0 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32fb42640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe328112100 con 0x7fe3281027a0 2024-09-10T11:00:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32e0df640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328106f20 0x7fe328074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32e0df640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328106f20 0x7fe328074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44392/0 (socket says 172.21.15.59:44392) 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32e0df640 1 -- 172.21.15.59:0/386312211 learned_addr learned my addr 172.21.15.59:0/386312211 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32d8de640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328101df0 0x7fe3280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.850+0000 7fe32d0dd640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3281027a0 0x7fe328074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe32e0df640 1 -- 172.21.15.59:0/386312211 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3281027a0 msgr2=0x7fe328074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe32e0df640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3281027a0 0x7fe328074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe32e0df640 1 -- 172.21.15.59:0/386312211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328101df0 msgr2=0x7fe3280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe32e0df640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328101df0 0x7fe3280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe32e0df640 1 -- 172.21.15.59:0/386312211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3281a6960 con 0x7fe328106f20 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe32e0df640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328106f20 0x7fe328074f70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe32000cce0 tx=0x7fe32000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe31effd640 1 -- 172.21.15.59:0/386312211 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32000f450 con 0x7fe328106f20 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe31effd640 1 -- 172.21.15.59:0/386312211 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe32000fad0 con 0x7fe328106f20 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe31effd640 1 -- 172.21.15.59:0/386312211 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe320018c10 con 0x7fe328106f20 2024-09-10T11:00:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3281a6c50 con 0x7fe328106f20 2024-09-10T11:00:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.851+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3281a7140 con 0x7fe328106f20 2024-09-10T11:00:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.852+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe328062880 con 0x7fe328106f20 2024-09-10T11:00:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.853+0000 7fe31effd640 1 -- 172.21.15.59:0/386312211 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe32000f5f0 con 0x7fe328106f20 2024-09-10T11:00:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.854+0000 7fe31effd640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 0x7fe3140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.854+0000 7fe32d8de640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 0x7fe3140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.854+0000 7fe31effd640 1 -- 172.21.15.59:0/386312211 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe3200cfb20 con 0x7fe328106f20 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.854+0000 7fe31effd640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] conn(0x7fe3140ac8c0 0x7fe3140aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.854+0000 7fe31effd640 1 -- 172.21.15.59:0/386312211 --> [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3140af430 con 0x7fe3140ac8c0 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.854+0000 7fe31effd640 1 -- 172.21.15.59:0/386312211 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe3200cfed0 con 0x7fe328106f20 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.854+0000 7fe32d8de640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 0x7fe3140a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe324005fd0 tx=0x7fe32400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.855+0000 7fe32d0dd640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] conn(0x7fe3140ac8c0 0x7fe3140aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.855+0000 7fe32d0dd640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] conn(0x7fe3140ac8c0 0x7fe3140aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.856+0000 7fe31effd640 1 -- 172.21.15.59:0/386312211 <== osd.11 v2:172.21.15.181:6824/746086660 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3140af430 con 0x7fe3140ac8c0 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.869+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 --> [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe328062c80 con 0x7fe3140ac8c0 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.870+0000 7fe31effd640 1 -- 172.21.15.59:0/386312211 <== osd.11 v2:172.21.15.181:6824/746086660 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe328062c80 con 0x7fe3140ac8c0 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 >> [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] conn(0x7fe3140ac8c0 msgr2=0x7fe3140aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] conn(0x7fe3140ac8c0 0x7fe3140aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 msgr2=0x7fe3140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 0x7fe3140a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe324005fd0 tx=0x7fe32400b390 comp rx=0 tx=0).stop 2024-09-10T11:00:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328106f20 msgr2=0x7fe328074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 --2- 172.21.15.59:0/386312211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328106f20 0x7fe328074f70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe32000cce0 tx=0x7fe32000a620 comp rx=0 tx=0).stop 2024-09-10T11:00:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32e0df640 1 -- 172.21.15.59:0/386312211 reap_dead start 2024-09-10T11:00:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 shutdown_connections 2024-09-10T11:00:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 >> 172.21.15.59:0/386312211 conn(0x7fe3280fd8f0 msgr2=0x7fe3280fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 shutdown_connections 2024-09-10T11:00:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:10.871+0000 7fe32fb42640 1 -- 172.21.15.59:0/386312211 wait complete. 2024-09-10T11:00:14.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:14 smithi059 ceph-mon[30978]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T11:00:14.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:14 smithi181 ceph-mon[35409]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T11:00:14.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:14 smithi115 ceph-mon[34719]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T11:00:15.042 INFO:teuthology.orchestra.run.smithi059.stdout:322122547222 2024-09-10T11:00:15.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T11:00:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.563+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1992435245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be41009b0 msgr2=0x7f3be4100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.563+0000 7f3beb0fc640 1 --2- 172.21.15.59:0/1992435245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be41009b0 0x7f3be4100d90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009900 tx=0x7f3bcc02a410 comp rx=0 tx=0).stop 2024-09-10T11:00:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.563+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1992435245 shutdown_connections 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.563+0000 7f3beb0fc640 1 --2- 172.21.15.59:0/1992435245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3be410e4d0 0x7f3be41108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.563+0000 7f3beb0fc640 1 --2- 172.21.15.59:0/1992435245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be4101360 0x7f3be410df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.563+0000 7f3beb0fc640 1 --2- 172.21.15.59:0/1992435245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be41009b0 0x7f3be4100d90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.563+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1992435245 >> 172.21.15.59:0/1992435245 conn(0x7f3be40fc7d0 msgr2=0x7f3be40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.563+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1992435245 shutdown_connections 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.563+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1992435245 wait complete. 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3beb0fc640 1 Processor -- start 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3beb0fc640 1 -- start start 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3beb0fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3be41009b0 0x7f3be41a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3beb0fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be4101360 0x7f3be41a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3beb0fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be410e4d0 0x7f3be419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3beb0fc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3be4114280 con 0x7f3be410e4d0 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3beb0fc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3be4114100 con 0x7f3be41009b0 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3beb0fc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3be4114400 con 0x7f3be4101360 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be9699640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be410e4d0 0x7f3be419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be9699640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be410e4d0 0x7f3be419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35800/0 (socket says 172.21.15.59:35800) 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be9699640 1 -- 172.21.15.59:0/1968995836 learned_addr learned my addr 172.21.15.59:0/1968995836 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be3fff640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be4101360 0x7f3be41a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be8e98640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3be41009b0 0x7f3be41a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be9699640 1 -- 172.21.15.59:0/1968995836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be4101360 msgr2=0x7f3be41a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be9699640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be4101360 0x7f3be41a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be9699640 1 -- 172.21.15.59:0/1968995836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3be41009b0 msgr2=0x7f3be41a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be9699640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3be41009b0 0x7f3be41a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be9699640 1 -- 172.21.15.59:0/1968995836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be419acc0 con 0x7f3be410e4d0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.564+0000 7f3be8e98640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3be41009b0 0x7f3be41a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.565+0000 7f3be9699640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be410e4d0 0x7f3be419a590 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00d750 tx=0x7f3bdc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.565+0000 7f3be1ffb640 1 -- 172.21.15.59:0/1968995836 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc017070 con 0x7f3be410e4d0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.565+0000 7f3be1ffb640 1 -- 172.21.15.59:0/1968995836 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bdc005500 con 0x7f3be410e4d0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.565+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be419afb0 con 0x7f3be410e4d0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.565+0000 7f3be1ffb640 1 -- 172.21.15.59:0/1968995836 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc004d90 con 0x7f3be410e4d0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.565+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be41a72a0 con 0x7f3be410e4d0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.566+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3be4062940 con 0x7f3be410e4d0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.567+0000 7f3be1ffb640 1 -- 172.21.15.59:0/1968995836 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3bdc004f30 con 0x7f3be410e4d0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.568+0000 7f3be1ffb640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3bd00a2c10 0x7f3bd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.568+0000 7f3be8e98640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3bd00a2c10 0x7f3bd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.568+0000 7f3be1ffb640 1 -- 172.21.15.59:0/1968995836 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f3bdc0ceb60 con 0x7f3be410e4d0 2024-09-10T11:00:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.568+0000 7f3be1ffb640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] conn(0x7f3bd00ac8c0 0x7f3bd00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.568+0000 7f3be1ffb640 1 -- 172.21.15.59:0/1968995836 --> [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bd00af430 con 0x7f3bd00ac8c0 2024-09-10T11:00:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.568+0000 7f3be1ffb640 1 -- 172.21.15.59:0/1968995836 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f3bdc0d3240 con 0x7f3be410e4d0 2024-09-10T11:00:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.568+0000 7f3be3fff640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] conn(0x7f3bd00ac8c0 0x7f3bd00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.568+0000 7f3be8e98640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3bd00a2c10 0x7f3bd00a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc000c00 tx=0x7f3bcc005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.569+0000 7f3be3fff640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] conn(0x7f3bd00ac8c0 0x7f3bd00aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.569+0000 7f3be1ffb640 1 -- 172.21.15.59:0/1968995836 <== osd.6 v2:172.21.15.59:6818/1773461334 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3bd00af430 con 0x7f3bd00ac8c0 2024-09-10T11:00:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.583+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 --> [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3be4062df0 con 0x7f3bd00ac8c0 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.583+0000 7f3be1ffb640 1 -- 172.21.15.59:0/1968995836 <== osd.6 v2:172.21.15.59:6818/1773461334 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3be4062df0 con 0x7f3bd00ac8c0 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] conn(0x7f3bd00ac8c0 msgr2=0x7f3bd00aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] conn(0x7f3bd00ac8c0 0x7f3bd00aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3bd00a2c10 msgr2=0x7f3bd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3bd00a2c10 0x7f3bd00a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc000c00 tx=0x7f3bcc005a40 comp rx=0 tx=0).stop 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be410e4d0 msgr2=0x7f3be419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 --2- 172.21.15.59:0/1968995836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be410e4d0 0x7f3be419a590 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00d750 tx=0x7f3bdc00dc10 comp rx=0 tx=0).stop 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3be9699640 1 -- 172.21.15.59:0/1968995836 reap_dead start 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 shutdown_connections 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 >> 172.21.15.59:0/1968995836 conn(0x7f3be40fc7d0 msgr2=0x7f3be40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 shutdown_connections 2024-09-10T11:00:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.584+0000 7f3beb0fc640 1 -- 172.21.15.59:0/1968995836 wait complete. 2024-09-10T11:00:16.780 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:16 smithi059 ceph-mon[30978]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T11:00:16.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:16 smithi181 ceph-mon[35409]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T11:00:16.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:16 smithi115 ceph-mon[34719]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T11:00:17.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.219+0000 7fa20ba15640 1 -- 172.21.15.59:0/1889960254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa204102ef0 msgr2=0x7fa20410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:17.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.219+0000 7fa20ba15640 1 --2- 172.21.15.59:0/1889960254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa204102ef0 0x7fa20410da40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009ca0 tx=0x7fa1fc02a950 comp rx=0 tx=0).stop 2024-09-10T11:00:17.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.220+0000 7fa20ba15640 1 -- 172.21.15.59:0/1889960254 shutdown_connections 2024-09-10T11:00:17.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.220+0000 7fa20ba15640 1 --2- 172.21.15.59:0/1889960254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa204102ef0 0x7fa20410da40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:17.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.220+0000 7fa20ba15640 1 --2- 172.21.15.59:0/1889960254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa204102570 0x7fa2041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:17.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.220+0000 7fa20ba15640 1 --2- 172.21.15.59:0/1889960254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa204100e20 0x7fa204101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:17.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.220+0000 7fa20ba15640 1 -- 172.21.15.59:0/1889960254 >> 172.21.15.59:0/1889960254 conn(0x7fa2040fc7d0 msgr2=0x7fa2040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:17.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.220+0000 7fa20ba15640 1 -- 172.21.15.59:0/1889960254 shutdown_connections 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.220+0000 7fa20ba15640 1 -- 172.21.15.59:0/1889960254 wait complete. 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.220+0000 7fa20ba15640 1 Processor -- start 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.220+0000 7fa20ba15640 1 -- start start 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa20ba15640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa204100e20 0x7fa2040fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa20ba15640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa204102570 0x7fa2040fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa20ba15640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa204102ef0 0x7fa2040fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa20ba15640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa204110f80 con 0x7fa204100e20 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa20ba15640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa204110e00 con 0x7fa204102ef0 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa20ba15640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa204111100 con 0x7fa204102570 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa2097b1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa204100e20 0x7fa2040fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa2097b1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa204100e20 0x7fa2040fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44466/0 (socket says 172.21.15.59:44466) 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa2097b1640 1 -- 172.21.15.59:0/2465882878 learned_addr learned my addr 172.21.15.59:0/2465882878 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:17.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa208fb0640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa204102570 0x7fa2040fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa209fb2640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa204102ef0 0x7fa2040fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa2097b1640 1 -- 172.21.15.59:0/2465882878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa204102570 msgr2=0x7fa2040fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa2097b1640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa204102570 0x7fa2040fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa2097b1640 1 -- 172.21.15.59:0/2465882878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa204102ef0 msgr2=0x7fa2040fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa2097b1640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa204102ef0 0x7fa2040fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa2097b1640 1 -- 172.21.15.59:0/2465882878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2041a68b0 con 0x7fa204100e20 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa209fb2640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa204102ef0 0x7fa2040fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa2097b1640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa204100e20 0x7fa2040fcc80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c920 tx=0x7fa20000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa1fa7fc640 1 -- 172.21.15.59:0/2465882878 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200007c70 con 0x7fa204100e20 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2041a6ba0 con 0x7fa204100e20 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa1fa7fc640 1 -- 172.21.15.59:0/2465882878 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa200007e10 con 0x7fa204100e20 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.221+0000 7fa1fa7fc640 1 -- 172.21.15.59:0/2465882878 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200018890 con 0x7fa204100e20 2024-09-10T11:00:17.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.222+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2041a70e0 con 0x7fa204100e20 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.222+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa204062940 con 0x7fa204100e20 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.224+0000 7fa1fa7fc640 1 -- 172.21.15.59:0/2465882878 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa200018a50 con 0x7fa204100e20 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.224+0000 7fa1fa7fc640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa1f00a2c10 0x7fa1f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.225+0000 7fa208fb0640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa1f00a2c10 0x7fa1f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.225+0000 7fa1fa7fc640 1 -- 172.21.15.59:0/2465882878 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fa2000cf7c0 con 0x7fa204100e20 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.225+0000 7fa1fa7fc640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] conn(0x7fa1f00ac8c0 0x7fa1f00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.225+0000 7fa1fa7fc640 1 -- 172.21.15.59:0/2465882878 --> [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa200021e50 con 0x7fa1f00ac8c0 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.225+0000 7fa1fa7fc640 1 -- 172.21.15.59:0/2465882878 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa2000cfb70 con 0x7fa204100e20 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.225+0000 7fa208fb0640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa1f00a2c10 0x7fa1f00a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa2040fe710 tx=0x7fa1f400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.225+0000 7fa209fb2640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] conn(0x7fa1f00ac8c0 0x7fa1f00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.226+0000 7fa209fb2640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] conn(0x7fa1f00ac8c0 0x7fa1f00aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.227+0000 7fa1fa7fc640 1 -- 172.21.15.59:0/2465882878 <== osd.7 v2:172.21.15.115:6816/3436962956 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa200021e50 con 0x7fa1f00ac8c0 2024-09-10T11:00:17.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.246+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 --> [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa204062dc0 con 0x7fa1f00ac8c0 2024-09-10T11:00:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.247+0000 7fa1fa7fc640 1 -- 172.21.15.59:0/2465882878 <== osd.7 v2:172.21.15.115:6816/3436962956 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa204062dc0 con 0x7fa1f00ac8c0 2024-09-10T11:00:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 >> [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] conn(0x7fa1f00ac8c0 msgr2=0x7fa1f00aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] conn(0x7fa1f00ac8c0 0x7fa1f00aed60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa1f00a2c10 msgr2=0x7fa1f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa1f00a2c10 0x7fa1f00a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa2040fe710 tx=0x7fa1f400b390 comp rx=0 tx=0).stop 2024-09-10T11:00:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa204100e20 msgr2=0x7fa2040fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 --2- 172.21.15.59:0/2465882878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa204100e20 0x7fa2040fcc80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c920 tx=0x7fa20000cde0 comp rx=0 tx=0).stop 2024-09-10T11:00:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa209fb2640 1 -- 172.21.15.59:0/2465882878 reap_dead start 2024-09-10T11:00:17.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 shutdown_connections 2024-09-10T11:00:17.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 >> 172.21.15.59:0/2465882878 conn(0x7fa2040fc7d0 msgr2=0x7fa20406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:17.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 shutdown_connections 2024-09-10T11:00:17.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:15.248+0000 7fa20ba15640 1 -- 172.21.15.59:0/2465882878 wait complete. 2024-09-10T11:00:17.806 INFO:teuthology.orchestra.run.smithi059.stdout:103079215165 2024-09-10T11:00:17.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T11:00:17.926 INFO:teuthology.orchestra.run.smithi059.stdout:240518168614 2024-09-10T11:00:17.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.779+0000 7fc7efd60640 1 -- 172.21.15.59:0/506432457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8101280 msgr2=0x7fc7e810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.779+0000 7fc7efd60640 1 --2- 172.21.15.59:0/506432457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8101280 0x7fc7e810df40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009900 tx=0x7fc7d802a410 comp rx=0 tx=0).stop 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.779+0000 7fc7efd60640 1 -- 172.21.15.59:0/506432457 shutdown_connections 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.779+0000 7fc7efd60640 1 --2- 172.21.15.59:0/506432457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e810e480 0x7fc7e8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.779+0000 7fc7efd60640 1 --2- 172.21.15.59:0/506432457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8101280 0x7fc7e810df40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.779+0000 7fc7efd60640 1 --2- 172.21.15.59:0/506432457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7e81008d0 0x7fc7e8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.779+0000 7fc7efd60640 1 -- 172.21.15.59:0/506432457 >> 172.21.15.59:0/506432457 conn(0x7fc7e80fc7a0 msgr2=0x7fc7e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.780+0000 7fc7efd60640 1 -- 172.21.15.59:0/506432457 shutdown_connections 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.780+0000 7fc7efd60640 1 -- 172.21.15.59:0/506432457 wait complete. 2024-09-10T11:00:18.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.780+0000 7fc7efd60640 1 Processor -- start 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.780+0000 7fc7efd60640 1 -- start start 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7efd60640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7e81008d0 0x7fc7e819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7efd60640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8101280 0x7fc7e819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7efd60640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e810e480 0x7fc7e819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7efd60640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8114190 con 0x7fc7e8101280 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7efd60640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8114010 con 0x7fc7e81008d0 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7efd60640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8114310 con 0x7fc7e810e480 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ed2fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8101280 0x7fc7e819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ed2fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8101280 0x7fc7e819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35814/0 (socket says 172.21.15.59:35814) 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ed2fb640 1 -- 172.21.15.59:0/2808640991 learned_addr learned my addr 172.21.15.59:0/2808640991 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ee2fd640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e810e480 0x7fc7e819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7edafc640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7e81008d0 0x7fc7e819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ed2fb640 1 -- 172.21.15.59:0/2808640991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e810e480 msgr2=0x7fc7e819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ed2fb640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7e810e480 0x7fc7e819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ed2fb640 1 -- 172.21.15.59:0/2808640991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7e81008d0 msgr2=0x7fc7e819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ed2fb640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7e81008d0 0x7fc7e819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ed2fb640 1 -- 172.21.15.59:0/2808640991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e819f6a0 con 0x7fc7e8101280 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7ed2fb640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8101280 0x7fc7e819ac30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8006010 tx=0x7fc7d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.781+0000 7fc7deffd640 1 -- 172.21.15.59:0/2808640991 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d803f030 con 0x7fc7e8101280 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.782+0000 7fc7deffd640 1 -- 172.21.15.59:0/2808640991 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7d8003ce0 con 0x7fc7e8101280 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.782+0000 7fc7deffd640 1 -- 172.21.15.59:0/2808640991 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8035070 con 0x7fc7e8101280 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.782+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e819f930 con 0x7fc7e8101280 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.782+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e81a7270 con 0x7fc7e8101280 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.782+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7e8062980 con 0x7fc7e8101280 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.784+0000 7fc7deffd640 1 -- 172.21.15.59:0/2808640991 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc7d8042030 con 0x7fc7e8101280 2024-09-10T11:00:18.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.785+0000 7fc7deffd640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc7d40a2c10 0x7fc7d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.785+0000 7fc7edafc640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc7d40a2c10 0x7fc7d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.785+0000 7fc7deffd640 1 -- 172.21.15.59:0/2808640991 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fc7d80eff60 con 0x7fc7e8101280 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.785+0000 7fc7deffd640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] conn(0x7fc7d40ac8c0 0x7fc7d40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.785+0000 7fc7deffd640 1 -- 172.21.15.59:0/2808640991 --> [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7d8040e70 con 0x7fc7d40ac8c0 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.785+0000 7fc7deffd640 1 -- 172.21.15.59:0/2808640991 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc7d80f0310 con 0x7fc7e8101280 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.785+0000 7fc7ee2fd640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] conn(0x7fc7d40ac8c0 0x7fc7d40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.785+0000 7fc7edafc640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc7d40a2c10 0x7fc7d40a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4005fd0 tx=0x7fc7e4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.786+0000 7fc7ee2fd640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] conn(0x7fc7d40ac8c0 0x7fc7d40aed60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.786+0000 7fc7deffd640 1 -- 172.21.15.59:0/2808640991 <== osd.9 v2:172.21.15.59:6826/144353588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7d8040e70 con 0x7fc7d40ac8c0 2024-09-10T11:00:18.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.800+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 --> [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc7e8062e00 con 0x7fc7d40ac8c0 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.800+0000 7fc7deffd640 1 -- 172.21.15.59:0/2808640991 <== osd.9 v2:172.21.15.59:6826/144353588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc7e8062e00 con 0x7fc7d40ac8c0 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] conn(0x7fc7d40ac8c0 msgr2=0x7fc7d40aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] conn(0x7fc7d40ac8c0 0x7fc7d40aed60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc7d40a2c10 msgr2=0x7fc7d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc7d40a2c10 0x7fc7d40a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4005fd0 tx=0x7fc7e4005850 comp rx=0 tx=0).stop 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8101280 msgr2=0x7fc7e819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 --2- 172.21.15.59:0/2808640991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7e8101280 0x7fc7e819ac30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8006010 tx=0x7fc7d80042f0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7ee2fd640 1 -- 172.21.15.59:0/2808640991 reap_dead start 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 shutdown_connections 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 >> 172.21.15.59:0/2808640991 conn(0x7fc7e80fc7a0 msgr2=0x7fc7e80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 shutdown_connections 2024-09-10T11:00:18.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:16.801+0000 7fc7efd60640 1 -- 172.21.15.59:0/2808640991 wait complete. 2024-09-10T11:00:18.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.444+0000 7f603b8c8640 1 -- 172.21.15.59:0/1771632579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6034100480 msgr2=0x7f6034100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.444+0000 7f603b8c8640 1 --2- 172.21.15.59:0/1771632579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6034100480 0x7f6034100860 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6028009900 tx=0x7f602802a410 comp rx=0 tx=0).stop 2024-09-10T11:00:18.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.444+0000 7f603b8c8640 1 -- 172.21.15.59:0/1771632579 shutdown_connections 2024-09-10T11:00:18.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.444+0000 7f603b8c8640 1 --2- 172.21.15.59:0/1771632579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60341055b0 0x7f603410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.444+0000 7f603b8c8640 1 --2- 172.21.15.59:0/1771632579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6034100e30 0x7f6034104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.444+0000 7f603b8c8640 1 --2- 172.21.15.59:0/1771632579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6034100480 0x7f6034100860 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.444+0000 7f603b8c8640 1 -- 172.21.15.59:0/1771632579 >> 172.21.15.59:0/1771632579 conn(0x7f6034077210 msgr2=0x7f60340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 -- 172.21.15.59:0/1771632579 shutdown_connections 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 -- 172.21.15.59:0/1771632579 wait complete. 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 Processor -- start 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 -- start start 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6034100480 0x7f60341985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6034100e30 0x7f6034198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60341055b0 0x7f603419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f60341106b0 con 0x7f60341055b0 2024-09-10T11:00:18.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6034110530 con 0x7f6034100e30 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.445+0000 7f603b8c8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6034110830 con 0x7f6034100480 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039e65640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60341055b0 0x7f603419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039e65640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60341055b0 0x7f603419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35826/0 (socket says 172.21.15.59:35826) 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039e65640 1 -- 172.21.15.59:0/237209840 learned_addr learned my addr 172.21.15.59:0/237209840 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039664640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6034100480 0x7f60341985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6038e63640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6034100e30 0x7f6034198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039e65640 1 -- 172.21.15.59:0/237209840 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6034100480 msgr2=0x7f60341985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039e65640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6034100480 0x7f60341985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039e65640 1 -- 172.21.15.59:0/237209840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6034100e30 msgr2=0x7f6034198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039e65640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6034100e30 0x7f6034198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039e65640 1 -- 172.21.15.59:0/237209840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603419d570 con 0x7f60341055b0 2024-09-10T11:00:18.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6038e63640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6034100e30 0x7f6034198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f6039e65640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60341055b0 0x7f603419ce90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f602c00b970 tx=0x7f602c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f60267fc640 1 -- 172.21.15.59:0/237209840 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c019070 con 0x7f60341055b0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f60267fc640 1 -- 172.21.15.59:0/237209840 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f602c00cb40 con 0x7f60341055b0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603419d860 con 0x7f60341055b0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f60267fc640 1 -- 172.21.15.59:0/237209840 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c007650 con 0x7f60341055b0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.446+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60341a5140 con 0x7f60341055b0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.447+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60341042b0 con 0x7f60341055b0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.449+0000 7f60267fc640 1 -- 172.21.15.59:0/237209840 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f602c01c070 con 0x7f60341055b0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.449+0000 7f60267fc640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60200a2c90 0x7f60200a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.449+0000 7f60267fc640 1 -- 172.21.15.59:0/237209840 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f602c0cef30 con 0x7f60341055b0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.449+0000 7f6039664640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60200a2c90 0x7f60200a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.449+0000 7f60267fc640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] conn(0x7f60200ac940 0x7f60200aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.449+0000 7f60267fc640 1 -- 172.21.15.59:0/237209840 --> [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f602c0047d0 con 0x7f60200ac940 2024-09-10T11:00:18.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.449+0000 7f60267fc640 1 -- 172.21.15.59:0/237209840 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f602c0cf380 con 0x7f60341055b0 2024-09-10T11:00:18.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.450+0000 7f6039664640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60200a2c90 0x7f60200a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f60280096c0 tx=0x7f6028000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:18.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.450+0000 7f6038e63640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] conn(0x7f60200ac940 0x7f60200aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:18.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.450+0000 7f6038e63640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] conn(0x7f60200ac940 0x7f60200aede0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:18.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.451+0000 7f60267fc640 1 -- 172.21.15.59:0/237209840 <== osd.10 v2:172.21.15.115:6824/601478460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f602c0047d0 con 0x7f60200ac940 2024-09-10T11:00:18.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.465+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 --> [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6034101960 con 0x7f60200ac940 2024-09-10T11:00:18.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.465+0000 7f60267fc640 1 -- 172.21.15.59:0/237209840 <== osd.10 v2:172.21.15.115:6824/601478460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6034101960 con 0x7f60200ac940 2024-09-10T11:00:18.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 >> [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] conn(0x7f60200ac940 msgr2=0x7f60200aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] conn(0x7f60200ac940 0x7f60200aede0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60200a2c90 msgr2=0x7f60200a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60200a2c90 0x7f60200a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f60280096c0 tx=0x7f6028000bc0 comp rx=0 tx=0).stop 2024-09-10T11:00:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60341055b0 msgr2=0x7f603419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 --2- 172.21.15.59:0/237209840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60341055b0 0x7f603419ce90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f602c00b970 tx=0x7f602c00be30 comp rx=0 tx=0).stop 2024-09-10T11:00:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f6039e65640 1 -- 172.21.15.59:0/237209840 reap_dead start 2024-09-10T11:00:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 shutdown_connections 2024-09-10T11:00:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 >> 172.21.15.59:0/237209840 conn(0x7f6034077210 msgr2=0x7f6034103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 shutdown_connections 2024-09-10T11:00:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:18.466+0000 7f603b8c8640 1 -- 172.21.15.59:0/237209840 wait complete. 2024-09-10T11:00:18.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:18 smithi059 ceph-mon[30978]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T11:00:18.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:18 smithi181 ceph-mon[35409]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T11:00:18.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:18 smithi115 ceph-mon[34719]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T11:00:19.186 INFO:teuthology.orchestra.run.smithi059.stdout:292057776155 2024-09-10T11:00:19.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T11:00:19.623 INFO:teuthology.orchestra.run.smithi059.stdout:158913790004 2024-09-10T11:00:19.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T11:00:20.115 INFO:teuthology.orchestra.run.smithi059.stdout:270582939680 2024-09-10T11:00:20.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T11:00:20.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:20 smithi059 ceph-mon[30978]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:20.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:20 smithi181 ceph-mon[35409]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:20.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:20 smithi115 ceph-mon[34719]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.034+0000 7fe90edb2640 1 -- 172.21.15.59:0/106154260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908101de0 msgr2=0x7fe9081021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:21.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.034+0000 7fe90edb2640 1 --2- 172.21.15.59:0/106154260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908101de0 0x7fe9081021c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009900 tx=0x7fe8fc02a410 comp rx=0 tx=0).stop 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.034+0000 7fe90edb2640 1 -- 172.21.15.59:0/106154260 shutdown_connections 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.034+0000 7fe90edb2640 1 --2- 172.21.15.59:0/106154260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe908106f10 0x7fe90810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.034+0000 7fe90edb2640 1 --2- 172.21.15.59:0/106154260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe908102790 0x7fe9081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.034+0000 7fe90edb2640 1 --2- 172.21.15.59:0/106154260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908101de0 0x7fe9081021c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.034+0000 7fe90edb2640 1 -- 172.21.15.59:0/106154260 >> 172.21.15.59:0/106154260 conn(0x7fe9080fd8c0 msgr2=0x7fe9080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.034+0000 7fe90edb2640 1 -- 172.21.15.59:0/106154260 shutdown_connections 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.034+0000 7fe90edb2640 1 -- 172.21.15.59:0/106154260 wait complete. 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90edb2640 1 Processor -- start 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90edb2640 1 -- start start 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90edb2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe908101de0 0x7fe9080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90edb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908102790 0x7fe908074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90edb2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe908106f10 0x7fe908074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90edb2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe908111f30 con 0x7fe908102790 2024-09-10T11:00:21.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90edb2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe908111db0 con 0x7fe908106f10 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90edb2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081120b0 con 0x7fe908101de0 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe907fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908102790 0x7fe908074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe907fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908102790 0x7fe908074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35832/0 (socket says 172.21.15.59:35832) 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe907fff640 1 -- 172.21.15.59:0/2258398433 learned_addr learned my addr 172.21.15.59:0/2258398433 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90cb4e640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe908101de0 0x7fe9080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.035+0000 7fe90d34f640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe908106f10 0x7fe908074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe907fff640 1 -- 172.21.15.59:0/2258398433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe908101de0 msgr2=0x7fe9080744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe907fff640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe908101de0 0x7fe9080744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe907fff640 1 -- 172.21.15.59:0/2258398433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe908106f10 msgr2=0x7fe908074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe907fff640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe908106f10 0x7fe908074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe907fff640 1 -- 172.21.15.59:0/2258398433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9081a67d0 con 0x7fe908102790 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe90d34f640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe908106f10 0x7fe908074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe907fff640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908102790 0x7fe908074a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400c920 tx=0x7fe8f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:21.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe905ffb640 1 -- 172.21.15.59:0/2258398433 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4007c70 con 0x7fe908102790 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9081a6ac0 con 0x7fe908102790 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe905ffb640 1 -- 172.21.15.59:0/2258398433 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8f4007e10 con 0x7fe908102790 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe905ffb640 1 -- 172.21.15.59:0/2258398433 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4018890 con 0x7fe908102790 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.036+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9081a7000 con 0x7fe908102790 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.037+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9080feee0 con 0x7fe908102790 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.038+0000 7fe905ffb640 1 -- 172.21.15.59:0/2258398433 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe8f4018a30 con 0x7fe908102790 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.039+0000 7fe905ffb640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8f80a2c10 0x7fe8f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.039+0000 7fe905ffb640 1 -- 172.21.15.59:0/2258398433 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe8f40cf760 con 0x7fe908102790 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.039+0000 7fe90cb4e640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8f80a2c10 0x7fe8f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.039+0000 7fe905ffb640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] conn(0x7fe8f80ac8c0 0x7fe8f80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.039+0000 7fe905ffb640 1 -- 172.21.15.59:0/2258398433 --> [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8f80af430 con 0x7fe8f80ac8c0 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.039+0000 7fe905ffb640 1 -- 172.21.15.59:0/2258398433 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe8f40cfbb0 con 0x7fe908102790 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.039+0000 7fe90d34f640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] conn(0x7fe8f80ac8c0 0x7fe8f80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:21.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.040+0000 7fe90cb4e640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8f80a2c10 0x7fe8f80a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc000c00 tx=0x7fe8fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:21.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.040+0000 7fe90d34f640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] conn(0x7fe8f80ac8c0 0x7fe8f80aed60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:21.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.040+0000 7fe905ffb640 1 -- 172.21.15.59:0/2258398433 <== osd.0 v2:172.21.15.59:6802/1643826067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8f80af430 con 0x7fe8f80ac8c0 2024-09-10T11:00:21.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.054+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 --> [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe9081032c0 con 0x7fe8f80ac8c0 2024-09-10T11:00:21.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.054+0000 7fe905ffb640 1 -- 172.21.15.59:0/2258398433 <== osd.0 v2:172.21.15.59:6802/1643826067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe9081032c0 con 0x7fe8f80ac8c0 2024-09-10T11:00:21.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] conn(0x7fe8f80ac8c0 msgr2=0x7fe8f80aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] conn(0x7fe8f80ac8c0 0x7fe8f80aed60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8f80a2c10 msgr2=0x7fe8f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe8f80a2c10 0x7fe8f80a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc000c00 tx=0x7fe8fc0058d0 comp rx=0 tx=0).stop 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908102790 msgr2=0x7fe908074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 --2- 172.21.15.59:0/2258398433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908102790 0x7fe908074a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400c920 tx=0x7fe8f400cde0 comp rx=0 tx=0).stop 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90d34f640 1 -- 172.21.15.59:0/2258398433 reap_dead start 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 shutdown_connections 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 >> 172.21.15.59:0/2258398433 conn(0x7fe9080fd8c0 msgr2=0x7fe9080ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 shutdown_connections 2024-09-10T11:00:21.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:21.055+0000 7fe90edb2640 1 -- 172.21.15.59:0/2258398433 wait complete. 2024-09-10T11:00:21.392 INFO:teuthology.orchestra.run.smithi059.stdout:188978561072 2024-09-10T11:00:21.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T11:00:22.091 INFO:teuthology.orchestra.run.smithi059.stdout:34359738447 2024-09-10T11:00:22.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T11:00:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:22.154 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:22.840 INFO:teuthology.orchestra.run.smithi059.stdout:210453397546 2024-09-10T11:00:22.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T11:00:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:22 smithi059 ceph-mon[30978]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:22.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:22 smithi181 ceph-mon[35409]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:22.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:22 smithi115 ceph-mon[34719]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:24.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.171+0000 7fd43a576640 1 -- 172.21.15.59:0/1567911431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434101df0 msgr2=0x7fd4341021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.171+0000 7fd43a576640 1 --2- 172.21.15.59:0/1567911431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434101df0 0x7fd4341021d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd424009900 tx=0x7fd42402a410 comp rx=0 tx=0).stop 2024-09-10T11:00:24.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.171+0000 7fd43a576640 1 -- 172.21.15.59:0/1567911431 shutdown_connections 2024-09-10T11:00:24.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.171+0000 7fd43a576640 1 --2- 172.21.15.59:0/1567911431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd434106f20 0x7fd43410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.171+0000 7fd43a576640 1 --2- 172.21.15.59:0/1567911431 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4341027a0 0x7fd4341067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.171+0000 7fd43a576640 1 --2- 172.21.15.59:0/1567911431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434101df0 0x7fd4341021d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.171+0000 7fd43a576640 1 -- 172.21.15.59:0/1567911431 >> 172.21.15.59:0/1567911431 conn(0x7fd4340fd8f0 msgr2=0x7fd4340ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.171+0000 7fd43a576640 1 -- 172.21.15.59:0/1567911431 shutdown_connections 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.171+0000 7fd43a576640 1 -- 172.21.15.59:0/1567911431 wait complete. 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd43a576640 1 Processor -- start 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd43a576640 1 -- start start 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd43a576640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd434101df0 0x7fd4341985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd43a576640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4341027a0 0x7fd434198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd43a576640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434106f20 0x7fd43419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd43a576640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd434112020 con 0x7fd434106f20 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd43a576640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd434111ea0 con 0x7fd434101df0 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd43a576640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd4341121a0 con 0x7fd4341027a0 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd438b13640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434106f20 0x7fd43419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd438b13640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434106f20 0x7fd43419ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35860/0 (socket says 172.21.15.59:35860) 2024-09-10T11:00:24.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd438b13640 1 -- 172.21.15.59:0/2563199362 learned_addr learned my addr 172.21.15.59:0/2563199362 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd433fff640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd434101df0 0x7fd4341985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd42bfff640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4341027a0 0x7fd434198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd438b13640 1 -- 172.21.15.59:0/2563199362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4341027a0 msgr2=0x7fd434198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd438b13640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4341027a0 0x7fd434198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd438b13640 1 -- 172.21.15.59:0/2563199362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd434101df0 msgr2=0x7fd4341985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd438b13640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd434101df0 0x7fd4341985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.172+0000 7fd438b13640 1 -- 172.21.15.59:0/2563199362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43419d550 con 0x7fd434106f20 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.173+0000 7fd438b13640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434106f20 0x7fd43419ce70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b970 tx=0x7fd42c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.173+0000 7fd431ffb640 1 -- 172.21.15.59:0/2563199362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c019070 con 0x7fd434106f20 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.173+0000 7fd431ffb640 1 -- 172.21.15.59:0/2563199362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd42c014440 con 0x7fd434106f20 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.173+0000 7fd431ffb640 1 -- 172.21.15.59:0/2563199362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0075d0 con 0x7fd434106f20 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.173+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43419d840 con 0x7fd434106f20 2024-09-10T11:00:24.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.173+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4341a5120 con 0x7fd434106f20 2024-09-10T11:00:24.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.174+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd434102250 con 0x7fd434106f20 2024-09-10T11:00:24.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.175+0000 7fd431ffb640 1 -- 172.21.15.59:0/2563199362 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd42c01c070 con 0x7fd434106f20 2024-09-10T11:00:24.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.176+0000 7fd431ffb640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd4200a2c10 0x7fd4200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.176+0000 7fd433fff640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd4200a2c10 0x7fd4200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.176+0000 7fd431ffb640 1 -- 172.21.15.59:0/2563199362 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fd42c0ce680 con 0x7fd434106f20 2024-09-10T11:00:24.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.176+0000 7fd433fff640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd4200a2c10 0x7fd4200a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd424000c00 tx=0x7fd4240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:24.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.180+0000 7fd431ffb640 1 -- 172.21.15.59:0/2563199362 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd42c09af20 con 0x7fd434106f20 2024-09-10T11:00:24.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.359+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd434109b70 con 0x7fd434106f20 2024-09-10T11:00:24.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.359+0000 7fd431ffb640 1 -- 172.21.15.59:0/2563199362 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd42c09f220 con 0x7fd434106f20 2024-09-10T11:00:24.360 INFO:teuthology.orchestra.run.smithi059.stdout:322122547224 2024-09-10T11:00:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd4200a2c10 msgr2=0x7fd4200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd4200a2c10 0x7fd4200a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd424000c00 tx=0x7fd4240058d0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434106f20 msgr2=0x7fd43419ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434106f20 0x7fd43419ce70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b970 tx=0x7fd42c00bd70 comp rx=0 tx=0).stop 2024-09-10T11:00:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 shutdown_connections 2024-09-10T11:00:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd4200a2c10 0x7fd4200a50d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd434106f20 0x7fd43419ce70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4341027a0 0x7fd434198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 --2- 172.21.15.59:0/2563199362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd434101df0 0x7fd4341985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 >> 172.21.15.59:0/2563199362 conn(0x7fd4340fd8f0 msgr2=0x7fd4340fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 shutdown_connections 2024-09-10T11:00:24.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.361+0000 7fd43a576640 1 -- 172.21.15.59:0/2563199362 wait complete. 2024-09-10T11:00:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.513+0000 7f30f892a640 1 -- 172.21.15.59:0/3847483657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4101df0 msgr2=0x7f30f41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.513+0000 7f30f892a640 1 --2- 172.21.15.59:0/3847483657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4101df0 0x7f30f41021d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009ca0 tx=0x7f30e402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.513+0000 7f30f892a640 1 -- 172.21.15.59:0/3847483657 shutdown_connections 2024-09-10T11:00:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.513+0000 7f30f892a640 1 --2- 172.21.15.59:0/3847483657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f4106f20 0x7f30f410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.513+0000 7f30f892a640 1 --2- 172.21.15.59:0/3847483657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f41027a0 0x7f30f41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.513+0000 7f30f892a640 1 --2- 172.21.15.59:0/3847483657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4101df0 0x7f30f41021d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.513+0000 7f30f892a640 1 -- 172.21.15.59:0/3847483657 >> 172.21.15.59:0/3847483657 conn(0x7f30f40fd8f0 msgr2=0x7f30f40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.513+0000 7f30f892a640 1 -- 172.21.15.59:0/3847483657 shutdown_connections 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.513+0000 7f30f892a640 1 -- 172.21.15.59:0/3847483657 wait complete. 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f892a640 1 Processor -- start 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f892a640 1 -- start start 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f892a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f4101df0 0x7f30f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f892a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f41027a0 0x7f30f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f892a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4106f20 0x7f30f4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f892a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4112020 con 0x7f30f4106f20 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f892a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4111ea0 con 0x7f30f4101df0 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f892a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f30f41121a0 con 0x7f30f41027a0 2024-09-10T11:00:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f2d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4106f20 0x7f30f4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f2d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4106f20 0x7f30f4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35880/0 (socket says 172.21.15.59:35880) 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f2d9d640 1 -- 172.21.15.59:0/2047689816 learned_addr learned my addr 172.21.15.59:0/2047689816 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f259c640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f4101df0 0x7f30f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f1d9b640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f41027a0 0x7f30f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f2d9d640 1 -- 172.21.15.59:0/2047689816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f41027a0 msgr2=0x7f30f4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f2d9d640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f41027a0 0x7f30f4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f2d9d640 1 -- 172.21.15.59:0/2047689816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f4101df0 msgr2=0x7f30f40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f2d9d640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f4101df0 0x7f30f40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f2d9d640 1 -- 172.21.15.59:0/2047689816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f41a6b30 con 0x7f30f4106f20 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f259c640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f4101df0 0x7f30f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.514+0000 7f30f1d9b640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f41027a0 0x7f30f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.515+0000 7f30f2d9d640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4106f20 0x7f30f4074f70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009fd0 tx=0x7f30ec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.515+0000 7f30eb7fe640 1 -- 172.21.15.59:0/2047689816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec011830 con 0x7f30f4106f20 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.515+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f41a6e20 con 0x7f30f4106f20 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.515+0000 7f30eb7fe640 1 -- 172.21.15.59:0/2047689816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30ec016070 con 0x7f30f4106f20 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.515+0000 7f30eb7fe640 1 -- 172.21.15.59:0/2047689816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec00f2e0 con 0x7f30f4106f20 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.515+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f41a72e0 con 0x7f30f4106f20 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.516+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f4102250 con 0x7f30f4106f20 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.517+0000 7f30eb7fe640 1 -- 172.21.15.59:0/2047689816 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f30ec0119d0 con 0x7f30f4106f20 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.518+0000 7f30eb7fe640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e00a2c10 0x7f30e00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.518+0000 7f30f259c640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e00a2c10 0x7f30e00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.518+0000 7f30eb7fe640 1 -- 172.21.15.59:0/2047689816 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f30ec0cef00 con 0x7f30f4106f20 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.518+0000 7f30f259c640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e00a2c10 0x7f30e00a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f30e402f540 tx=0x7f30e40099a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.521+0000 7f30eb7fe640 1 -- 172.21.15.59:0/2047689816 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30ec09bd90 con 0x7f30f4106f20 2024-09-10T11:00:24.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.698+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f30f410a100 con 0x7f30f4106f20 2024-09-10T11:00:24.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.699+0000 7f30eb7fe640 1 -- 172.21.15.59:0/2047689816 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30ec09b690 con 0x7f30f4106f20 2024-09-10T11:00:24.699 INFO:teuthology.orchestra.run.smithi059.stdout:77309411396 2024-09-10T11:00:24.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e00a2c10 msgr2=0x7f30e00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e00a2c10 0x7f30e00a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f30e402f540 tx=0x7f30e40099a0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4106f20 msgr2=0x7f30f4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4106f20 0x7f30f4074f70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009fd0 tx=0x7f30ec00b8e0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 shutdown_connections 2024-09-10T11:00:24.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e00a2c10 0x7f30e00a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f4106f20 0x7f30f4074f70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f41027a0 0x7f30f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 --2- 172.21.15.59:0/2047689816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f4101df0 0x7f30f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 >> 172.21.15.59:0/2047689816 conn(0x7f30f40fd8f0 msgr2=0x7f30f40fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:24.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 shutdown_connections 2024-09-10T11:00:24.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.701+0000 7f30f892a640 1 -- 172.21.15.59:0/2047689816 wait complete. 2024-09-10T11:00:24.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 -- 172.21.15.59:0/1426069864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793010e490 msgr2=0x7f7930110880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 --2- 172.21.15.59:0/1426069864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793010e490 0x7f7930110880 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7928009ca0 tx=0x7f792802a8c0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 -- 172.21.15.59:0/1426069864 shutdown_connections 2024-09-10T11:00:24.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 --2- 172.21.15.59:0/1426069864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793010e490 0x7f7930110880 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 --2- 172.21.15.59:0/1426069864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7930101290 0x7f793010df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 --2- 172.21.15.59:0/1426069864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79301008e0 0x7f7930100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 -- 172.21.15.59:0/1426069864 >> 172.21.15.59:0/1426069864 conn(0x7f79300fc7d0 msgr2=0x7f79300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 -- 172.21.15.59:0/1426069864 shutdown_connections 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 -- 172.21.15.59:0/1426069864 wait complete. 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 Processor -- start 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.735+0000 7f7937e6c640 1 -- start start 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7937e6c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79301008e0 0x7f793019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7937e6c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7930101290 0x7f793019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7937e6c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793010e490 0x7f793019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7937e6c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7930114190 con 0x7f7930101290 2024-09-10T11:00:24.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7937e6c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7930114010 con 0x7f79301008e0 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7937e6c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7930114310 con 0x7f793010e490 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935407640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7930101290 0x7f793019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935407640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7930101290 0x7f793019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35894/0 (socket says 172.21.15.59:35894) 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935407640 1 -- 172.21.15.59:0/3851579039 learned_addr learned my addr 172.21.15.59:0/3851579039 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935c08640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79301008e0 0x7f793019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7936409640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793010e490 0x7f793019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935407640 1 -- 172.21.15.59:0/3851579039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793010e490 msgr2=0x7f793019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935407640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793010e490 0x7f793019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935407640 1 -- 172.21.15.59:0/3851579039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79301008e0 msgr2=0x7f793019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935407640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79301008e0 0x7f793019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935407640 1 -- 172.21.15.59:0/3851579039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793019f5e0 con 0x7f7930101290 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7935407640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7930101290 0x7f793019ab70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f792000d770 tx=0x7f792000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7926ffd640 1 -- 172.21.15.59:0/3851579039 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920017070 con 0x7f7930101290 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7926ffd640 1 -- 172.21.15.59:0/3851579039 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7920005500 con 0x7f7930101290 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793019f8d0 con 0x7f7930101290 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.736+0000 7f7926ffd640 1 -- 172.21.15.59:0/3851579039 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920004e00 con 0x7f7930101290 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.737+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79301a71b0 con 0x7f7930101290 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.738+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7930100cc0 con 0x7f7930101290 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.739+0000 7f7926ffd640 1 -- 172.21.15.59:0/3851579039 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7920004fa0 con 0x7f7930101290 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.739+0000 7f7926ffd640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f791c0a2c10 0x7f791c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.739+0000 7f7935c08640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f791c0a2c10 0x7f791c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.739+0000 7f7926ffd640 1 -- 172.21.15.59:0/3851579039 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f79200cec10 con 0x7f7930101290 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.740+0000 7f7935c08640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f791c0a2c10 0x7f791c0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f792c00bbe0 tx=0x7f792c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.743+0000 7f7926ffd640 1 -- 172.21.15.59:0/3851579039 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f792009b9f0 con 0x7f7930101290 2024-09-10T11:00:24.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:24 smithi059 ceph-mon[30978]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:24 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2563199362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T11:00:24.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.919+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7930109620 con 0x7f7930101290 2024-09-10T11:00:24.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.920+0000 7f7926ffd640 1 -- 172.21.15.59:0/3851579039 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f792009b2f0 con 0x7f7930101290 2024-09-10T11:00:24.921 INFO:teuthology.orchestra.run.smithi059.stdout:137438953531 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f791c0a2c10 msgr2=0x7f791c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f791c0a2c10 0x7f791c0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f792c00bbe0 tx=0x7f792c00b390 comp rx=0 tx=0).stop 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7930101290 msgr2=0x7f793019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7930101290 0x7f793019ab70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f792000d770 tx=0x7f792000dc30 comp rx=0 tx=0).stop 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 shutdown_connections 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f791c0a2c10 0x7f791c0a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f793010e490 0x7f793019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7930101290 0x7f793019ab70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 --2- 172.21.15.59:0/3851579039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79301008e0 0x7f793019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 >> 172.21.15.59:0/3851579039 conn(0x7f79300fc7d0 msgr2=0x7f79300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 shutdown_connections 2024-09-10T11:00:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:24.922+0000 7f7937e6c640 1 -- 172.21.15.59:0/3851579039 wait complete. 2024-09-10T11:00:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:24 smithi181 ceph-mon[35409]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:24.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:24 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2563199362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T11:00:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:24 smithi115 ceph-mon[34719]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:24 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2563199362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T11:00:25.719 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953529 got 137438953531 for osd.4 2024-09-10T11:00:25.719 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:25.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:25 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2047689816' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T11:00:25.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:25 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3851579039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T11:00:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:25 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2047689816' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T11:00:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:25 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3851579039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T11:00:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:25 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2047689816' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T11:00:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:25 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3851579039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T11:00:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 -- 172.21.15.59:0/2199068933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 msgr2=0x7fa8cc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2199068933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 0x7fa8cc1029b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009900 tx=0x7fa8c002a480 comp rx=0 tx=0).stop 2024-09-10T11:00:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 -- 172.21.15.59:0/2199068933 shutdown_connections 2024-09-10T11:00:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2199068933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8cc102ef0 0x7fa8cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2199068933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 0x7fa8cc1029b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2199068933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8cc100e20 0x7fa8cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 -- 172.21.15.59:0/2199068933 >> 172.21.15.59:0/2199068933 conn(0x7fa8cc0fc7d0 msgr2=0x7fa8cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 -- 172.21.15.59:0/2199068933 shutdown_connections 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 -- 172.21.15.59:0/2199068933 wait complete. 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.015+0000 7fa8d1272640 1 Processor -- start 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8d1272640 1 -- start start 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8d1272640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8cc100e20 0x7fa8cc1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8d1272640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 0x7fa8cc198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8d1272640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8cc102ef0 0x7fa8cc19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8d1272640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc1120a0 con 0x7fa8cc102570 2024-09-10T11:00:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8d1272640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc111f20 con 0x7fa8cc102ef0 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8d1272640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc112220 con 0x7fa8cc100e20 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8ca7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 0x7fa8cc198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8ca7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 0x7fa8cc198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35928/0 (socket says 172.21.15.59:35928) 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8ca7fc640 1 -- 172.21.15.59:0/2297975936 learned_addr learned my addr 172.21.15.59:0/2297975936 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8cb7fe640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8cc102ef0 0x7fa8cc19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8caffd640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8cc100e20 0x7fa8cc1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8ca7fc640 1 -- 172.21.15.59:0/2297975936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8cc100e20 msgr2=0x7fa8cc1985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8ca7fc640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8cc100e20 0x7fa8cc1985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8ca7fc640 1 -- 172.21.15.59:0/2297975936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8cc102ef0 msgr2=0x7fa8cc19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8ca7fc640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8cc102ef0 0x7fa8cc19ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8ca7fc640 1 -- 172.21.15.59:0/2297975936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8cc19d590 con 0x7fa8cc102570 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.016+0000 7fa8ca7fc640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 0x7fa8cc198b20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0006010 tx=0x7fa8c0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.017+0000 7fa8b3fff640 1 -- 172.21.15.59:0/2297975936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c003f070 con 0x7fa8cc102570 2024-09-10T11:00:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.017+0000 7fa8b3fff640 1 -- 172.21.15.59:0/2297975936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8c0031c30 con 0x7fa8cc102570 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.017+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8cc19d820 con 0x7fa8cc102570 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.017+0000 7fa8b3fff640 1 -- 172.21.15.59:0/2297975936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0035030 con 0x7fa8cc102570 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.017+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8cc1a5160 con 0x7fa8cc102570 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.018+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8cc1021b0 con 0x7fa8cc102570 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.020+0000 7fa8b3fff640 1 -- 172.21.15.59:0/2297975936 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa8c0042070 con 0x7fa8cc102570 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.020+0000 7fa8b3fff640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.020+0000 7fa8caffd640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.020+0000 7fa8b3fff640 1 -- 172.21.15.59:0/2297975936 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fa8c00efe70 con 0x7fa8cc102570 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.021+0000 7fa8caffd640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc005fd0 tx=0x7fa8bc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.023+0000 7fa8b3fff640 1 -- 172.21.15.59:0/2297975936 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8c0031de0 con 0x7fa8cc102570 2024-09-10T11:00:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.201+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa8cc101200 con 0x7fa8cc102570 2024-09-10T11:00:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.202+0000 7fa8b3fff640 1 -- 172.21.15.59:0/2297975936 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8cc101200 con 0x7fa8cc102570 2024-09-10T11:00:26.203 INFO:teuthology.orchestra.run.smithi059.stdout:55834574921 2024-09-10T11:00:26.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa8b40a2c10 msgr2=0x7fa8b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc005fd0 tx=0x7fa8bc005850 comp rx=0 tx=0).stop 2024-09-10T11:00:26.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 msgr2=0x7fa8cc198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 0x7fa8cc198b20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0006010 tx=0x7fa8c0003c10 comp rx=0 tx=0).stop 2024-09-10T11:00:26.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 shutdown_connections 2024-09-10T11:00:26.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8cc102ef0 0x7fa8cc19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8cc102570 0x7fa8cc198b20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 --2- 172.21.15.59:0/2297975936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8cc100e20 0x7fa8cc1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 >> 172.21.15.59:0/2297975936 conn(0x7fa8cc0fc7d0 msgr2=0x7fa8cc106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:26.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 shutdown_connections 2024-09-10T11:00:26.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.204+0000 7fa8d1272640 1 -- 172.21.15.59:0/2297975936 wait complete. 2024-09-10T11:00:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.908+0000 7efc3a4d8640 1 -- 172.21.15.59:0/2396715909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34106f10 msgr2=0x7efc3410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.908+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/2396715909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34106f10 0x7efc3410ea90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009ca0 tx=0x7efc2c02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.908+0000 7efc3a4d8640 1 -- 172.21.15.59:0/2396715909 shutdown_connections 2024-09-10T11:00:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.908+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/2396715909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34106f10 0x7efc3410ea90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.908+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/2396715909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc34102790 0x7efc341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.908+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/2396715909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc34101de0 0x7efc341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.908+0000 7efc3a4d8640 1 -- 172.21.15.59:0/2396715909 >> 172.21.15.59:0/2396715909 conn(0x7efc340fd8c0 msgr2=0x7efc340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.908+0000 7efc3a4d8640 1 -- 172.21.15.59:0/2396715909 shutdown_connections 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.908+0000 7efc3a4d8640 1 -- 172.21.15.59:0/2396715909 wait complete. 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.909+0000 7efc3a4d8640 1 Processor -- start 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.909+0000 7efc3a4d8640 1 -- start start 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.909+0000 7efc3a4d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc34101de0 0x7efc340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.909+0000 7efc3a4d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34102790 0x7efc34074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.909+0000 7efc3a4d8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc34106f10 0x7efc34074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.909+0000 7efc3a4d8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc34112010 con 0x7efc34102790 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.909+0000 7efc3a4d8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efc34111e90 con 0x7efc34106f10 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.909+0000 7efc3a4d8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efc34112190 con 0x7efc34101de0 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34102790 0x7efc34074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34102790 0x7efc34074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35912/0 (socket says 172.21.15.59:35912) 2024-09-10T11:00:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc337fe640 1 -- 172.21.15.59:0/635283877 learned_addr learned my addr 172.21.15.59:0/635283877 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:26.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc33fff640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc34101de0 0x7efc340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:26.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc38a75640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc34106f10 0x7efc34074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:26.370 INFO:teuthology.orchestra.run.smithi059.stdout:292057776157 2024-09-10T11:00:26.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc337fe640 1 -- 172.21.15.59:0/635283877 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc34101de0 msgr2=0x7efc340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc337fe640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc34101de0 0x7efc340744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc337fe640 1 -- 172.21.15.59:0/635283877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc34106f10 msgr2=0x7efc34074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc337fe640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc34106f10 0x7efc34074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc337fe640 1 -- 172.21.15.59:0/635283877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc341a6a50 con 0x7efc34102790 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc337fe640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34102790 0x7efc34074a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efc2800b4a0 tx=0x7efc2800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc317fa640 1 -- 172.21.15.59:0/635283877 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28015020 con 0x7efc34102790 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc317fa640 1 -- 172.21.15.59:0/635283877 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc28011d10 con 0x7efc34102790 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc341a6d40 con 0x7efc34102790 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc317fa640 1 -- 172.21.15.59:0/635283877 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2800f2e0 con 0x7efc34102790 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.910+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc341a71d0 con 0x7efc34102790 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.911+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc34102240 con 0x7efc34102790 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.912+0000 7efc317fa640 1 -- 172.21.15.59:0/635283877 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efc28018020 con 0x7efc34102790 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.913+0000 7efc317fa640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efc1c0a2c10 0x7efc1c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.914+0000 7efc33fff640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efc1c0a2c10 0x7efc1c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.914+0000 7efc317fa640 1 -- 172.21.15.59:0/635283877 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7efc280ce9e0 con 0x7efc34102790 2024-09-10T11:00:26.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.914+0000 7efc33fff640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efc1c0a2c10 0x7efc1c0a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efc24009990 tx=0x7efc24009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:25.918+0000 7efc317fa640 1 -- 172.21.15.59:0/635283877 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc2801f020 con 0x7efc34102790 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.101+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7efc3410a0f0 con 0x7efc34102790 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.102+0000 7efc317fa640 1 -- 172.21.15.59:0/635283877 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7efc2809b870 con 0x7efc34102790 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efc1c0a2c10 msgr2=0x7efc1c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efc1c0a2c10 0x7efc1c0a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efc24009990 tx=0x7efc24009110 comp rx=0 tx=0).stop 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34102790 msgr2=0x7efc34074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34102790 0x7efc34074a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efc2800b4a0 tx=0x7efc2800b8a0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 shutdown_connections 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7efc1c0a2c10 0x7efc1c0a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc34106f10 0x7efc34074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34102790 0x7efc34074a30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 --2- 172.21.15.59:0/635283877 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc34101de0 0x7efc340744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 >> 172.21.15.59:0/635283877 conn(0x7efc340fd8c0 msgr2=0x7efc340fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:26.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 shutdown_connections 2024-09-10T11:00:26.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:26.104+0000 7efc3a4d8640 1 -- 172.21.15.59:0/635283877 wait complete. 2024-09-10T11:00:26.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:26 smithi059 ceph-mon[30978]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:26 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/635283877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T11:00:26.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:26 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2297975936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T11:00:26.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:26 smithi181 ceph-mon[35409]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:26.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:26 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/635283877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T11:00:26.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:26 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2297975936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T11:00:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:26 smithi115 ceph-mon[34719]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:26 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/635283877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T11:00:26.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:26 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2297975936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T11:00:27.023 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411396 for osd.2 2024-09-10T11:00:27.023 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:27.484 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547222 got 322122547224 for osd.11 2024-09-10T11:00:27.484 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:27.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:27 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:00:27.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:27 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:00:27.939 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:27 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:00:27.965 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776155 got 292057776157 for osd.10 2024-09-10T11:00:27.965 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:28.161 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:28.635 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574918 got 55834574921 for osd.1 2024-09-10T11:00:28.635 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:28.652 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:28.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:28 smithi059 ceph-mon[30978]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:28.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:28.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:28 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:28.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:28 smithi181 ceph-mon[35409]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:28.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:28.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:28 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:28.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:28 smithi115 ceph-mon[34719]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:28.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:28.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:28 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:29.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 -- 172.21.15.59:0/2224160228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 msgr2=0x7fb1d810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:29.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/2224160228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 0x7fb1d810d950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009930 tx=0x7fb1d002a420 comp rx=0 tx=0).stop 2024-09-10T11:00:29.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 -- 172.21.15.59:0/2224160228 shutdown_connections 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/2224160228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 0x7fb1d810d950 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/2224160228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1d8100a80 0x7fb1d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/2224160228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d8106a80 0x7fb1d8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 -- 172.21.15.59:0/2224160228 >> 172.21.15.59:0/2224160228 conn(0x7fb1d80fc7a0 msgr2=0x7fb1d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 -- 172.21.15.59:0/2224160228 shutdown_connections 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 -- 172.21.15.59:0/2224160228 wait complete. 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.624+0000 7fb1de0d0640 1 Processor -- start 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1de0d0640 1 -- start start 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1de0d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1d8100a80 0x7fb1d80fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1de0d0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 0x7fb1d80fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1de0d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d8106a80 0x7fb1d80fd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1de0d0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d8110ea0 con 0x7fb1d8101420 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1de0d0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d8110d20 con 0x7fb1d8106a80 2024-09-10T11:00:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1de0d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d8111020 con 0x7fb1d8100a80 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 0x7fb1d80fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 0x7fb1d80fd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60412/0 (socket says 172.21.15.59:60412) 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d6ffd640 1 -- 172.21.15.59:0/386778825 learned_addr learned my addr 172.21.15.59:0/386778825 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d77fe640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1d8100a80 0x7fb1d80fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d7fff640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d8106a80 0x7fb1d80fd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d6ffd640 1 -- 172.21.15.59:0/386778825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1d8100a80 msgr2=0x7fb1d80fcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d6ffd640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1d8100a80 0x7fb1d80fcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d6ffd640 1 -- 172.21.15.59:0/386778825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d8106a80 msgr2=0x7fb1d80fd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d6ffd640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d8106a80 0x7fb1d80fd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.625+0000 7fb1d6ffd640 1 -- 172.21.15.59:0/386778825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d81a6900 con 0x7fb1d8101420 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.626+0000 7fb1d6ffd640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 0x7fb1d80fd2e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000b4a0 tx=0x7fb1c000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.626+0000 7fb1d4ff9640 1 -- 172.21.15.59:0/386778825 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0014070 con 0x7fb1d8101420 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.626+0000 7fb1d4ff9640 1 -- 172.21.15.59:0/386778825 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1c0010af0 con 0x7fb1d8101420 2024-09-10T11:00:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.626+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d81a6bf0 con 0x7fb1d8101420 2024-09-10T11:00:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.626+0000 7fb1d4ff9640 1 -- 172.21.15.59:0/386778825 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0017d10 con 0x7fb1d8101420 2024-09-10T11:00:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.626+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d81a70e0 con 0x7fb1d8101420 2024-09-10T11:00:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.627+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d8100ee0 con 0x7fb1d8101420 2024-09-10T11:00:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.628+0000 7fb1d4ff9640 1 -- 172.21.15.59:0/386778825 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb1c0017070 con 0x7fb1d8101420 2024-09-10T11:00:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.629+0000 7fb1d4ff9640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb1c40a2c10 0x7fb1c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.629+0000 7fb1d77fe640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb1c40a2c10 0x7fb1c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.629+0000 7fb1d4ff9640 1 -- 172.21.15.59:0/386778825 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fb1c00ce7a0 con 0x7fb1d8101420 2024-09-10T11:00:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.629+0000 7fb1d77fe640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb1c40a2c10 0x7fb1c40a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8005fd0 tx=0x7fb1c8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.632+0000 7fb1d4ff9640 1 -- 172.21.15.59:0/386778825 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1c009b040 con 0x7fb1d8101420 2024-09-10T11:00:29.793 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:29 smithi059 ceph-mon[30978]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-10T11:00:29.793 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:29 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:29.793 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:29 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:29.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.812+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fb1d80fe2d0 con 0x7fb1d8101420 2024-09-10T11:00:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.812+0000 7fb1d4ff9640 1 -- 172.21.15.59:0/386778825 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb1d80fe2d0 con 0x7fb1d8101420 2024-09-10T11:00:29.813 INFO:teuthology.orchestra.run.smithi059.stdout:270582939683 2024-09-10T11:00:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb1c40a2c10 msgr2=0x7fb1c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb1c40a2c10 0x7fb1c40a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8005fd0 tx=0x7fb1c8009680 comp rx=0 tx=0).stop 2024-09-10T11:00:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 msgr2=0x7fb1d80fd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 0x7fb1d80fd2e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000b4a0 tx=0x7fb1c000b960 comp rx=0 tx=0).stop 2024-09-10T11:00:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 shutdown_connections 2024-09-10T11:00:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb1c40a2c10 0x7fb1c40a50d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1d8106a80 0x7fb1d80fd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1d8101420 0x7fb1d80fd2e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 --2- 172.21.15.59:0/386778825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1d8100a80 0x7fb1d80fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.814+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 >> 172.21.15.59:0/386778825 conn(0x7fb1d80fc7a0 msgr2=0x7fb1d806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.815+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 shutdown_connections 2024-09-10T11:00:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.815+0000 7fb1de0d0640 1 -- 172.21.15.59:0/386778825 wait complete. 2024-09-10T11:00:29.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.878+0000 7fb111bd2640 1 -- 172.21.15.59:0/2576439513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102570 msgr2=0x7fb10c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:29.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.878+0000 7fb111bd2640 1 --2- 172.21.15.59:0/2576439513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102570 0x7fb10c1029b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb100009900 tx=0x7fb10002a480 comp rx=0 tx=0).stop 2024-09-10T11:00:29.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.878+0000 7fb111bd2640 1 -- 172.21.15.59:0/2576439513 shutdown_connections 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.878+0000 7fb111bd2640 1 --2- 172.21.15.59:0/2576439513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb10c102ef0 0x7fb10c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.878+0000 7fb111bd2640 1 --2- 172.21.15.59:0/2576439513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102570 0x7fb10c1029b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.878+0000 7fb111bd2640 1 --2- 172.21.15.59:0/2576439513 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10c100e20 0x7fb10c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.878+0000 7fb111bd2640 1 -- 172.21.15.59:0/2576439513 >> 172.21.15.59:0/2576439513 conn(0x7fb10c0fc7d0 msgr2=0x7fb10c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.878+0000 7fb111bd2640 1 -- 172.21.15.59:0/2576439513 shutdown_connections 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.878+0000 7fb111bd2640 1 -- 172.21.15.59:0/2576439513 wait complete. 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb111bd2640 1 Processor -- start 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb111bd2640 1 -- start start 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb111bd2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10c100e20 0x7fb10c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb111bd2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb10c102570 0x7fb10c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb111bd2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102ef0 0x7fb10c1a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:29.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb111bd2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c110fa0 con 0x7fb10c102ef0 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb111bd2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c110e20 con 0x7fb10c102570 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb111bd2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c111120 con 0x7fb10c100e20 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb10bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102ef0 0x7fb10c1a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb10bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102ef0 0x7fb10c1a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60440/0 (socket says 172.21.15.59:60440) 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb10bfff640 1 -- 172.21.15.59:0/1675737934 learned_addr learned my addr 172.21.15.59:0/1675737934 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb10affd640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb10c102570 0x7fb10c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.879+0000 7fb10b7fe640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10c100e20 0x7fb10c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb10bfff640 1 -- 172.21.15.59:0/1675737934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10c100e20 msgr2=0x7fb10c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb10bfff640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10c100e20 0x7fb10c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb10bfff640 1 -- 172.21.15.59:0/1675737934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb10c102570 msgr2=0x7fb10c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb10bfff640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb10c102570 0x7fb10c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb10bfff640 1 -- 172.21.15.59:0/1675737934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c1a4930 con 0x7fb10c102ef0 2024-09-10T11:00:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb10bfff640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102ef0 0x7fb10c1a43f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb10400cce0 tx=0x7fb10400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb108ff9640 1 -- 172.21.15.59:0/1675737934 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10400f450 con 0x7fb10c102ef0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb108ff9640 1 -- 172.21.15.59:0/1675737934 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb10400fad0 con 0x7fb10c102ef0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10c1a4b00 con 0x7fb10c102ef0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb108ff9640 1 -- 172.21.15.59:0/1675737934 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104018b60 con 0x7fb10c102ef0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.880+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10c1a4fc0 con 0x7fb10c102ef0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.881+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10c101200 con 0x7fb10c102ef0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.882+0000 7fb108ff9640 1 -- 172.21.15.59:0/1675737934 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb10400fc80 con 0x7fb10c102ef0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.883+0000 7fb108ff9640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb0f40a2c10 0x7fb0f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.884+0000 7fb10b7fe640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb0f40a2c10 0x7fb0f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.884+0000 7fb108ff9640 1 -- 172.21.15.59:0/1675737934 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fb1040cfa50 con 0x7fb10c102ef0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.884+0000 7fb10b7fe640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb0f40a2c10 0x7fb0f40a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009990 tx=0x7fb0fc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:29.887+0000 7fb108ff9640 1 -- 172.21.15.59:0/1675737934 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb104014030 con 0x7fb10c102ef0 2024-09-10T11:00:30.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:29 smithi115 ceph-mon[34719]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-10T11:00:30.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:29 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:30.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:29 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.065+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb10c1a5280 con 0x7fb10c102ef0 2024-09-10T11:00:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.065+0000 7fb108ff9640 1 -- 172.21.15.59:0/1675737934 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb10409c830 con 0x7fb10c102ef0 2024-09-10T11:00:30.066 INFO:teuthology.orchestra.run.smithi059.stdout:158913790008 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.067+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb0f40a2c10 msgr2=0x7fb0f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.067+0000 7fb111bd2640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb0f40a2c10 0x7fb0f40a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009990 tx=0x7fb0fc009110 comp rx=0 tx=0).stop 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.067+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102ef0 msgr2=0x7fb10c1a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.067+0000 7fb111bd2640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102ef0 0x7fb10c1a43f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb10400cce0 tx=0x7fb10400a620 comp rx=0 tx=0).stop 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.067+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 shutdown_connections 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.067+0000 7fb111bd2640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb0f40a2c10 0x7fb0f40a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.068+0000 7fb111bd2640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c102ef0 0x7fb10c1a43f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.068+0000 7fb111bd2640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb10c102570 0x7fb10c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.068+0000 7fb111bd2640 1 --2- 172.21.15.59:0/1675737934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb10c100e20 0x7fb10c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.068+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 >> 172.21.15.59:0/1675737934 conn(0x7fb10c0fc7d0 msgr2=0x7fb10c1068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.068+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 shutdown_connections 2024-09-10T11:00:30.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.068+0000 7fb111bd2640 1 -- 172.21.15.59:0/1675737934 wait complete. 2024-09-10T11:00:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:29 smithi181 ceph-mon[35409]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-10T11:00:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:29 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:29 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 -- 172.21.15.59:0/649715120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102ef0 msgr2=0x7f344810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 --2- 172.21.15.59:0/649715120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102ef0 0x7f344810da40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3440009ca0 tx=0x7f344002a950 comp rx=0 tx=0).stop 2024-09-10T11:00:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 -- 172.21.15.59:0/649715120 shutdown_connections 2024-09-10T11:00:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 --2- 172.21.15.59:0/649715120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102ef0 0x7f344810da40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:30.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 --2- 172.21.15.59:0/649715120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3448102570 0x7f34481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 --2- 172.21.15.59:0/649715120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3448100e20 0x7f3448101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 -- 172.21.15.59:0/649715120 >> 172.21.15.59:0/649715120 conn(0x7f34480fc7d0 msgr2=0x7f34480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 -- 172.21.15.59:0/649715120 shutdown_connections 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 -- 172.21.15.59:0/649715120 wait complete. 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 Processor -- start 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 -- start start 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.810+0000 7f345025a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3448100e20 0x7f3448199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f345025a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102570 0x7f3448199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f345025a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3448102ef0 0x7f34481a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f345025a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3448110fa0 con 0x7f3448102570 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f345025a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3448110e20 con 0x7f3448100e20 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f345025a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3448111120 con 0x7f3448102ef0 2024-09-10T11:00:30.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344d7f5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102570 0x7f3448199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344d7f5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102570 0x7f3448199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60448/0 (socket says 172.21.15.59:60448) 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344d7f5640 1 -- 172.21.15.59:0/1775924651 learned_addr learned my addr 172.21.15.59:0/1775924651 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344e7f7640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3448102ef0 0x7f34481a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344dff6640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3448100e20 0x7f3448199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344d7f5640 1 -- 172.21.15.59:0/1775924651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3448102ef0 msgr2=0x7f34481a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344d7f5640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3448102ef0 0x7f34481a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344d7f5640 1 -- 172.21.15.59:0/1775924651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3448100e20 msgr2=0x7f3448199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344d7f5640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3448100e20 0x7f3448199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344d7f5640 1 -- 172.21.15.59:0/1775924651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34481a4910 con 0x7f3448102570 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f344d7f5640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102570 0x7f3448199890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f343800b4a0 tx=0x7f343800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f343effd640 1 -- 172.21.15.59:0/1775924651 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3438014070 con 0x7f3448102570 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f343effd640 1 -- 172.21.15.59:0/1775924651 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3438010af0 con 0x7f3448102570 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34481a4ae0 con 0x7f3448102570 2024-09-10T11:00:30.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f343effd640 1 -- 172.21.15.59:0/1775924651 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3438017d10 con 0x7f3448102570 2024-09-10T11:00:30.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.811+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34481a5020 con 0x7f3448102570 2024-09-10T11:00:30.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.812+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3448101200 con 0x7f3448102570 2024-09-10T11:00:30.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.814+0000 7f343effd640 1 -- 172.21.15.59:0/1775924651 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3438017070 con 0x7f3448102570 2024-09-10T11:00:30.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.814+0000 7f343effd640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f34340a2c90 0x7f34340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:30.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.814+0000 7f344dff6640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f34340a2c90 0x7f34340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:30.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.814+0000 7f343effd640 1 -- 172.21.15.59:0/1775924651 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f34380ce3d0 con 0x7f3448102570 2024-09-10T11:00:30.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.815+0000 7f344dff6640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f34340a2c90 0x7f34340a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f34440058c0 tx=0x7f344400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:30.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:30.818+0000 7f343effd640 1 -- 172.21.15.59:0/1775924651 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f343809b2c0 con 0x7f3448102570 2024-09-10T11:00:31.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.001+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f344806a560 con 0x7f3448102570 2024-09-10T11:00:31.002 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:30 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/386778825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T11:00:31.002 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:30 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1675737934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T11:00:31.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.001+0000 7f343effd640 1 -- 172.21.15.59:0/1775924651 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f344806a560 con 0x7f3448102570 2024-09-10T11:00:31.003 INFO:teuthology.orchestra.run.smithi059.stdout:103079215169 2024-09-10T11:00:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f34340a2c90 msgr2=0x7f34340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f34340a2c90 0x7f34340a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f34440058c0 tx=0x7f344400a4c0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102570 msgr2=0x7f3448199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102570 0x7f3448199890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f343800b4a0 tx=0x7f343800b960 comp rx=0 tx=0).stop 2024-09-10T11:00:31.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 shutdown_connections 2024-09-10T11:00:31.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f34340a2c90 0x7f34340a5150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3448102ef0 0x7f34481a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3448102570 0x7f3448199890 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 --2- 172.21.15.59:0/1775924651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3448100e20 0x7f3448199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 >> 172.21.15.59:0/1775924651 conn(0x7f34480fc7d0 msgr2=0x7f3448106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:31.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 shutdown_connections 2024-09-10T11:00:31.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.003+0000 7f345025a640 1 -- 172.21.15.59:0/1775924651 wait complete. 2024-09-10T11:00:31.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.029+0000 7fb57b28b640 1 -- 172.21.15.59:0/2890600985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574101df0 msgr2=0x7fb5741021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.029+0000 7fb57b28b640 1 --2- 172.21.15.59:0/2890600985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574101df0 0x7fb5741021d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb570009900 tx=0x7fb57002a410 comp rx=0 tx=0).stop 2024-09-10T11:00:31.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.029+0000 7fb57b28b640 1 -- 172.21.15.59:0/2890600985 shutdown_connections 2024-09-10T11:00:31.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.029+0000 7fb57b28b640 1 --2- 172.21.15.59:0/2890600985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb574106f20 0x7fb57410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.029+0000 7fb57b28b640 1 --2- 172.21.15.59:0/2890600985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5741027a0 0x7fb5741067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.029+0000 7fb57b28b640 1 --2- 172.21.15.59:0/2890600985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574101df0 0x7fb5741021d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.029+0000 7fb57b28b640 1 -- 172.21.15.59:0/2890600985 >> 172.21.15.59:0/2890600985 conn(0x7fb5740fd8f0 msgr2=0x7fb5740ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.029+0000 7fb57b28b640 1 -- 172.21.15.59:0/2890600985 shutdown_connections 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.029+0000 7fb57b28b640 1 -- 172.21.15.59:0/2890600985 wait complete. 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb57b28b640 1 Processor -- start 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb57b28b640 1 -- start start 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb57b28b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb574101df0 0x7fb5741983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb57b28b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5741027a0 0x7fb574198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb57b28b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574106f20 0x7fb57419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb57b28b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb574111f80 con 0x7fb574106f20 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb57b28b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb574111e00 con 0x7fb5741027a0 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb57b28b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb574112100 con 0x7fb574101df0 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb579828640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574106f20 0x7fb57419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb579828640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574106f20 0x7fb57419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60464/0 (socket says 172.21.15.59:60464) 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb579828640 1 -- 172.21.15.59:0/160145321 learned_addr learned my addr 172.21.15.59:0/160145321 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:31.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb579027640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb574101df0 0x7fb5741983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.030+0000 7fb578826640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5741027a0 0x7fb574198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb579828640 1 -- 172.21.15.59:0/160145321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb574101df0 msgr2=0x7fb5741983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb579828640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb574101df0 0x7fb5741983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb579828640 1 -- 172.21.15.59:0/160145321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5741027a0 msgr2=0x7fb574198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb579828640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5741027a0 0x7fb574198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb579828640 1 -- 172.21.15.59:0/160145321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57419d390 con 0x7fb574106f20 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb578826640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5741027a0 0x7fb574198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb579828640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574106f20 0x7fb57419ccb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00cce0 tx=0x7fb56c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb56a7fc640 1 -- 172.21.15.59:0/160145321 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c00f450 con 0x7fb574106f20 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57419d680 con 0x7fb574106f20 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb56a7fc640 1 -- 172.21.15.59:0/160145321 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb56c00fad0 con 0x7fb574106f20 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb56a7fc640 1 -- 172.21.15.59:0/160145321 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c018c10 con 0x7fb574106f20 2024-09-10T11:00:31.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.031+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5741a4f60 con 0x7fb574106f20 2024-09-10T11:00:31.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.032+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5741021d0 con 0x7fb574106f20 2024-09-10T11:00:31.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.034+0000 7fb56a7fc640 1 -- 172.21.15.59:0/160145321 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb56c00f5f0 con 0x7fb574106f20 2024-09-10T11:00:31.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.035+0000 7fb56a7fc640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb5600a2c90 0x7fb5600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:31.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.035+0000 7fb579027640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb5600a2c90 0x7fb5600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:31.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.035+0000 7fb56a7fc640 1 -- 172.21.15.59:0/160145321 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fb56c0cf7c0 con 0x7fb574106f20 2024-09-10T11:00:31.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.035+0000 7fb579027640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb5600a2c90 0x7fb5600a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb570009230 tx=0x7fb5700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:31.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.039+0000 7fb56a7fc640 1 -- 172.21.15.59:0/160145321 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb56c014030 con 0x7fb574106f20 2024-09-10T11:00:31.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:30 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/386778825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T11:00:31.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:30 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1675737934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T11:00:31.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:30 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/386778825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T11:00:31.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:30 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1675737934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T11:00:31.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.215+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb574109b70 con 0x7fb574106f20 2024-09-10T11:00:31.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.215+0000 7fb56a7fc640 1 -- 172.21.15.59:0/160145321 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb56c09c5a0 con 0x7fb574106f20 2024-09-10T11:00:31.216 INFO:teuthology.orchestra.run.smithi059.stdout:34359738449 2024-09-10T11:00:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.217+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb5600a2c90 msgr2=0x7fb5600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.217+0000 7fb57b28b640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb5600a2c90 0x7fb5600a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb570009230 tx=0x7fb5700058d0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.217+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574106f20 msgr2=0x7fb57419ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.217+0000 7fb57b28b640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574106f20 0x7fb57419ccb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00cce0 tx=0x7fb56c00a620 comp rx=0 tx=0).stop 2024-09-10T11:00:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.218+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 shutdown_connections 2024-09-10T11:00:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.218+0000 7fb57b28b640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fb5600a2c90 0x7fb5600a5150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.218+0000 7fb57b28b640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb574106f20 0x7fb57419ccb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.218+0000 7fb57b28b640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5741027a0 0x7fb574198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.218+0000 7fb57b28b640 1 --2- 172.21.15.59:0/160145321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb574101df0 0x7fb5741983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.218+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 >> 172.21.15.59:0/160145321 conn(0x7fb5740fd8f0 msgr2=0x7fb5740febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.218+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 shutdown_connections 2024-09-10T11:00:31.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.218+0000 7fb57b28b640 1 -- 172.21.15.59:0/160145321 wait complete. 2024-09-10T11:00:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.697+0000 7fd9499a7640 1 -- 172.21.15.59:0/4275606410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 msgr2=0x7fd9441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.697+0000 7fd9499a7640 1 --2- 172.21.15.59:0/4275606410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 0x7fd9441067e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009900 tx=0x7fd92c02a410 comp rx=0 tx=0).stop 2024-09-10T11:00:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.697+0000 7fd9499a7640 1 -- 172.21.15.59:0/4275606410 shutdown_connections 2024-09-10T11:00:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.697+0000 7fd9499a7640 1 --2- 172.21.15.59:0/4275606410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd944106f10 0x7fd94410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.697+0000 7fd9499a7640 1 --2- 172.21.15.59:0/4275606410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 0x7fd9441067e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.697+0000 7fd9499a7640 1 --2- 172.21.15.59:0/4275606410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd944101de0 0x7fd9441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.697+0000 7fd9499a7640 1 -- 172.21.15.59:0/4275606410 >> 172.21.15.59:0/4275606410 conn(0x7fd9440fd8c0 msgr2=0x7fd9440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.697+0000 7fd9499a7640 1 -- 172.21.15.59:0/4275606410 shutdown_connections 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.697+0000 7fd9499a7640 1 -- 172.21.15.59:0/4275606410 wait complete. 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9499a7640 1 Processor -- start 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9499a7640 1 -- start start 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9499a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd944101de0 0x7fd94419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9499a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 0x7fd94419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9499a7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd944106f10 0x7fd94419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9499a7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd944111f30 con 0x7fd944102790 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9499a7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd944111db0 con 0x7fd944106f10 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9499a7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd9441120b0 con 0x7fd944101de0 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9427fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 0x7fd94419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9427fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 0x7fd94419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60478/0 (socket says 172.21.15.59:60478) 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9427fc640 1 -- 172.21.15.59:0/1541811830 learned_addr learned my addr 172.21.15.59:0/1541811830 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd9437fe640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd944106f10 0x7fd94419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.698+0000 7fd942ffd640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd944101de0 0x7fd94419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9427fc640 1 -- 172.21.15.59:0/1541811830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd944101de0 msgr2=0x7fd94419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9427fc640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd944101de0 0x7fd94419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9427fc640 1 -- 172.21.15.59:0/1541811830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd944106f10 msgr2=0x7fd94419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9427fc640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd944106f10 0x7fd94419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9427fc640 1 -- 172.21.15.59:0/1541811830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94419f620 con 0x7fd944102790 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9437fe640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd944106f10 0x7fd94419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd942ffd640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd944101de0 0x7fd94419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9427fc640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 0x7fd94419abb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd92c005ab0 tx=0x7fd92c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9489a5640 1 -- 172.21.15.59:0/1541811830 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c03f030 con 0x7fd944102790 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94419f8b0 con 0x7fd944102790 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9489a5640 1 -- 172.21.15.59:0/1541811830 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd92c003ce0 con 0x7fd944102790 2024-09-10T11:00:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9489a5640 1 -- 172.21.15.59:0/1541811830 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c035070 con 0x7fd944102790 2024-09-10T11:00:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.699+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9441a71f0 con 0x7fd944102790 2024-09-10T11:00:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.700+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9441021c0 con 0x7fd944102790 2024-09-10T11:00:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.701+0000 7fd9489a5640 1 -- 172.21.15.59:0/1541811830 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd92c042030 con 0x7fd944102790 2024-09-10T11:00:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.702+0000 7fd9489a5640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd9300a2c10 0x7fd9300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.702+0000 7fd942ffd640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd9300a2c10 0x7fd9300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.702+0000 7fd9489a5640 1 -- 172.21.15.59:0/1541811830 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fd92c0efe70 con 0x7fd944102790 2024-09-10T11:00:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.703+0000 7fd942ffd640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd9300a2c10 0x7fd9300a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd93c007e70 tx=0x7fd93c007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.705+0000 7fd9489a5640 1 -- 172.21.15.59:0/1541811830 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd92c0bcbf0 con 0x7fd944102790 2024-09-10T11:00:31.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.885+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd9441a73c0 con 0x7fd944102790 2024-09-10T11:00:31.886 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:31 smithi059 ceph-mon[30978]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:31.886 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:31 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1775924651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T11:00:31.886 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:31 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/160145321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T11:00:31.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.885+0000 7fd9489a5640 1 -- 172.21.15.59:0/1541811830 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd92c0bc4f0 con 0x7fd944102790 2024-09-10T11:00:31.886 INFO:teuthology.orchestra.run.smithi059.stdout:188978561075 2024-09-10T11:00:31.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd9300a2c10 msgr2=0x7fd9300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd9300a2c10 0x7fd9300a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd93c007e70 tx=0x7fd93c007850 comp rx=0 tx=0).stop 2024-09-10T11:00:31.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 msgr2=0x7fd94419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 0x7fd94419abb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd92c005ab0 tx=0x7fd92c0042f0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 shutdown_connections 2024-09-10T11:00:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd9300a2c10 0x7fd9300a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd944106f10 0x7fd94419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd944102790 0x7fd94419abb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 --2- 172.21.15.59:0/1541811830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd944101de0 0x7fd94419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.887+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 >> 172.21.15.59:0/1541811830 conn(0x7fd9440fd8c0 msgr2=0x7fd9440feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.888+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 shutdown_connections 2024-09-10T11:00:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:31.888+0000 7fd9499a7640 1 -- 172.21.15.59:0/1541811830 wait complete. 2024-09-10T11:00:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:31 smithi181 ceph-mon[35409]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:31 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1775924651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T11:00:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:31 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/160145321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T11:00:32.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939680 got 270582939683 for osd.9 2024-09-10T11:00:32.192 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:31 smithi115 ceph-mon[34719]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:31 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1775924651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T11:00:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:31 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/160145321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T11:00:32.650 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215165 got 103079215169 for osd.3 2024-09-10T11:00:32.650 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:32.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:32 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1541811830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T11:00:33.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:32 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1541811830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T11:00:33.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:32 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1541811830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.362+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1543254276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8102ef0 msgr2=0x7ff2e810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.362+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1543254276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8102ef0 0x7ff2e810da40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009ca0 tx=0x7ff2e002a950 comp rx=0 tx=0).stop 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.362+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1543254276 shutdown_connections 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.362+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1543254276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8102ef0 0x7ff2e810da40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.362+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1543254276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e8102570 0x7ff2e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.362+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1543254276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e8100e20 0x7ff2e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.362+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1543254276 >> 172.21.15.59:0/1543254276 conn(0x7ff2e80fc7d0 msgr2=0x7ff2e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.362+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1543254276 shutdown_connections 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.362+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1543254276 wait complete. 2024-09-10T11:00:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2efd9e640 1 Processor -- start 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2efd9e640 1 -- start start 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2efd9e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8100e20 0x7ff2e8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2efd9e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e8102570 0x7ff2e8199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2efd9e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e8102ef0 0x7ff2e81a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2efd9e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8110fa0 con 0x7ff2e8100e20 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2efd9e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8110e20 con 0x7ff2e8102ef0 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2efd9e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8111120 con 0x7ff2e8102570 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2edb3a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8100e20 0x7ff2e8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2edb3a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8100e20 0x7ff2e8199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60502/0 (socket says 172.21.15.59:60502) 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.363+0000 7ff2edb3a640 1 -- 172.21.15.59:0/1910808437 learned_addr learned my addr 172.21.15.59:0/1910808437 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2ed339640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e8102570 0x7ff2e8199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2ee33b640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e8102ef0 0x7ff2e81a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2edb3a640 1 -- 172.21.15.59:0/1910808437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e8102570 msgr2=0x7ff2e8199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2edb3a640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e8102570 0x7ff2e8199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2edb3a640 1 -- 172.21.15.59:0/1910808437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e8102ef0 msgr2=0x7ff2e81a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2edb3a640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e8102ef0 0x7ff2e81a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2edb3a640 1 -- 172.21.15.59:0/1910808437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e81a4910 con 0x7ff2e8100e20 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2ee33b640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e8102ef0 0x7ff2e81a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2edb3a640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8100e20 0x7ff2e8199350 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c890 tx=0x7ff2e400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2deffd640 1 -- 172.21.15.59:0/1910808437 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004220 con 0x7ff2e8100e20 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2deffd640 1 -- 172.21.15.59:0/1910808437 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2e40043c0 con 0x7ff2e8100e20 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e81a4ae0 con 0x7ff2e8100e20 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2deffd640 1 -- 172.21.15.59:0/1910808437 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004a00 con 0x7ff2e8100e20 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.364+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e81a5020 con 0x7ff2e8100e20 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.365+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e8101200 con 0x7ff2e8100e20 2024-09-10T11:00:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.366+0000 7ff2deffd640 1 -- 172.21.15.59:0/1910808437 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff2e40079b0 con 0x7ff2e8100e20 2024-09-10T11:00:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.367+0000 7ff2deffd640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2d40a2c90 0x7ff2d40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.367+0000 7ff2ed339640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2d40a2c90 0x7ff2d40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.367+0000 7ff2deffd640 1 -- 172.21.15.59:0/1910808437 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7ff2e40ceea0 con 0x7ff2e8100e20 2024-09-10T11:00:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.368+0000 7ff2ed339640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2d40a2c90 0x7ff2d40a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2e806aac0 tx=0x7ff2d8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.371+0000 7ff2deffd640 1 -- 172.21.15.59:0/1910808437 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2e4014030 con 0x7ff2e8100e20 2024-09-10T11:00:33.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.550+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7ff2e81a5280 con 0x7ff2e8100e20 2024-09-10T11:00:33.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.550+0000 7ff2deffd640 1 -- 172.21.15.59:0/1910808437 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff2e409bc20 con 0x7ff2e8100e20 2024-09-10T11:00:33.551 INFO:teuthology.orchestra.run.smithi059.stdout:240518168617 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2d40a2c90 msgr2=0x7ff2d40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2d40a2c90 0x7ff2d40a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2e806aac0 tx=0x7ff2d8009110 comp rx=0 tx=0).stop 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8100e20 msgr2=0x7ff2e8199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8100e20 0x7ff2e8199350 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c890 tx=0x7ff2e400cc90 comp rx=0 tx=0).stop 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 shutdown_connections 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ff2d40a2c90 0x7ff2d40a5150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e8102ef0 0x7ff2e81a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2e8102570 0x7ff2e8199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 --2- 172.21.15.59:0/1910808437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8100e20 0x7ff2e8199350 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 >> 172.21.15.59:0/1910808437 conn(0x7ff2e80fc7d0 msgr2=0x7ff2e8106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 shutdown_connections 2024-09-10T11:00:33.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:33.553+0000 7ff2efd9e640 1 -- 172.21.15.59:0/1910808437 wait complete. 2024-09-10T11:00:33.840 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:33 smithi059 ceph-mon[30978]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:33.840 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:33 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1910808437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T11:00:33.867 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790004 got 158913790008 for osd.5 2024-09-10T11:00:33.868 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:34.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:33 smithi181 ceph-mon[35409]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:34.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:33 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1910808437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T11:00:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:33 smithi115 ceph-mon[34719]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:33 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1910808437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T11:00:34.521 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561072 got 188978561075 for osd.6 2024-09-10T11:00:34.521 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:35.166 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168614 got 240518168617 for osd.8 2024-09-10T11:00:35.166 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:35.876 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738449 for osd.0 2024-09-10T11:00:35.877 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:36.019 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:36.051 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:35 smithi059 ceph-mon[30978]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:36.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:35 smithi181 ceph-mon[35409]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:36.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:35 smithi115 ceph-mon[34719]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:36.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.854+0000 7fe32d4f8640 1 -- 172.21.15.59:0/601947104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328103720 msgr2=0x7fe32810bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:36.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.854+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/601947104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328103720 0x7fe32810bc10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe310009900 tx=0x7fe31002a480 comp rx=0 tx=0).stop 2024-09-10T11:00:36.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.854+0000 7fe32d4f8640 1 -- 172.21.15.59:0/601947104 shutdown_connections 2024-09-10T11:00:36.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.854+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/601947104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32810c1a0 0x7fe32810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:36.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.854+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/601947104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328103720 0x7fe32810bc10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:36.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.854+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/601947104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe328102e00 0x7fe3281031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:36.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.854+0000 7fe32d4f8640 1 -- 172.21.15.59:0/601947104 >> 172.21.15.59:0/601947104 conn(0x7fe3280fc7a0 msgr2=0x7fe3280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:36.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.854+0000 7fe32d4f8640 1 -- 172.21.15.59:0/601947104 shutdown_connections 2024-09-10T11:00:36.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.854+0000 7fe32d4f8640 1 -- 172.21.15.59:0/601947104 wait complete. 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe32d4f8640 1 Processor -- start 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe32d4f8640 1 -- start start 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe32d4f8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328102e00 0x7fe328198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe32d4f8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328103720 0x7fe328198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe32d4f8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe32810c1a0 0x7fe32819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe32d4f8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe328111f70 con 0x7fe328102e00 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe32d4f8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe328111df0 con 0x7fe328103720 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe32d4f8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe3281120f0 con 0x7fe32810c1a0 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe326ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328102e00 0x7fe328198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe326ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328102e00 0x7fe328198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57110/0 (socket says 172.21.15.59:57110) 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.855+0000 7fe326ffd640 1 -- 172.21.15.59:0/4045456896 learned_addr learned my addr 172.21.15.59:0/4045456896 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe31ffff640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328103720 0x7fe328198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe3277fe640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe32810c1a0 0x7fe32819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe326ffd640 1 -- 172.21.15.59:0/4045456896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe32810c1a0 msgr2=0x7fe32819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe326ffd640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe32810c1a0 0x7fe32819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe326ffd640 1 -- 172.21.15.59:0/4045456896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328103720 msgr2=0x7fe328198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe326ffd640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328103720 0x7fe328198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe326ffd640 1 -- 172.21.15.59:0/4045456896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32819d400 con 0x7fe328102e00 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe326ffd640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328102e00 0x7fe328198450 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe31800d950 tx=0x7fe31800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe324ff9640 1 -- 172.21.15.59:0/4045456896 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318017030 con 0x7fe328102e00 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe324ff9640 1 -- 172.21.15.59:0/4045456896 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe318004020 con 0x7fe328102e00 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32819d6f0 con 0x7fe328102e00 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe324ff9640 1 -- 172.21.15.59:0/4045456896 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3180047a0 con 0x7fe328102e00 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.856+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3281a4fd0 con 0x7fe328102e00 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.857+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3281031e0 con 0x7fe328102e00 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.858+0000 7fe324ff9640 1 -- 172.21.15.59:0/4045456896 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe3180041d0 con 0x7fe328102e00 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.859+0000 7fe324ff9640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 0x7fe3140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.859+0000 7fe31ffff640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 0x7fe3140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.859+0000 7fe324ff9640 1 -- 172.21.15.59:0/4045456896 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe3180cf1c0 con 0x7fe328102e00 2024-09-10T11:00:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.860+0000 7fe31ffff640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 0x7fe3140a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe310009230 tx=0x7fe3100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:36.862+0000 7fe324ff9640 1 -- 172.21.15.59:0/4045456896 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe31809bfa0 con 0x7fe328102e00 2024-09-10T11:00:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.058+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe328106c90 con 0x7fe328102e00 2024-09-10T11:00:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.058+0000 7fe324ff9640 1 -- 172.21.15.59:0/4045456896 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe31809b8a0 con 0x7fe328102e00 2024-09-10T11:00:37.059 INFO:teuthology.orchestra.run.smithi059.stdout:210453397550 2024-09-10T11:00:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 msgr2=0x7fe3140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 0x7fe3140a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe310009230 tx=0x7fe3100058d0 comp rx=0 tx=0).stop 2024-09-10T11:00:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328102e00 msgr2=0x7fe328198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328102e00 0x7fe328198450 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe31800d950 tx=0x7fe31800de10 comp rx=0 tx=0).stop 2024-09-10T11:00:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 shutdown_connections 2024-09-10T11:00:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe3140a2c10 0x7fe3140a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe32810c1a0 0x7fe32819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe328103720 0x7fe328198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 --2- 172.21.15.59:0/4045456896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe328102e00 0x7fe328198450 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 >> 172.21.15.59:0/4045456896 conn(0x7fe3280fc7a0 msgr2=0x7fe3280fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 shutdown_connections 2024-09-10T11:00:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:37.062+0000 7fe32d4f8640 1 -- 172.21.15.59:0/4045456896 wait complete. 2024-09-10T11:00:37.755 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397546 got 210453397550 for osd.7 2024-09-10T11:00:37.755 DEBUG:teuthology.parallel:result is None 2024-09-10T11:00:37.755 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T11:00:37.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T11:00:38.043 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:38.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:37 smithi059 ceph-mon[30978]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:38.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:37 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/4045456896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T11:00:38.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:37 smithi181 ceph-mon[35409]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:38.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:37 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/4045456896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T11:00:38.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:37 smithi115 ceph-mon[34719]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:38.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:37 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/4045456896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T11:00:38.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.550+0000 7fe0f2990640 1 -- 172.21.15.59:0/3173464592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 msgr2=0x7fe0ec103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:38.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.550+0000 7fe0f2990640 1 --2- 172.21.15.59:0/3173464592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 0x7fe0ec103120 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009900 tx=0x7fe0dc02a480 comp rx=0 tx=0).stop 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.550+0000 7fe0f2990640 1 -- 172.21.15.59:0/3173464592 shutdown_connections 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.550+0000 7fe0f2990640 1 --2- 172.21.15.59:0/3173464592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0ec10c170 0x7fe0ec10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.550+0000 7fe0f2990640 1 --2- 172.21.15.59:0/3173464592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec103660 0x7fe0ec10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.550+0000 7fe0f2990640 1 --2- 172.21.15.59:0/3173464592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 0x7fe0ec103120 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.550+0000 7fe0f2990640 1 -- 172.21.15.59:0/3173464592 >> 172.21.15.59:0/3173464592 conn(0x7fe0ec0fc7a0 msgr2=0x7fe0ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.550+0000 7fe0f2990640 1 -- 172.21.15.59:0/3173464592 shutdown_connections 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.550+0000 7fe0f2990640 1 -- 172.21.15.59:0/3173464592 wait complete. 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0f2990640 1 Processor -- start 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0f2990640 1 -- start start 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0f2990640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 0x7fe0ec198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0f2990640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec103660 0x7fe0ec1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0f2990640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0ec10c170 0x7fe0ec19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0f2990640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec111f70 con 0x7fe0ec102d40 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0f2990640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec111df0 con 0x7fe0ec103660 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0f2990640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1120f0 con 0x7fe0ec10c170 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0ebfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 0x7fe0ec198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0ebfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 0x7fe0ec198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57130/0 (socket says 172.21.15.59:57130) 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.551+0000 7fe0ebfff640 1 -- 172.21.15.59:0/4201844779 learned_addr learned my addr 172.21.15.59:0/4201844779 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0eb7fe640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec103660 0x7fe0ec1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0f0f2d640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0ec10c170 0x7fe0ec19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0ebfff640 1 -- 172.21.15.59:0/4201844779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0ec10c170 msgr2=0x7fe0ec19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0ebfff640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0ec10c170 0x7fe0ec19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0ebfff640 1 -- 172.21.15.59:0/4201844779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec103660 msgr2=0x7fe0ec1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0ebfff640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec103660 0x7fe0ec1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0ebfff640 1 -- 172.21.15.59:0/4201844779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec19d420 con 0x7fe0ec102d40 2024-09-10T11:00:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0eb7fe640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec103660 0x7fe0ec1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0ebfff640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 0x7fe0ec198470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0e97fa640 1 -- 172.21.15.59:0/4201844779 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc03f030 con 0x7fe0ec102d40 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0e97fa640 1 -- 172.21.15.59:0/4201844779 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0dc003ce0 con 0x7fe0ec102d40 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec19d6b0 con 0x7fe0ec102d40 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0e97fa640 1 -- 172.21.15.59:0/4201844779 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc035070 con 0x7fe0ec102d40 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.552+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec1a4ff0 con 0x7fe0ec102d40 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.553+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ec06b070 con 0x7fe0ec102d40 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.554+0000 7fe0e97fa640 1 -- 172.21.15.59:0/4201844779 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe0dc042030 con 0x7fe0ec102d40 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.555+0000 7fe0e97fa640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe0d40a2c10 0x7fe0d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.555+0000 7fe0eb7fe640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe0d40a2c10 0x7fe0d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.555+0000 7fe0e97fa640 1 -- 172.21.15.59:0/4201844779 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe0dc0ef960 con 0x7fe0ec102d40 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.556+0000 7fe0eb7fe640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe0d40a2c10 0x7fe0d40a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00058c0 tx=0x7fe0e0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:38.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.559+0000 7fe0e97fa640 1 -- 172.21.15.59:0/4201844779 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0dc0bc800 con 0x7fe0ec102d40 2024-09-10T11:00:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.733+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0ec107280 con 0x7fe0d40a2c10 2024-09-10T11:00:38.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.739+0000 7fe0e97fa640 1 -- 172.21.15.59:0/4201844779 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258915 (secure 0 0 0) 0x7fe0e000bce0 con 0x7fe0d40a2c10 2024-09-10T11:00:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T11:00:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe0d40a2c10 msgr2=0x7fe0d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe0d40a2c10 0x7fe0d40a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00058c0 tx=0x7fe0e0005850 comp rx=0 tx=0).stop 2024-09-10T11:00:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 msgr2=0x7fe0ec198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 0x7fe0ec198470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc0042f0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 shutdown_connections 2024-09-10T11:00:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fe0d40a2c10 0x7fe0d40a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0ec10c170 0x7fe0ec19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ec103660 0x7fe0ec1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 --2- 172.21.15.59:0/4201844779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec102d40 0x7fe0ec198470 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 >> 172.21.15.59:0/4201844779 conn(0x7fe0ec0fc7a0 msgr2=0x7fe0ec0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 shutdown_connections 2024-09-10T11:00:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:38.742+0000 7fe0f2990640 1 -- 172.21.15.59:0/4201844779 wait complete. 2024-09-10T11:00:39.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:39.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:39.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:00:39.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:00:39.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:38 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:39.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:39.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:39.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:00:39.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:00:39.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:38 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:39.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:39.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:39.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:00:39.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:00:39.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:38 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' 2024-09-10T11:00:39.513 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-10T11:00:38.723599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654209,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":506,"num_read_kb":371,"num_write":342,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364468,"kb_used_data":11040,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577356,"statfs":{"total":1151940427776,"available":1151567212544,"internally_reserved":0,"allocated":11304960,"data_stored":7212699,"data_compressed":176979,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002846"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155754+0000","last_change":"2024-09-10T10:59:31.132551+0000","last_active":"2024-09-10T10:59:40.155754+0000","last_peered":"2024-09-10T10:59:40.155754+0000","last_clean":"2024-09-10T10:59:40.155754+0000","last_became_active":"2024-09-10T10:59:31.132002+0000","last_became_peered":"2024-09-10T10:59:31.132002+0000","last_unstale":"2024-09-10T10:59:40.155754+0000","last_undegraded":"2024-09-10T10:59:40.155754+0000","last_fullsized":"2024-09-10T10:59:40.155754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:14.696067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211064+0000","last_change":"2024-09-10T10:59:31.129868+0000","last_active":"2024-09-10T10:59:40.211064+0000","last_peered":"2024-09-10T10:59:40.211064+0000","last_clean":"2024-09-10T10:59:40.211064+0000","last_became_active":"2024-09-10T10:59:31.129566+0000","last_became_peered":"2024-09-10T10:59:31.129566+0000","last_unstale":"2024-09-10T10:59:40.211064+0000","last_undegraded":"2024-09-10T10:59:40.211064+0000","last_fullsized":"2024-09-10T10:59:40.211064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:30.890000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211128+0000","last_change":"2024-09-10T10:59:31.134021+0000","last_active":"2024-09-10T10:59:40.211128+0000","last_peered":"2024-09-10T10:59:40.211128+0000","last_clean":"2024-09-10T10:59:40.211128+0000","last_became_active":"2024-09-10T10:59:31.133378+0000","last_became_peered":"2024-09-10T10:59:31.133378+0000","last_unstale":"2024-09-10T10:59:40.211128+0000","last_undegraded":"2024-09-10T10:59:40.211128+0000","last_fullsized":"2024-09-10T10:59:40.211128+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:32.808518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.156639+0000","last_change":"2024-09-10T10:59:40.156045+0000","last_active":"2024-09-10T10:59:40.156639+0000","last_peered":"2024-09-10T10:59:40.156639+0000","last_clean":"2024-09-10T10:59:40.156639+0000","last_became_active":"2024-09-10T10:59:40.155722+0000","last_became_peered":"2024-09-10T10:59:40.155722+0000","last_unstale":"2024-09-10T10:59:40.156639+0000","last_undegraded":"2024-09-10T10:59:40.156639+0000","last_fullsized":"2024-09-10T10:59:40.156639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:55.413173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153086+0000","last_change":"2024-09-10T10:59:31.128308+0000","last_active":"2024-09-10T10:59:40.153086+0000","last_peered":"2024-09-10T10:59:40.153086+0000","last_clean":"2024-09-10T10:59:40.153086+0000","last_became_active":"2024-09-10T10:59:31.127937+0000","last_became_peered":"2024-09-10T10:59:31.127937+0000","last_unstale":"2024-09-10T10:59:40.153086+0000","last_undegraded":"2024-09-10T10:59:40.153086+0000","last_fullsized":"2024-09-10T10:59:40.153086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:37.977168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157396+0000","last_change":"2024-09-10T10:59:40.157396+0000","last_active":"2024-09-10T10:59:40.157396+0000","last_peered":"2024-09-10T10:59:40.157396+0000","last_clean":"2024-09-10T10:59:40.157396+0000","last_became_active":"2024-09-10T10:59:40.157003+0000","last_became_peered":"2024-09-10T10:59:40.157003+0000","last_unstale":"2024-09-10T10:59:40.157396+0000","last_undegraded":"2024-09-10T10:59:40.157396+0000","last_fullsized":"2024-09-10T10:59:40.157396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152495+0000","last_change":"2024-09-10T10:59:31.136045+0000","last_active":"2024-09-10T10:59:40.152495+0000","last_peered":"2024-09-10T10:59:40.152495+0000","last_clean":"2024-09-10T10:59:40.152495+0000","last_became_active":"2024-09-10T10:59:31.135295+0000","last_became_peered":"2024-09-10T10:59:31.135295+0000","last_unstale":"2024-09-10T10:59:40.152495+0000","last_undegraded":"2024-09-10T10:59:40.152495+0000","last_fullsized":"2024-09-10T10:59:40.152495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:04.306752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157288+0000","last_change":"2024-09-10T10:59:31.120953+0000","last_active":"2024-09-10T10:59:40.157288+0000","last_peered":"2024-09-10T10:59:40.157288+0000","last_clean":"2024-09-10T10:59:40.157288+0000","last_became_active":"2024-09-10T10:59:31.120647+0000","last_became_peered":"2024-09-10T10:59:31.120647+0000","last_unstale":"2024-09-10T10:59:40.157288+0000","last_undegraded":"2024-09-10T10:59:40.157288+0000","last_fullsized":"2024-09-10T10:59:40.157288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:53.689216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151033+0000","last_change":"2024-09-10T10:59:31.136326+0000","last_active":"2024-09-10T10:59:40.151033+0000","last_peered":"2024-09-10T10:59:40.151033+0000","last_clean":"2024-09-10T10:59:40.151033+0000","last_became_active":"2024-09-10T10:59:31.135129+0000","last_became_peered":"2024-09-10T10:59:31.135129+0000","last_unstale":"2024-09-10T10:59:40.151033+0000","last_undegraded":"2024-09-10T10:59:40.151033+0000","last_fullsized":"2024-09-10T10:59:40.151033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:05.510845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153822+0000","last_change":"2024-09-10T10:59:31.130680+0000","last_active":"2024-09-10T10:59:40.153822+0000","last_peered":"2024-09-10T10:59:40.153822+0000","last_clean":"2024-09-10T10:59:40.153822+0000","last_became_active":"2024-09-10T10:59:31.130356+0000","last_became_peered":"2024-09-10T10:59:31.130356+0000","last_unstale":"2024-09-10T10:59:40.153822+0000","last_undegraded":"2024-09-10T10:59:40.153822+0000","last_fullsized":"2024-09-10T10:59:40.153822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:50.450251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153064+0000","last_change":"2024-09-10T10:59:31.129938+0000","last_active":"2024-09-10T10:59:40.153064+0000","last_peered":"2024-09-10T10:59:40.153064+0000","last_clean":"2024-09-10T10:59:40.153064+0000","last_became_active":"2024-09-10T10:59:31.129527+0000","last_became_peered":"2024-09-10T10:59:31.129527+0000","last_unstale":"2024-09-10T10:59:40.153064+0000","last_undegraded":"2024-09-10T10:59:40.153064+0000","last_fullsized":"2024-09-10T10:59:40.153064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:06.373082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.156876+0000","last_change":"2024-09-10T10:59:40.156217+0000","last_active":"2024-09-10T10:59:40.156876+0000","last_peered":"2024-09-10T10:59:40.156876+0000","last_clean":"2024-09-10T10:59:40.156876+0000","last_became_active":"2024-09-10T10:59:40.155900+0000","last_became_peered":"2024-09-10T10:59:40.155900+0000","last_unstale":"2024-09-10T10:59:40.156876+0000","last_undegraded":"2024-09-10T10:59:40.156876+0000","last_fullsized":"2024-09-10T10:59:40.156876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:17.085474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153961+0000","last_change":"2024-09-10T10:59:31.135564+0000","last_active":"2024-09-10T10:59:40.153961+0000","last_peered":"2024-09-10T10:59:40.153961+0000","last_clean":"2024-09-10T10:59:40.153961+0000","last_became_active":"2024-09-10T10:59:31.135185+0000","last_became_peered":"2024-09-10T10:59:31.135185+0000","last_unstale":"2024-09-10T10:59:40.153961+0000","last_undegraded":"2024-09-10T10:59:40.153961+0000","last_fullsized":"2024-09-10T10:59:40.153961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:17.275533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211219+0000","last_change":"2024-09-10T10:59:31.130517+0000","last_active":"2024-09-10T10:59:40.211219+0000","last_peered":"2024-09-10T10:59:40.211219+0000","last_clean":"2024-09-10T10:59:40.211219+0000","last_became_active":"2024-09-10T10:59:31.130156+0000","last_became_peered":"2024-09-10T10:59:31.130156+0000","last_unstale":"2024-09-10T10:59:40.211219+0000","last_undegraded":"2024-09-10T10:59:40.211219+0000","last_fullsized":"2024-09-10T10:59:40.211219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:33.354812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.210915+0000","last_change":"2024-09-10T10:59:31.130701+0000","last_active":"2024-09-10T10:59:40.210915+0000","last_peered":"2024-09-10T10:59:40.210915+0000","last_clean":"2024-09-10T10:59:40.210915+0000","last_became_active":"2024-09-10T10:59:31.130379+0000","last_became_peered":"2024-09-10T10:59:31.130379+0000","last_unstale":"2024-09-10T10:59:40.210915+0000","last_undegraded":"2024-09-10T10:59:40.210915+0000","last_fullsized":"2024-09-10T10:59:40.210915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:24.787292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150433+0000","last_change":"2024-09-10T10:59:31.129583+0000","last_active":"2024-09-10T10:59:40.150433+0000","last_peered":"2024-09-10T10:59:40.150433+0000","last_clean":"2024-09-10T10:59:40.150433+0000","last_became_active":"2024-09-10T10:59:31.128559+0000","last_became_peered":"2024-09-10T10:59:31.128559+0000","last_unstale":"2024-09-10T10:59:40.150433+0000","last_undegraded":"2024-09-10T10:59:40.150433+0000","last_fullsized":"2024-09-10T10:59:40.150433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:20.139987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155807+0000","last_change":"2024-09-10T10:59:31.132579+0000","last_active":"2024-09-10T10:59:40.155807+0000","last_peered":"2024-09-10T10:59:40.155807+0000","last_clean":"2024-09-10T10:59:40.155807+0000","last_became_active":"2024-09-10T10:59:31.132256+0000","last_became_peered":"2024-09-10T10:59:31.132256+0000","last_unstale":"2024-09-10T10:59:40.155807+0000","last_undegraded":"2024-09-10T10:59:40.155807+0000","last_fullsized":"2024-09-10T10:59:40.155807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:54.771376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151638+0000","last_change":"2024-09-10T10:59:31.127666+0000","last_active":"2024-09-10T10:59:40.151638+0000","last_peered":"2024-09-10T10:59:40.151638+0000","last_clean":"2024-09-10T10:59:40.151638+0000","last_became_active":"2024-09-10T10:59:31.127354+0000","last_became_peered":"2024-09-10T10:59:31.127354+0000","last_unstale":"2024-09-10T10:59:40.151638+0000","last_undegraded":"2024-09-10T10:59:40.151638+0000","last_fullsized":"2024-09-10T10:59:40.151638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:25.089856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152482+0000","last_change":"2024-09-10T10:59:31.126146+0000","last_active":"2024-09-10T10:59:40.152482+0000","last_peered":"2024-09-10T10:59:40.152482+0000","last_clean":"2024-09-10T10:59:40.152482+0000","last_became_active":"2024-09-10T10:59:31.125821+0000","last_became_peered":"2024-09-10T10:59:31.125821+0000","last_unstale":"2024-09-10T10:59:40.152482+0000","last_undegraded":"2024-09-10T10:59:40.152482+0000","last_fullsized":"2024-09-10T10:59:40.152482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:14.442467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155662+0000","last_change":"2024-09-10T10:59:31.124783+0000","last_active":"2024-09-10T10:59:40.155662+0000","last_peered":"2024-09-10T10:59:40.155662+0000","last_clean":"2024-09-10T10:59:40.155662+0000","last_became_active":"2024-09-10T10:59:31.124461+0000","last_became_peered":"2024-09-10T10:59:31.124461+0000","last_unstale":"2024-09-10T10:59:40.155662+0000","last_undegraded":"2024-09-10T10:59:40.155662+0000","last_fullsized":"2024-09-10T10:59:40.155662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:30.312716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154045+0000","last_change":"2024-09-10T10:59:31.123118+0000","last_active":"2024-09-10T10:59:40.154045+0000","last_peered":"2024-09-10T10:59:40.154045+0000","last_clean":"2024-09-10T10:59:40.154045+0000","last_became_active":"2024-09-10T10:59:31.122802+0000","last_became_peered":"2024-09-10T10:59:31.122802+0000","last_unstale":"2024-09-10T10:59:40.154045+0000","last_undegraded":"2024-09-10T10:59:40.154045+0000","last_fullsized":"2024-09-10T10:59:40.154045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:38:30.274121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150564+0000","last_change":"2024-09-10T10:59:31.125163+0000","last_active":"2024-09-10T10:59:40.150564+0000","last_peered":"2024-09-10T10:59:40.150564+0000","last_clean":"2024-09-10T10:59:40.150564+0000","last_became_active":"2024-09-10T10:59:31.124823+0000","last_became_peered":"2024-09-10T10:59:31.124823+0000","last_unstale":"2024-09-10T10:59:40.150564+0000","last_undegraded":"2024-09-10T10:59:40.150564+0000","last_fullsized":"2024-09-10T10:59:40.150564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:06.479220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157045+0000","last_change":"2024-09-10T10:59:31.124892+0000","last_active":"2024-09-10T10:59:40.157045+0000","last_peered":"2024-09-10T10:59:40.157045+0000","last_clean":"2024-09-10T10:59:40.157045+0000","last_became_active":"2024-09-10T10:59:31.124575+0000","last_became_peered":"2024-09-10T10:59:31.124575+0000","last_unstale":"2024-09-10T10:59:40.157045+0000","last_undegraded":"2024-09-10T10:59:40.157045+0000","last_fullsized":"2024-09-10T10:59:40.157045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:54.562406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.159964+0000","last_change":"2024-09-10T10:59:40.159510+0000","last_active":"2024-09-10T10:59:40.159964+0000","last_peered":"2024-09-10T10:59:40.159964+0000","last_clean":"2024-09-10T10:59:40.159964+0000","last_became_active":"2024-09-10T10:59:40.159115+0000","last_became_peered":"2024-09-10T10:59:40.159115+0000","last_unstale":"2024-09-10T10:59:40.159964+0000","last_undegraded":"2024-09-10T10:59:40.159964+0000","last_fullsized":"2024-09-10T10:59:40.159964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:28.390308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158008+0000","last_change":"2024-09-10T10:59:31.125849+0000","last_active":"2024-09-10T10:59:40.158008+0000","last_peered":"2024-09-10T10:59:40.158008+0000","last_clean":"2024-09-10T10:59:40.158008+0000","last_became_active":"2024-09-10T10:59:31.125487+0000","last_became_peered":"2024-09-10T10:59:31.125487+0000","last_unstale":"2024-09-10T10:59:40.158008+0000","last_undegraded":"2024-09-10T10:59:40.158008+0000","last_fullsized":"2024-09-10T10:59:40.158008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:56.364182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152718+0000","last_change":"2024-09-10T10:59:31.132717+0000","last_active":"2024-09-10T10:59:40.152718+0000","last_peered":"2024-09-10T10:59:40.152718+0000","last_clean":"2024-09-10T10:59:40.152718+0000","last_became_active":"2024-09-10T10:59:31.132258+0000","last_became_peered":"2024-09-10T10:59:31.132258+0000","last_unstale":"2024-09-10T10:59:40.152718+0000","last_undegraded":"2024-09-10T10:59:40.152718+0000","last_fullsized":"2024-09-10T10:59:40.152718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:27.910065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155638+0000","last_change":"2024-09-10T10:59:31.136320+0000","last_active":"2024-09-10T10:59:40.155638+0000","last_peered":"2024-09-10T10:59:40.155638+0000","last_clean":"2024-09-10T10:59:40.155638+0000","last_became_active":"2024-09-10T10:59:31.135970+0000","last_became_peered":"2024-09-10T10:59:31.135970+0000","last_unstale":"2024-09-10T10:59:40.155638+0000","last_undegraded":"2024-09-10T10:59:40.155638+0000","last_fullsized":"2024-09-10T10:59:40.155638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:19.380754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153513+0000","last_change":"2024-09-10T10:59:31.123793+0000","last_active":"2024-09-10T10:59:40.153513+0000","last_peered":"2024-09-10T10:59:40.153513+0000","last_clean":"2024-09-10T10:59:40.153513+0000","last_became_active":"2024-09-10T10:59:31.123502+0000","last_became_peered":"2024-09-10T10:59:31.123502+0000","last_unstale":"2024-09-10T10:59:40.153513+0000","last_undegraded":"2024-09-10T10:59:40.153513+0000","last_fullsized":"2024-09-10T10:59:40.153513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:43.883652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211247+0000","last_change":"2024-09-10T10:59:31.127616+0000","last_active":"2024-09-10T10:59:40.211247+0000","last_peered":"2024-09-10T10:59:40.211247+0000","last_clean":"2024-09-10T10:59:40.211247+0000","last_became_active":"2024-09-10T10:59:31.127296+0000","last_became_peered":"2024-09-10T10:59:31.127296+0000","last_unstale":"2024-09-10T10:59:40.211247+0000","last_undegraded":"2024-09-10T10:59:40.211247+0000","last_fullsized":"2024-09-10T10:59:40.211247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:58.284180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212762+0000","last_change":"2024-09-10T10:59:40.212762+0000","last_active":"2024-09-10T10:59:40.212762+0000","last_peered":"2024-09-10T10:59:40.212762+0000","last_clean":"2024-09-10T10:59:40.212762+0000","last_became_active":"2024-09-10T10:59:40.212356+0000","last_became_peered":"2024-09-10T10:59:40.212356+0000","last_unstale":"2024-09-10T10:59:40.212762+0000","last_undegraded":"2024-09-10T10:59:40.212762+0000","last_fullsized":"2024-09-10T10:59:40.212762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:45.341432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.213553+0000","last_change":"2024-09-10T10:59:40.213553+0000","last_active":"2024-09-10T10:59:40.213553+0000","last_peered":"2024-09-10T10:59:40.213553+0000","last_clean":"2024-09-10T10:59:40.213553+0000","last_became_active":"2024-09-10T10:59:40.213104+0000","last_became_peered":"2024-09-10T10:59:40.213104+0000","last_unstale":"2024-09-10T10:59:40.213553+0000","last_undegraded":"2024-09-10T10:59:40.213553+0000","last_fullsized":"2024-09-10T10:59:40.213553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:24:09.901559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155007+0000","last_change":"2024-09-10T10:59:31.135637+0000","last_active":"2024-09-10T10:59:40.155007+0000","last_peered":"2024-09-10T10:59:40.155007+0000","last_clean":"2024-09-10T10:59:40.155007+0000","last_became_active":"2024-09-10T10:59:31.135286+0000","last_became_peered":"2024-09-10T10:59:31.135286+0000","last_unstale":"2024-09-10T10:59:40.155007+0000","last_undegraded":"2024-09-10T10:59:40.155007+0000","last_fullsized":"2024-09-10T10:59:40.155007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:44:56.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157927+0000","last_change":"2024-09-10T10:59:40.157927+0000","last_active":"2024-09-10T10:59:40.157927+0000","last_peered":"2024-09-10T10:59:40.157927+0000","last_clean":"2024-09-10T10:59:40.157927+0000","last_became_active":"2024-09-10T10:59:40.157506+0000","last_became_peered":"2024-09-10T10:59:40.157506+0000","last_unstale":"2024-09-10T10:59:40.157927+0000","last_undegraded":"2024-09-10T10:59:40.157927+0000","last_fullsized":"2024-09-10T10:59:40.157927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:18.848309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:37.251724+0000","last_change":"2024-09-10T10:59:28.980783+0000","last_active":"2024-09-10T11:00:37.251724+0000","last_peered":"2024-09-10T11:00:37.251724+0000","last_clean":"2024-09-10T11:00:37.251724+0000","last_became_active":"2024-09-10T10:59:28.980420+0000","last_became_peered":"2024-09-10T10:59:28.980420+0000","last_unstale":"2024-09-10T11:00:37.251724+0000","last_undegraded":"2024-09-10T11:00:37.251724+0000","last_fullsized":"2024-09-10T11:00:37.251724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:58.575440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211462+0000","last_change":"2024-09-10T10:59:31.133661+0000","last_active":"2024-09-10T10:59:40.211462+0000","last_peered":"2024-09-10T10:59:40.211462+0000","last_clean":"2024-09-10T10:59:40.211462+0000","last_became_active":"2024-09-10T10:59:31.133323+0000","last_became_peered":"2024-09-10T10:59:31.133323+0000","last_unstale":"2024-09-10T10:59:40.211462+0000","last_undegraded":"2024-09-10T10:59:40.211462+0000","last_fullsized":"2024-09-10T10:59:40.211462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:37.498128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170086+0000","last_change":"2024-09-10T10:59:28.976329+0000","last_active":"2024-09-10T10:59:41.170086+0000","last_peered":"2024-09-10T10:59:41.170086+0000","last_clean":"2024-09-10T10:59:41.170086+0000","last_became_active":"2024-09-10T10:59:28.975937+0000","last_became_peered":"2024-09-10T10:59:28.975937+0000","last_unstale":"2024-09-10T10:59:41.170086+0000","last_undegraded":"2024-09-10T10:59:41.170086+0000","last_fullsized":"2024-09-10T10:59:41.170086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:46.118954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170624+0000","last_change":"2024-09-10T10:59:28.976853+0000","last_active":"2024-09-10T10:59:41.170624+0000","last_peered":"2024-09-10T10:59:41.170624+0000","last_clean":"2024-09-10T10:59:41.170624+0000","last_became_active":"2024-09-10T10:59:28.976524+0000","last_became_peered":"2024-09-10T10:59:28.976524+0000","last_unstale":"2024-09-10T10:59:41.170624+0000","last_undegraded":"2024-09-10T10:59:41.170624+0000","last_fullsized":"2024-09-10T10:59:41.170624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:27.473954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157400+0000","last_change":"2024-09-10T10:59:31.124533+0000","last_active":"2024-09-10T10:59:40.157400+0000","last_peered":"2024-09-10T10:59:40.157400+0000","last_clean":"2024-09-10T10:59:40.157400+0000","last_became_active":"2024-09-10T10:59:31.124179+0000","last_became_peered":"2024-09-10T10:59:31.124179+0000","last_unstale":"2024-09-10T10:59:40.157400+0000","last_undegraded":"2024-09-10T10:59:40.157400+0000","last_fullsized":"2024-09-10T10:59:40.157400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:23.114178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211738+0000","last_change":"2024-09-10T10:59:28.974785+0000","last_active":"2024-09-10T10:59:40.211738+0000","last_peered":"2024-09-10T10:59:40.211738+0000","last_clean":"2024-09-10T10:59:40.211738+0000","last_became_active":"2024-09-10T10:59:28.974499+0000","last_became_peered":"2024-09-10T10:59:28.974499+0000","last_unstale":"2024-09-10T10:59:40.211738+0000","last_undegraded":"2024-09-10T10:59:40.211738+0000","last_fullsized":"2024-09-10T10:59:40.211738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:18.551425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151294+0000","last_change":"2024-09-10T10:59:31.122040+0000","last_active":"2024-09-10T10:59:40.151294+0000","last_peered":"2024-09-10T10:59:40.151294+0000","last_clean":"2024-09-10T10:59:40.151294+0000","last_became_active":"2024-09-10T10:59:31.121683+0000","last_became_peered":"2024-09-10T10:59:31.121683+0000","last_unstale":"2024-09-10T10:59:40.151294+0000","last_undegraded":"2024-09-10T10:59:40.151294+0000","last_fullsized":"2024-09-10T10:59:40.151294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:42.783446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":82,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:37.251049+0000","last_change":"2024-09-10T10:59:28.979068+0000","last_active":"2024-09-10T11:00:37.251049+0000","last_peered":"2024-09-10T11:00:37.251049+0000","last_clean":"2024-09-10T11:00:37.251049+0000","last_became_active":"2024-09-10T10:59:28.978746+0000","last_became_peered":"2024-09-10T10:59:28.978746+0000","last_unstale":"2024-09-10T11:00:37.251049+0000","last_undegraded":"2024-09-10T11:00:37.251049+0000","last_fullsized":"2024-09-10T11:00:37.251049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:30.940050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150814+0000","last_change":"2024-09-10T10:59:31.130966+0000","last_active":"2024-09-10T10:59:40.150814+0000","last_peered":"2024-09-10T10:59:40.150814+0000","last_clean":"2024-09-10T10:59:40.150814+0000","last_became_active":"2024-09-10T10:59:31.130592+0000","last_became_peered":"2024-09-10T10:59:31.130592+0000","last_unstale":"2024-09-10T10:59:40.150814+0000","last_undegraded":"2024-09-10T10:59:40.150814+0000","last_fullsized":"2024-09-10T10:59:40.150814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:59.000694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.183919+0000","last_change":"2024-09-10T10:59:40.182217+0000","last_active":"2024-09-10T10:59:40.183919+0000","last_peered":"2024-09-10T10:59:40.183919+0000","last_clean":"2024-09-10T10:59:40.183919+0000","last_became_active":"2024-09-10T10:59:40.181771+0000","last_became_peered":"2024-09-10T10:59:40.181771+0000","last_unstale":"2024-09-10T10:59:40.183919+0000","last_undegraded":"2024-09-10T10:59:40.183919+0000","last_fullsized":"2024-09-10T10:59:40.183919+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:22.745512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211385+0000","last_change":"2024-09-10T10:59:31.123034+0000","last_active":"2024-09-10T10:59:40.211385+0000","last_peered":"2024-09-10T10:59:40.211385+0000","last_clean":"2024-09-10T10:59:40.211385+0000","last_became_active":"2024-09-10T10:59:31.122721+0000","last_became_peered":"2024-09-10T10:59:31.122721+0000","last_unstale":"2024-09-10T10:59:40.211385+0000","last_undegraded":"2024-09-10T10:59:40.211385+0000","last_fullsized":"2024-09-10T10:59:40.211385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:20.175740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212064+0000","last_change":"2024-09-10T10:59:29.230812+0000","last_active":"2024-09-10T10:59:40.212064+0000","last_peered":"2024-09-10T10:59:40.212064+0000","last_clean":"2024-09-10T10:59:40.212064+0000","last_became_active":"2024-09-10T10:59:29.230450+0000","last_became_peered":"2024-09-10T10:59:29.230450+0000","last_unstale":"2024-09-10T10:59:40.212064+0000","last_undegraded":"2024-09-10T10:59:40.212064+0000","last_fullsized":"2024-09-10T10:59:40.212064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:32.476465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150665+0000","last_change":"2024-09-10T10:59:31.129751+0000","last_active":"2024-09-10T10:59:40.150665+0000","last_peered":"2024-09-10T10:59:40.150665+0000","last_clean":"2024-09-10T10:59:40.150665+0000","last_became_active":"2024-09-10T10:59:31.129420+0000","last_became_peered":"2024-09-10T10:59:31.129420+0000","last_unstale":"2024-09-10T10:59:40.150665+0000","last_undegraded":"2024-09-10T10:59:40.150665+0000","last_fullsized":"2024-09-10T10:59:40.150665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:21.243051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'26","reported_seq":170,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:38.252571+0000","last_change":"2024-09-10T10:59:28.977234+0000","last_active":"2024-09-10T11:00:38.252571+0000","last_peered":"2024-09-10T11:00:38.252571+0000","last_clean":"2024-09-10T11:00:38.252571+0000","last_became_active":"2024-09-10T10:59:28.976897+0000","last_became_peered":"2024-09-10T10:59:28.976897+0000","last_unstale":"2024-09-10T11:00:38.252571+0000","last_undegraded":"2024-09-10T11:00:38.252571+0000","last_fullsized":"2024-09-10T11:00:38.252571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.937110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59211,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":27,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154209+0000","last_change":"2024-09-10T10:59:31.125741+0000","last_active":"2024-09-10T10:59:40.154209+0000","last_peered":"2024-09-10T10:59:40.154209+0000","last_clean":"2024-09-10T10:59:40.154209+0000","last_became_active":"2024-09-10T10:59:31.125369+0000","last_became_peered":"2024-09-10T10:59:31.125369+0000","last_unstale":"2024-09-10T10:59:40.154209+0000","last_undegraded":"2024-09-10T10:59:40.154209+0000","last_fullsized":"2024-09-10T10:59:40.154209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:26.873331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.168438+0000","last_change":"2024-09-10T10:59:28.975326+0000","last_active":"2024-09-10T10:59:41.168438+0000","last_peered":"2024-09-10T10:59:41.168438+0000","last_clean":"2024-09-10T10:59:41.168438+0000","last_became_active":"2024-09-10T10:59:28.975004+0000","last_became_peered":"2024-09-10T10:59:28.975004+0000","last_unstale":"2024-09-10T10:59:41.168438+0000","last_undegraded":"2024-09-10T10:59:41.168438+0000","last_fullsized":"2024-09-10T10:59:41.168438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:11.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153138+0000","last_change":"2024-09-10T10:59:31.125916+0000","last_active":"2024-09-10T10:59:40.153138+0000","last_peered":"2024-09-10T10:59:40.153138+0000","last_clean":"2024-09-10T10:59:40.153138+0000","last_became_active":"2024-09-10T10:59:31.125591+0000","last_became_peered":"2024-09-10T10:59:31.125591+0000","last_unstale":"2024-09-10T10:59:40.153138+0000","last_undegraded":"2024-09-10T10:59:40.153138+0000","last_fullsized":"2024-09-10T10:59:40.153138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:19.512266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211706+0000","last_change":"2024-09-10T10:59:28.980967+0000","last_active":"2024-09-10T10:59:40.211706+0000","last_peered":"2024-09-10T10:59:40.211706+0000","last_clean":"2024-09-10T10:59:40.211706+0000","last_became_active":"2024-09-10T10:59:28.980176+0000","last_became_peered":"2024-09-10T10:59:28.980176+0000","last_unstale":"2024-09-10T10:59:40.211706+0000","last_undegraded":"2024-09-10T10:59:40.211706+0000","last_fullsized":"2024-09-10T10:59:40.211706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:56.327936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152737+0000","last_change":"2024-09-10T10:59:31.127819+0000","last_active":"2024-09-10T10:59:40.152737+0000","last_peered":"2024-09-10T10:59:40.152737+0000","last_clean":"2024-09-10T10:59:40.152737+0000","last_became_active":"2024-09-10T10:59:31.127503+0000","last_became_peered":"2024-09-10T10:59:31.127503+0000","last_unstale":"2024-09-10T10:59:40.152737+0000","last_undegraded":"2024-09-10T10:59:40.152737+0000","last_fullsized":"2024-09-10T10:59:40.152737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:17.014121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:37.265313+0000","last_change":"2024-09-10T10:59:28.980881+0000","last_active":"2024-09-10T11:00:37.265313+0000","last_peered":"2024-09-10T11:00:37.265313+0000","last_clean":"2024-09-10T11:00:37.265313+0000","last_became_active":"2024-09-10T10:59:28.980452+0000","last_became_peered":"2024-09-10T10:59:28.980452+0000","last_unstale":"2024-09-10T11:00:37.265313+0000","last_undegraded":"2024-09-10T11:00:37.265313+0000","last_fullsized":"2024-09-10T11:00:37.265313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:00.373348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152392+0000","last_change":"2024-09-10T10:59:31.120463+0000","last_active":"2024-09-10T10:59:40.152392+0000","last_peered":"2024-09-10T10:59:40.152392+0000","last_clean":"2024-09-10T10:59:40.152392+0000","last_became_active":"2024-09-10T10:59:31.120122+0000","last_became_peered":"2024-09-10T10:59:31.120122+0000","last_unstale":"2024-09-10T10:59:40.152392+0000","last_undegraded":"2024-09-10T10:59:40.152392+0000","last_fullsized":"2024-09-10T10:59:40.152392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:37.425553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170329+0000","last_change":"2024-09-10T10:59:29.230592+0000","last_active":"2024-09-10T10:59:41.170329+0000","last_peered":"2024-09-10T10:59:41.170329+0000","last_clean":"2024-09-10T10:59:41.170329+0000","last_became_active":"2024-09-10T10:59:29.230205+0000","last_became_peered":"2024-09-10T10:59:29.230205+0000","last_unstale":"2024-09-10T10:59:41.170329+0000","last_undegraded":"2024-09-10T10:59:41.170329+0000","last_fullsized":"2024-09-10T10:59:41.170329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:00.671805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211929+0000","last_change":"2024-09-10T10:59:31.132506+0000","last_active":"2024-09-10T10:59:40.211929+0000","last_peered":"2024-09-10T10:59:40.211929+0000","last_clean":"2024-09-10T10:59:40.211929+0000","last_became_active":"2024-09-10T10:59:31.132038+0000","last_became_peered":"2024-09-10T10:59:31.132038+0000","last_unstale":"2024-09-10T10:59:40.211929+0000","last_undegraded":"2024-09-10T10:59:40.211929+0000","last_fullsized":"2024-09-10T10:59:40.211929+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:09.872032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:42.164709+0000","last_change":"2024-09-10T10:59:28.976756+0000","last_active":"2024-09-10T10:59:42.164709+0000","last_peered":"2024-09-10T10:59:42.164709+0000","last_clean":"2024-09-10T10:59:42.164709+0000","last_became_active":"2024-09-10T10:59:28.976429+0000","last_became_peered":"2024-09-10T10:59:28.976429+0000","last_unstale":"2024-09-10T10:59:42.164709+0000","last_undegraded":"2024-09-10T10:59:42.164709+0000","last_fullsized":"2024-09-10T10:59:42.164709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:41.679474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155401+0000","last_change":"2024-09-10T10:59:31.135768+0000","last_active":"2024-09-10T10:59:40.155401+0000","last_peered":"2024-09-10T10:59:40.155401+0000","last_clean":"2024-09-10T10:59:40.155401+0000","last_became_active":"2024-09-10T10:59:31.135420+0000","last_became_peered":"2024-09-10T10:59:31.135420+0000","last_unstale":"2024-09-10T10:59:40.155401+0000","last_undegraded":"2024-09-10T10:59:40.155401+0000","last_fullsized":"2024-09-10T10:59:40.155401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:02.983500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153716+0000","last_change":"2024-09-10T10:59:28.972185+0000","last_active":"2024-09-10T10:59:40.153716+0000","last_peered":"2024-09-10T10:59:40.153716+0000","last_clean":"2024-09-10T10:59:40.153716+0000","last_became_active":"2024-09-10T10:59:28.971813+0000","last_became_peered":"2024-09-10T10:59:28.971813+0000","last_unstale":"2024-09-10T10:59:40.153716+0000","last_undegraded":"2024-09-10T10:59:40.153716+0000","last_fullsized":"2024-09-10T10:59:40.153716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:53.612465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152705+0000","last_change":"2024-09-10T10:59:31.130197+0000","last_active":"2024-09-10T10:59:40.152705+0000","last_peered":"2024-09-10T10:59:40.152705+0000","last_clean":"2024-09-10T10:59:40.152705+0000","last_became_active":"2024-09-10T10:59:31.129596+0000","last_became_peered":"2024-09-10T10:59:31.129596+0000","last_unstale":"2024-09-10T10:59:40.152705+0000","last_undegraded":"2024-09-10T10:59:40.152705+0000","last_fullsized":"2024-09-10T10:59:40.152705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:23.962924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212176+0000","last_change":"2024-09-10T10:59:28.973990+0000","last_active":"2024-09-10T10:59:40.212176+0000","last_peered":"2024-09-10T10:59:40.212176+0000","last_clean":"2024-09-10T10:59:40.212176+0000","last_became_active":"2024-09-10T10:59:28.973647+0000","last_became_peered":"2024-09-10T10:59:28.973647+0000","last_unstale":"2024-09-10T10:59:40.212176+0000","last_undegraded":"2024-09-10T10:59:40.212176+0000","last_fullsized":"2024-09-10T10:59:40.212176+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:25.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153427+0000","last_change":"2024-09-10T10:59:31.135603+0000","last_active":"2024-09-10T10:59:40.153427+0000","last_peered":"2024-09-10T10:59:40.153427+0000","last_clean":"2024-09-10T10:59:40.153427+0000","last_became_active":"2024-09-10T10:59:31.135208+0000","last_became_peered":"2024-09-10T10:59:31.135208+0000","last_unstale":"2024-09-10T10:59:40.153427+0000","last_undegraded":"2024-09-10T10:59:40.153427+0000","last_fullsized":"2024-09-10T10:59:40.153427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:50.578770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.476974+0000","last_change":"2024-09-10T10:59:40.212180+0000","last_active":"2024-09-10T10:59:41.476974+0000","last_peered":"2024-09-10T10:59:41.476974+0000","last_clean":"2024-09-10T10:59:41.476974+0000","last_became_active":"2024-09-10T10:59:40.211860+0000","last_became_peered":"2024-09-10T10:59:40.211860+0000","last_unstale":"2024-09-10T10:59:41.476974+0000","last_undegraded":"2024-09-10T10:59:41.476974+0000","last_fullsized":"2024-09-10T10:59:41.476974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:09.718612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153216+0000","last_change":"2024-09-10T10:59:31.126162+0000","last_active":"2024-09-10T10:59:40.153216+0000","last_peered":"2024-09-10T10:59:40.153216+0000","last_clean":"2024-09-10T10:59:40.153216+0000","last_became_active":"2024-09-10T10:59:31.125661+0000","last_became_peered":"2024-09-10T10:59:31.125661+0000","last_unstale":"2024-09-10T10:59:40.153216+0000","last_undegraded":"2024-09-10T10:59:40.153216+0000","last_fullsized":"2024-09-10T10:59:40.153216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:36.677732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152671+0000","last_change":"2024-09-10T10:58:17.630377+0000","last_active":"2024-09-10T10:59:40.152671+0000","last_peered":"2024-09-10T10:59:40.152671+0000","last_clean":"2024-09-10T10:59:40.152671+0000","last_became_active":"2024-09-10T10:58:17.629956+0000","last_became_peered":"2024-09-10T10:58:17.629956+0000","last_unstale":"2024-09-10T10:59:40.152671+0000","last_undegraded":"2024-09-10T10:59:40.152671+0000","last_fullsized":"2024-09-10T10:59:40.152671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:54:53.218596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:54:53.218596+0000","last_clean_scrub_stamp":"2024-09-10T10:54:53.218596+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:44.005115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:42.170755+0000","last_change":"2024-09-10T10:59:28.975307+0000","last_active":"2024-09-10T10:59:42.170755+0000","last_peered":"2024-09-10T10:59:42.170755+0000","last_clean":"2024-09-10T10:59:42.170755+0000","last_became_active":"2024-09-10T10:59:28.974959+0000","last_became_peered":"2024-09-10T10:59:28.974959+0000","last_unstale":"2024-09-10T10:59:42.170755+0000","last_undegraded":"2024-09-10T10:59:42.170755+0000","last_fullsized":"2024-09-10T10:59:42.170755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:59.923354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157346+0000","last_change":"2024-09-10T10:59:31.124267+0000","last_active":"2024-09-10T10:59:40.157346+0000","last_peered":"2024-09-10T10:59:40.157346+0000","last_clean":"2024-09-10T10:59:40.157346+0000","last_became_active":"2024-09-10T10:59:31.123894+0000","last_became_peered":"2024-09-10T10:59:31.123894+0000","last_unstale":"2024-09-10T10:59:40.157346+0000","last_undegraded":"2024-09-10T10:59:40.157346+0000","last_fullsized":"2024-09-10T10:59:40.157346+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:54.657970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.169251+0000","last_change":"2024-09-10T10:59:28.977213+0000","last_active":"2024-09-10T10:59:41.169251+0000","last_peered":"2024-09-10T10:59:41.169251+0000","last_clean":"2024-09-10T10:59:41.169251+0000","last_became_active":"2024-09-10T10:59:28.976909+0000","last_became_peered":"2024-09-10T10:59:28.976909+0000","last_unstale":"2024-09-10T10:59:41.169251+0000","last_undegraded":"2024-09-10T10:59:41.169251+0000","last_fullsized":"2024-09-10T10:59:41.169251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:24.640147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152773+0000","last_change":"2024-09-10T10:59:31.129703+0000","last_active":"2024-09-10T10:59:40.152773+0000","last_peered":"2024-09-10T10:59:40.152773+0000","last_clean":"2024-09-10T10:59:40.152773+0000","last_became_active":"2024-09-10T10:59:31.129401+0000","last_became_peered":"2024-09-10T10:59:31.129401+0000","last_unstale":"2024-09-10T10:59:40.152773+0000","last_undegraded":"2024-09-10T10:59:40.152773+0000","last_fullsized":"2024-09-10T10:59:40.152773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:37.431852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:37.264521+0000","last_change":"2024-09-10T10:59:29.230556+0000","last_active":"2024-09-10T11:00:37.264521+0000","last_peered":"2024-09-10T11:00:37.264521+0000","last_clean":"2024-09-10T11:00:37.264521+0000","last_became_active":"2024-09-10T10:59:29.230129+0000","last_became_peered":"2024-09-10T10:59:29.230129+0000","last_unstale":"2024-09-10T11:00:37.264521+0000","last_undegraded":"2024-09-10T11:00:37.264521+0000","last_fullsized":"2024-09-10T11:00:37.264521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:31.903008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211592+0000","last_change":"2024-09-10T10:59:31.131687+0000","last_active":"2024-09-10T10:59:40.211592+0000","last_peered":"2024-09-10T10:59:40.211592+0000","last_clean":"2024-09-10T10:59:40.211592+0000","last_became_active":"2024-09-10T10:59:31.131373+0000","last_became_peered":"2024-09-10T10:59:31.131373+0000","last_unstale":"2024-09-10T10:59:40.211592+0000","last_undegraded":"2024-09-10T10:59:40.211592+0000","last_fullsized":"2024-09-10T10:59:40.211592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:03.923639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152936+0000","last_change":"2024-09-10T10:59:28.977557+0000","last_active":"2024-09-10T10:59:40.152936+0000","last_peered":"2024-09-10T10:59:40.152936+0000","last_clean":"2024-09-10T10:59:40.152936+0000","last_became_active":"2024-09-10T10:59:28.977203+0000","last_became_peered":"2024-09-10T10:59:28.977203+0000","last_unstale":"2024-09-10T10:59:40.152936+0000","last_undegraded":"2024-09-10T10:59:40.152936+0000","last_fullsized":"2024-09-10T10:59:40.152936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:25:29.880758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153759+0000","last_change":"2024-09-10T10:59:31.123998+0000","last_active":"2024-09-10T10:59:40.153759+0000","last_peered":"2024-09-10T10:59:40.153759+0000","last_clean":"2024-09-10T10:59:40.153759+0000","last_became_active":"2024-09-10T10:59:31.123645+0000","last_became_peered":"2024-09-10T10:59:31.123645+0000","last_unstale":"2024-09-10T10:59:40.153759+0000","last_undegraded":"2024-09-10T10:59:40.153759+0000","last_fullsized":"2024-09-10T10:59:40.153759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:47.607733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152223+0000","last_change":"2024-09-10T10:59:29.231291+0000","last_active":"2024-09-10T10:59:40.152223+0000","last_peered":"2024-09-10T10:59:40.152223+0000","last_clean":"2024-09-10T10:59:40.152223+0000","last_became_active":"2024-09-10T10:59:29.230946+0000","last_became_peered":"2024-09-10T10:59:29.230946+0000","last_unstale":"2024-09-10T10:59:40.152223+0000","last_undegraded":"2024-09-10T10:59:40.152223+0000","last_fullsized":"2024-09-10T10:59:40.152223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:55.268743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153274+0000","last_change":"2024-09-10T10:59:31.122359+0000","last_active":"2024-09-10T10:59:40.153274+0000","last_peered":"2024-09-10T10:59:40.153274+0000","last_clean":"2024-09-10T10:59:40.153274+0000","last_became_active":"2024-09-10T10:59:31.120741+0000","last_became_peered":"2024-09-10T10:59:31.120741+0000","last_unstale":"2024-09-10T10:59:40.153274+0000","last_undegraded":"2024-09-10T10:59:40.153274+0000","last_fullsized":"2024-09-10T10:59:40.153274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:02.827031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154484+0000","last_change":"2024-09-10T10:59:29.231008+0000","last_active":"2024-09-10T10:59:40.154484+0000","last_peered":"2024-09-10T10:59:40.154484+0000","last_clean":"2024-09-10T10:59:40.154484+0000","last_became_active":"2024-09-10T10:59:29.230638+0000","last_became_peered":"2024-09-10T10:59:29.230638+0000","last_unstale":"2024-09-10T10:59:40.154484+0000","last_undegraded":"2024-09-10T10:59:40.154484+0000","last_fullsized":"2024-09-10T10:59:40.154484+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.358831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153600+0000","last_change":"2024-09-10T10:59:31.129049+0000","last_active":"2024-09-10T10:59:40.153600+0000","last_peered":"2024-09-10T10:59:40.153600+0000","last_clean":"2024-09-10T10:59:40.153600+0000","last_became_active":"2024-09-10T10:59:31.128746+0000","last_became_peered":"2024-09-10T10:59:31.128746+0000","last_unstale":"2024-09-10T10:59:40.153600+0000","last_undegraded":"2024-09-10T10:59:40.153600+0000","last_fullsized":"2024-09-10T10:59:40.153600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:25.719609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:56.119318+0000","last_change":"2024-09-10T10:59:28.973043+0000","last_active":"2024-09-10T10:59:56.119318+0000","last_peered":"2024-09-10T10:59:56.119318+0000","last_clean":"2024-09-10T10:59:56.119318+0000","last_became_active":"2024-09-10T10:59:28.972633+0000","last_became_peered":"2024-09-10T10:59:28.972633+0000","last_unstale":"2024-09-10T10:59:56.119318+0000","last_undegraded":"2024-09-10T10:59:56.119318+0000","last_fullsized":"2024-09-10T10:59:56.119318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:51.858279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158104+0000","last_change":"2024-09-10T10:59:31.124663+0000","last_active":"2024-09-10T10:59:40.158104+0000","last_peered":"2024-09-10T10:59:40.158104+0000","last_clean":"2024-09-10T10:59:40.158104+0000","last_became_active":"2024-09-10T10:59:31.124312+0000","last_became_peered":"2024-09-10T10:59:31.124312+0000","last_unstale":"2024-09-10T10:59:40.158104+0000","last_undegraded":"2024-09-10T10:59:40.158104+0000","last_fullsized":"2024-09-10T10:59:40.158104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:03.530208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.180952+0000","last_change":"2024-09-10T10:59:29.461846+0000","last_active":"2024-09-10T10:59:40.180952+0000","last_peered":"2024-09-10T10:59:40.180952+0000","last_clean":"2024-09-10T10:59:40.180952+0000","last_became_active":"2024-09-10T10:59:29.461485+0000","last_became_peered":"2024-09-10T10:59:29.461485+0000","last_unstale":"2024-09-10T10:59:40.180952+0000","last_undegraded":"2024-09-10T10:59:40.180952+0000","last_fullsized":"2024-09-10T10:59:40.180952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:28.071947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211184+0000","last_change":"2024-09-10T10:59:31.122234+0000","last_active":"2024-09-10T10:59:40.211184+0000","last_peered":"2024-09-10T10:59:40.211184+0000","last_clean":"2024-09-10T10:59:40.211184+0000","last_became_active":"2024-09-10T10:59:31.121909+0000","last_became_peered":"2024-09-10T10:59:31.121909+0000","last_unstale":"2024-09-10T10:59:40.211184+0000","last_undegraded":"2024-09-10T10:59:40.211184+0000","last_fullsized":"2024-09-10T10:59:40.211184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:37.263257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150552+0000","last_change":"2024-09-10T10:59:29.230543+0000","last_active":"2024-09-10T10:59:40.150552+0000","last_peered":"2024-09-10T10:59:40.150552+0000","last_clean":"2024-09-10T10:59:40.150552+0000","last_became_active":"2024-09-10T10:59:29.230256+0000","last_became_peered":"2024-09-10T10:59:29.230256+0000","last_unstale":"2024-09-10T10:59:40.150552+0000","last_undegraded":"2024-09-10T10:59:40.150552+0000","last_fullsized":"2024-09-10T10:59:40.150552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:05.336402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153044+0000","last_change":"2024-09-10T10:59:31.121898+0000","last_active":"2024-09-10T10:59:40.153044+0000","last_peered":"2024-09-10T10:59:40.153044+0000","last_clean":"2024-09-10T10:59:40.153044+0000","last_became_active":"2024-09-10T10:59:31.121478+0000","last_became_peered":"2024-09-10T10:59:31.121478+0000","last_unstale":"2024-09-10T10:59:40.153044+0000","last_undegraded":"2024-09-10T10:59:40.153044+0000","last_fullsized":"2024-09-10T10:59:40.153044+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:01.805762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157141+0000","last_change":"2024-09-10T10:59:28.974086+0000","last_active":"2024-09-10T10:59:40.157141+0000","last_peered":"2024-09-10T10:59:40.157141+0000","last_clean":"2024-09-10T10:59:40.157141+0000","last_became_active":"2024-09-10T10:59:28.973801+0000","last_became_peered":"2024-09-10T10:59:28.973801+0000","last_unstale":"2024-09-10T10:59:40.157141+0000","last_undegraded":"2024-09-10T10:59:40.157141+0000","last_fullsized":"2024-09-10T10:59:40.157141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:10.338340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155611+0000","last_change":"2024-09-10T10:59:31.130301+0000","last_active":"2024-09-10T10:59:40.155611+0000","last_peered":"2024-09-10T10:59:40.155611+0000","last_clean":"2024-09-10T10:59:40.155611+0000","last_became_active":"2024-09-10T10:59:31.129959+0000","last_became_peered":"2024-09-10T10:59:31.129959+0000","last_unstale":"2024-09-10T10:59:40.155611+0000","last_undegraded":"2024-09-10T10:59:40.155611+0000","last_fullsized":"2024-09-10T10:59:40.155611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:32.131310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152650+0000","last_change":"2024-09-10T10:59:28.976683+0000","last_active":"2024-09-10T10:59:40.152650+0000","last_peered":"2024-09-10T10:59:40.152650+0000","last_clean":"2024-09-10T10:59:40.152650+0000","last_became_active":"2024-09-10T10:59:28.976278+0000","last_became_peered":"2024-09-10T10:59:28.976278+0000","last_unstale":"2024-09-10T10:59:40.152650+0000","last_undegraded":"2024-09-10T10:59:40.152650+0000","last_fullsized":"2024-09-10T10:59:40.152650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:49.100274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157441+0000","last_change":"2024-09-10T10:59:31.118400+0000","last_active":"2024-09-10T10:59:40.157441+0000","last_peered":"2024-09-10T10:59:40.157441+0000","last_clean":"2024-09-10T10:59:40.157441+0000","last_became_active":"2024-09-10T10:59:31.118067+0000","last_became_peered":"2024-09-10T10:59:31.118067+0000","last_unstale":"2024-09-10T10:59:40.157441+0000","last_undegraded":"2024-09-10T10:59:40.157441+0000","last_fullsized":"2024-09-10T10:59:40.157441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:03.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.162110+0000","last_change":"2024-09-10T10:59:40.161592+0000","last_active":"2024-09-10T10:59:40.162110+0000","last_peered":"2024-09-10T10:59:40.162110+0000","last_clean":"2024-09-10T10:59:40.162110+0000","last_became_active":"2024-09-10T10:59:40.156968+0000","last_became_peered":"2024-09-10T10:59:40.156968+0000","last_unstale":"2024-09-10T10:59:40.162110+0000","last_undegraded":"2024-09-10T10:59:40.162110+0000","last_fullsized":"2024-09-10T10:59:40.162110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:20.107251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152634+0000","last_change":"2024-09-10T10:59:31.132779+0000","last_active":"2024-09-10T10:59:40.152634+0000","last_peered":"2024-09-10T10:59:40.152634+0000","last_clean":"2024-09-10T10:59:40.152634+0000","last_became_active":"2024-09-10T10:59:31.132417+0000","last_became_peered":"2024-09-10T10:59:31.132417+0000","last_unstale":"2024-09-10T10:59:40.152634+0000","last_undegraded":"2024-09-10T10:59:40.152634+0000","last_fullsized":"2024-09-10T10:59:40.152634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:47.640774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211900+0000","last_change":"2024-09-10T10:59:31.133370+0000","last_active":"2024-09-10T10:59:40.211900+0000","last_peered":"2024-09-10T10:59:40.211900+0000","last_clean":"2024-09-10T10:59:40.211900+0000","last_became_active":"2024-09-10T10:59:31.133027+0000","last_became_peered":"2024-09-10T10:59:31.133027+0000","last_unstale":"2024-09-10T10:59:40.211900+0000","last_undegraded":"2024-09-10T10:59:40.211900+0000","last_fullsized":"2024-09-10T10:59:40.211900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:24.550987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154242+0000","last_change":"2024-09-10T10:59:28.973416+0000","last_active":"2024-09-10T10:59:40.154242+0000","last_peered":"2024-09-10T10:59:40.154242+0000","last_clean":"2024-09-10T10:59:40.154242+0000","last_became_active":"2024-09-10T10:59:28.973050+0000","last_became_peered":"2024-09-10T10:59:28.973050+0000","last_unstale":"2024-09-10T10:59:40.154242+0000","last_undegraded":"2024-09-10T10:59:40.154242+0000","last_fullsized":"2024-09-10T10:59:40.154242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:00.013173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150537+0000","last_change":"2024-09-10T10:59:31.132568+0000","last_active":"2024-09-10T10:59:40.150537+0000","last_peered":"2024-09-10T10:59:40.150537+0000","last_clean":"2024-09-10T10:59:40.150537+0000","last_became_active":"2024-09-10T10:59:31.132260+0000","last_became_peered":"2024-09-10T10:59:31.132260+0000","last_unstale":"2024-09-10T10:59:40.150537+0000","last_undegraded":"2024-09-10T10:59:40.150537+0000","last_fullsized":"2024-09-10T10:59:40.150537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:14.420293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.169008+0000","last_change":"2024-09-10T10:59:28.981404+0000","last_active":"2024-09-10T10:59:41.169008+0000","last_peered":"2024-09-10T10:59:41.169008+0000","last_clean":"2024-09-10T10:59:41.169008+0000","last_became_active":"2024-09-10T10:59:28.981066+0000","last_became_peered":"2024-09-10T10:59:28.981066+0000","last_unstale":"2024-09-10T10:59:41.169008+0000","last_undegraded":"2024-09-10T10:59:41.169008+0000","last_fullsized":"2024-09-10T10:59:41.169008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:16.075280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211311+0000","last_change":"2024-09-10T10:59:31.133696+0000","last_active":"2024-09-10T10:59:40.211311+0000","last_peered":"2024-09-10T10:59:40.211311+0000","last_clean":"2024-09-10T10:59:40.211311+0000","last_became_active":"2024-09-10T10:59:31.132978+0000","last_became_peered":"2024-09-10T10:59:31.132978+0000","last_unstale":"2024-09-10T10:59:40.211311+0000","last_undegraded":"2024-09-10T10:59:40.211311+0000","last_fullsized":"2024-09-10T10:59:40.211311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:37.273524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158089+0000","last_change":"2024-09-10T10:59:29.230472+0000","last_active":"2024-09-10T10:59:40.158089+0000","last_peered":"2024-09-10T10:59:40.158089+0000","last_clean":"2024-09-10T10:59:40.158089+0000","last_became_active":"2024-09-10T10:59:29.230128+0000","last_became_peered":"2024-09-10T10:59:29.230128+0000","last_unstale":"2024-09-10T10:59:40.158089+0000","last_undegraded":"2024-09-10T10:59:40.158089+0000","last_fullsized":"2024-09-10T10:59:40.158089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:26.116922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157847+0000","last_change":"2024-09-10T10:59:31.132406+0000","last_active":"2024-09-10T10:59:40.157847+0000","last_peered":"2024-09-10T10:59:40.157847+0000","last_clean":"2024-09-10T10:59:40.157847+0000","last_became_active":"2024-09-10T10:59:31.132088+0000","last_became_peered":"2024-09-10T10:59:31.132088+0000","last_unstale":"2024-09-10T10:59:40.157847+0000","last_undegraded":"2024-09-10T10:59:40.157847+0000","last_fullsized":"2024-09-10T10:59:40.157847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:47.222192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170194+0000","last_change":"2024-09-10T10:59:28.978103+0000","last_active":"2024-09-10T10:59:41.170194+0000","last_peered":"2024-09-10T10:59:41.170194+0000","last_clean":"2024-09-10T10:59:41.170194+0000","last_became_active":"2024-09-10T10:59:28.977918+0000","last_became_peered":"2024-09-10T10:59:28.977918+0000","last_unstale":"2024-09-10T10:59:41.170194+0000","last_undegraded":"2024-09-10T10:59:41.170194+0000","last_fullsized":"2024-09-10T10:59:41.170194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.157534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63607,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":370,"num_read_kb":252,"num_write":159,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":212318,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":438088,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":1089173,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438324,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438244,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030569,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561077,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":437713,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790010,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":1029860,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":438543,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215171,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438024,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":497878,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":497299,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":438984,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34293,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34293,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:00:39.518 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T11:00:39.785 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:40.074 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:39 smithi059 ceph-mon[30978]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:40.074 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:39 smithi059 ceph-mon[30978]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:00:40.074 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:39 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-10T11:00:40.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:39 smithi181 ceph-mon[35409]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:40.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:39 smithi181 ceph-mon[35409]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:00:40.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:39 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-10T11:00:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:39 smithi115 ceph-mon[34719]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:00:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:39 smithi115 ceph-mon[34719]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:00:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:39 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-10T11:00:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.304+0000 7f3efec05640 1 -- 172.21.15.59:0/1532195816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 msgr2=0x7f3ef8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.304+0000 7f3efec05640 1 --2- 172.21.15.59:0/1532195816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 0x7f3ef8107b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009930 tx=0x7f3ee002a420 comp rx=0 tx=0).stop 2024-09-10T11:00:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 -- 172.21.15.59:0/1532195816 shutdown_connections 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 --2- 172.21.15.59:0/1532195816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ef81082a0 0x7f3ef810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 --2- 172.21.15.59:0/1532195816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 0x7f3ef8107b90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 --2- 172.21.15.59:0/1532195816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef8102d30 0x7f3ef8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 -- 172.21.15.59:0/1532195816 >> 172.21.15.59:0/1532195816 conn(0x7f3ef80fc7d0 msgr2=0x7f3ef80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 -- 172.21.15.59:0/1532195816 shutdown_connections 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 -- 172.21.15.59:0/1532195816 wait complete. 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 Processor -- start 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 -- start start 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef8102d30 0x7f3ef8198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 0x7f3ef8198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ef81082a0 0x7f3ef819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef81120c0 con 0x7f3ef81036e0 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8111f40 con 0x7f3ef81082a0 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.305+0000 7f3efec05640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8112240 con 0x7f3ef8102d30 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 0x7f3ef8198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 0x7f3ef8198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57142/0 (socket says 172.21.15.59:57142) 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef7fff640 1 -- 172.21.15.59:0/3609769503 learned_addr learned my addr 172.21.15.59:0/3609769503 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3efd1a2640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ef81082a0 0x7f3ef819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3efc9a1640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef8102d30 0x7f3ef8198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef7fff640 1 -- 172.21.15.59:0/3609769503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef8102d30 msgr2=0x7f3ef8198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef7fff640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef8102d30 0x7f3ef8198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef7fff640 1 -- 172.21.15.59:0/3609769503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ef81082a0 msgr2=0x7f3ef819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef7fff640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ef81082a0 0x7f3ef819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef7fff640 1 -- 172.21.15.59:0/3609769503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef819d5f0 con 0x7f3ef81036e0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef7fff640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 0x7f3ef8198b80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0005940 tx=0x7f3ee00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef5ffb640 1 -- 172.21.15.59:0/3609769503 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee003f030 con 0x7f3ef81036e0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef5ffb640 1 -- 172.21.15.59:0/3609769503 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ee0003ce0 con 0x7f3ef81036e0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef819d880 con 0x7f3ef81036e0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.306+0000 7f3ef5ffb640 1 -- 172.21.15.59:0/3609769503 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0035070 con 0x7f3ef81036e0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.307+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef81a51c0 con 0x7f3ef81036e0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.308+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef806a850 con 0x7f3ef81036e0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.309+0000 7f3ef5ffb640 1 -- 172.21.15.59:0/3609769503 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3ee0042030 con 0x7f3ef81036e0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.309+0000 7f3ef5ffb640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ee40a2c10 0x7f3ee40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.310+0000 7f3efc9a1640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ee40a2c10 0x7f3ee40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.310+0000 7f3ef5ffb640 1 -- 172.21.15.59:0/3609769503 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f3ee00ef720 con 0x7f3ef81036e0 2024-09-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.310+0000 7f3efc9a1640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ee40a2c10 0x7f3ee40a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009890 tx=0x7f3ef0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.314+0000 7f3ef5ffb640 1 -- 172.21.15.59:0/3609769503 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ee00bc480 con 0x7f3ef81036e0 2024-09-10T11:00:40.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.488+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ef8062630 con 0x7f3ee40a2c10 2024-09-10T11:00:40.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.495+0000 7f3ef5ffb640 1 -- 172.21.15.59:0/3609769503 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258915 (secure 0 0 0) 0x7f3ef8062630 con 0x7f3ee40a2c10 2024-09-10T11:00:40.498 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T11:00:40.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ee40a2c10 msgr2=0x7f3ee40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:40.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ee40a2c10 0x7f3ee40a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009890 tx=0x7f3ef0008040 comp rx=0 tx=0).stop 2024-09-10T11:00:40.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 msgr2=0x7f3ef8198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:40.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 0x7f3ef8198b80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0005940 tx=0x7f3ee00042f0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 shutdown_connections 2024-09-10T11:00:40.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ee40a2c10 0x7f3ee40a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ef81082a0 0x7f3ef819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef81036e0 0x7f3ef8198b80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 --2- 172.21.15.59:0/3609769503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef8102d30 0x7f3ef8198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:40.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 >> 172.21.15.59:0/3609769503 conn(0x7f3ef80fc7d0 msgr2=0x7f3ef8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:40.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 shutdown_connections 2024-09-10T11:00:40.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:40.498+0000 7f3efec05640 1 -- 172.21.15.59:0/3609769503 wait complete. 2024-09-10T11:00:41.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:40 smithi181 ceph-mon[35409]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-10T11:00:41.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:40 smithi181 ceph-mon[35409]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T11:00:41.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:40 smithi181 ceph-mon[35409]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:00:41.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:40 smithi115 ceph-mon[34719]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-10T11:00:41.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:40 smithi115 ceph-mon[34719]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T11:00:41.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:40 smithi115 ceph-mon[34719]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:00:41.291 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:40 smithi059 ceph-mon[30978]: from='mgr.14150 172.21.15.59:0/1062113586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-10T11:00:41.292 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:40 smithi059 ceph-mon[30978]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T11:00:41.292 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:40 smithi059 ceph-mon[30978]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-10T11:00:39.888646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654209,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":506,"num_read_kb":371,"num_write":342,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364468,"kb_used_data":11040,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577356,"statfs":{"total":1151940427776,"available":1151567212544,"internally_reserved":0,"allocated":11304960,"data_stored":7212699,"data_compressed":176979,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.167470"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155754+0000","last_change":"2024-09-10T10:59:31.132551+0000","last_active":"2024-09-10T10:59:40.155754+0000","last_peered":"2024-09-10T10:59:40.155754+0000","last_clean":"2024-09-10T10:59:40.155754+0000","last_became_active":"2024-09-10T10:59:31.132002+0000","last_became_peered":"2024-09-10T10:59:31.132002+0000","last_unstale":"2024-09-10T10:59:40.155754+0000","last_undegraded":"2024-09-10T10:59:40.155754+0000","last_fullsized":"2024-09-10T10:59:40.155754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:14.696067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211064+0000","last_change":"2024-09-10T10:59:31.129868+0000","last_active":"2024-09-10T10:59:40.211064+0000","last_peered":"2024-09-10T10:59:40.211064+0000","last_clean":"2024-09-10T10:59:40.211064+0000","last_became_active":"2024-09-10T10:59:31.129566+0000","last_became_peered":"2024-09-10T10:59:31.129566+0000","last_unstale":"2024-09-10T10:59:40.211064+0000","last_undegraded":"2024-09-10T10:59:40.211064+0000","last_fullsized":"2024-09-10T10:59:40.211064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:30.890000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211128+0000","last_change":"2024-09-10T10:59:31.134021+0000","last_active":"2024-09-10T10:59:40.211128+0000","last_peered":"2024-09-10T10:59:40.211128+0000","last_clean":"2024-09-10T10:59:40.211128+0000","last_became_active":"2024-09-10T10:59:31.133378+0000","last_became_peered":"2024-09-10T10:59:31.133378+0000","last_unstale":"2024-09-10T10:59:40.211128+0000","last_undegraded":"2024-09-10T10:59:40.211128+0000","last_fullsized":"2024-09-10T10:59:40.211128+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:32.808518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.156639+0000","last_change":"2024-09-10T10:59:40.156045+0000","last_active":"2024-09-10T10:59:40.156639+0000","last_peered":"2024-09-10T10:59:40.156639+0000","last_clean":"2024-09-10T10:59:40.156639+0000","last_became_active":"2024-09-10T10:59:40.155722+0000","last_became_peered":"2024-09-10T10:59:40.155722+0000","last_unstale":"2024-09-10T10:59:40.156639+0000","last_undegraded":"2024-09-10T10:59:40.156639+0000","last_fullsized":"2024-09-10T10:59:40.156639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:55.413173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153086+0000","last_change":"2024-09-10T10:59:31.128308+0000","last_active":"2024-09-10T10:59:40.153086+0000","last_peered":"2024-09-10T10:59:40.153086+0000","last_clean":"2024-09-10T10:59:40.153086+0000","last_became_active":"2024-09-10T10:59:31.127937+0000","last_became_peered":"2024-09-10T10:59:31.127937+0000","last_unstale":"2024-09-10T10:59:40.153086+0000","last_undegraded":"2024-09-10T10:59:40.153086+0000","last_fullsized":"2024-09-10T10:59:40.153086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:37.977168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157396+0000","last_change":"2024-09-10T10:59:40.157396+0000","last_active":"2024-09-10T10:59:40.157396+0000","last_peered":"2024-09-10T10:59:40.157396+0000","last_clean":"2024-09-10T10:59:40.157396+0000","last_became_active":"2024-09-10T10:59:40.157003+0000","last_became_peered":"2024-09-10T10:59:40.157003+0000","last_unstale":"2024-09-10T10:59:40.157396+0000","last_undegraded":"2024-09-10T10:59:40.157396+0000","last_fullsized":"2024-09-10T10:59:40.157396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152495+0000","last_change":"2024-09-10T10:59:31.136045+0000","last_active":"2024-09-10T10:59:40.152495+0000","last_peered":"2024-09-10T10:59:40.152495+0000","last_clean":"2024-09-10T10:59:40.152495+0000","last_became_active":"2024-09-10T10:59:31.135295+0000","last_became_peered":"2024-09-10T10:59:31.135295+0000","last_unstale":"2024-09-10T10:59:40.152495+0000","last_undegraded":"2024-09-10T10:59:40.152495+0000","last_fullsized":"2024-09-10T10:59:40.152495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:04.306752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157288+0000","last_change":"2024-09-10T10:59:31.120953+0000","last_active":"2024-09-10T10:59:40.157288+0000","last_peered":"2024-09-10T10:59:40.157288+0000","last_clean":"2024-09-10T10:59:40.157288+0000","last_became_active":"2024-09-10T10:59:31.120647+0000","last_became_peered":"2024-09-10T10:59:31.120647+0000","last_unstale":"2024-09-10T10:59:40.157288+0000","last_undegraded":"2024-09-10T10:59:40.157288+0000","last_fullsized":"2024-09-10T10:59:40.157288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:53.689216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151033+0000","last_change":"2024-09-10T10:59:31.136326+0000","last_active":"2024-09-10T10:59:40.151033+0000","last_peered":"2024-09-10T10:59:40.151033+0000","last_clean":"2024-09-10T10:59:40.151033+0000","last_became_active":"2024-09-10T10:59:31.135129+0000","last_became_peered":"2024-09-10T10:59:31.135129+0000","last_unstale":"2024-09-10T10:59:40.151033+0000","last_undegraded":"2024-09-10T10:59:40.151033+0000","last_fullsized":"2024-09-10T10:59:40.151033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:05.510845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153822+0000","last_change":"2024-09-10T10:59:31.130680+0000","last_active":"2024-09-10T10:59:40.153822+0000","last_peered":"2024-09-10T10:59:40.153822+0000","last_clean":"2024-09-10T10:59:40.153822+0000","last_became_active":"2024-09-10T10:59:31.130356+0000","last_became_peered":"2024-09-10T10:59:31.130356+0000","last_unstale":"2024-09-10T10:59:40.153822+0000","last_undegraded":"2024-09-10T10:59:40.153822+0000","last_fullsized":"2024-09-10T10:59:40.153822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:50.450251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153064+0000","last_change":"2024-09-10T10:59:31.129938+0000","last_active":"2024-09-10T10:59:40.153064+0000","last_peered":"2024-09-10T10:59:40.153064+0000","last_clean":"2024-09-10T10:59:40.153064+0000","last_became_active":"2024-09-10T10:59:31.129527+0000","last_became_peered":"2024-09-10T10:59:31.129527+0000","last_unstale":"2024-09-10T10:59:40.153064+0000","last_undegraded":"2024-09-10T10:59:40.153064+0000","last_fullsized":"2024-09-10T10:59:40.153064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:06.373082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.156876+0000","last_change":"2024-09-10T10:59:40.156217+0000","last_active":"2024-09-10T10:59:40.156876+0000","last_peered":"2024-09-10T10:59:40.156876+0000","last_clean":"2024-09-10T10:59:40.156876+0000","last_became_active":"2024-09-10T10:59:40.155900+0000","last_became_peered":"2024-09-10T10:59:40.155900+0000","last_unstale":"2024-09-10T10:59:40.156876+0000","last_undegraded":"2024-09-10T10:59:40.156876+0000","last_fullsized":"2024-09-10T10:59:40.156876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:17.085474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153961+0000","last_change":"2024-09-10T10:59:31.135564+0000","last_active":"2024-09-10T10:59:40.153961+0000","last_peered":"2024-09-10T10:59:40.153961+0000","last_clean":"2024-09-10T10:59:40.153961+0000","last_became_active":"2024-09-10T10:59:31.135185+0000","last_became_peered":"2024-09-10T10:59:31.135185+0000","last_unstale":"2024-09-10T10:59:40.153961+0000","last_undegraded":"2024-09-10T10:59:40.153961+0000","last_fullsized":"2024-09-10T10:59:40.153961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:17.275533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211219+0000","last_change":"2024-09-10T10:59:31.130517+0000","last_active":"2024-09-10T10:59:40.211219+0000","last_peered":"2024-09-10T10:59:40.211219+0000","last_clean":"2024-09-10T10:59:40.211219+0000","last_became_active":"2024-09-10T10:59:31.130156+0000","last_became_peered":"2024-09-10T10:59:31.130156+0000","last_unstale":"2024-09-10T10:59:40.211219+0000","last_undegraded":"2024-09-10T10:59:40.211219+0000","last_fullsized":"2024-09-10T10:59:40.211219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:33.354812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.210915+0000","last_change":"2024-09-10T10:59:31.130701+0000","last_active":"2024-09-10T10:59:40.210915+0000","last_peered":"2024-09-10T10:59:40.210915+0000","last_clean":"2024-09-10T10:59:40.210915+0000","last_became_active":"2024-09-10T10:59:31.130379+0000","last_became_peered":"2024-09-10T10:59:31.130379+0000","last_unstale":"2024-09-10T10:59:40.210915+0000","last_undegraded":"2024-09-10T10:59:40.210915+0000","last_fullsized":"2024-09-10T10:59:40.210915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:24.787292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150433+0000","last_change":"2024-09-10T10:59:31.129583+0000","last_active":"2024-09-10T10:59:40.150433+0000","last_peered":"2024-09-10T10:59:40.150433+0000","last_clean":"2024-09-10T10:59:40.150433+0000","last_became_active":"2024-09-10T10:59:31.128559+0000","last_became_peered":"2024-09-10T10:59:31.128559+0000","last_unstale":"2024-09-10T10:59:40.150433+0000","last_undegraded":"2024-09-10T10:59:40.150433+0000","last_fullsized":"2024-09-10T10:59:40.150433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:20.139987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155807+0000","last_change":"2024-09-10T10:59:31.132579+0000","last_active":"2024-09-10T10:59:40.155807+0000","last_peered":"2024-09-10T10:59:40.155807+0000","last_clean":"2024-09-10T10:59:40.155807+0000","last_became_active":"2024-09-10T10:59:31.132256+0000","last_became_peered":"2024-09-10T10:59:31.132256+0000","last_unstale":"2024-09-10T10:59:40.155807+0000","last_undegraded":"2024-09-10T10:59:40.155807+0000","last_fullsized":"2024-09-10T10:59:40.155807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:54.771376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151638+0000","last_change":"2024-09-10T10:59:31.127666+0000","last_active":"2024-09-10T10:59:40.151638+0000","last_peered":"2024-09-10T10:59:40.151638+0000","last_clean":"2024-09-10T10:59:40.151638+0000","last_became_active":"2024-09-10T10:59:31.127354+0000","last_became_peered":"2024-09-10T10:59:31.127354+0000","last_unstale":"2024-09-10T10:59:40.151638+0000","last_undegraded":"2024-09-10T10:59:40.151638+0000","last_fullsized":"2024-09-10T10:59:40.151638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:25.089856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152482+0000","last_change":"2024-09-10T10:59:31.126146+0000","last_active":"2024-09-10T10:59:40.152482+0000","last_peered":"2024-09-10T10:59:40.152482+0000","last_clean":"2024-09-10T10:59:40.152482+0000","last_became_active":"2024-09-10T10:59:31.125821+0000","last_became_peered":"2024-09-10T10:59:31.125821+0000","last_unstale":"2024-09-10T10:59:40.152482+0000","last_undegraded":"2024-09-10T10:59:40.152482+0000","last_fullsized":"2024-09-10T10:59:40.152482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:14.442467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155662+0000","last_change":"2024-09-10T10:59:31.124783+0000","last_active":"2024-09-10T10:59:40.155662+0000","last_peered":"2024-09-10T10:59:40.155662+0000","last_clean":"2024-09-10T10:59:40.155662+0000","last_became_active":"2024-09-10T10:59:31.124461+0000","last_became_peered":"2024-09-10T10:59:31.124461+0000","last_unstale":"2024-09-10T10:59:40.155662+0000","last_undegraded":"2024-09-10T10:59:40.155662+0000","last_fullsized":"2024-09-10T10:59:40.155662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:30.312716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154045+0000","last_change":"2024-09-10T10:59:31.123118+0000","last_active":"2024-09-10T10:59:40.154045+0000","last_peered":"2024-09-10T10:59:40.154045+0000","last_clean":"2024-09-10T10:59:40.154045+0000","last_became_active":"2024-09-10T10:59:31.122802+0000","last_became_peered":"2024-09-10T10:59:31.122802+0000","last_unstale":"2024-09-10T10:59:40.154045+0000","last_undegraded":"2024-09-10T10:59:40.154045+0000","last_fullsized":"2024-09-10T10:59:40.154045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:38:30.274121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150564+0000","last_change":"2024-09-10T10:59:31.125163+0000","last_active":"2024-09-10T10:59:40.150564+0000","last_peered":"2024-09-10T10:59:40.150564+0000","last_clean":"2024-09-10T10:59:40.150564+0000","last_became_active":"2024-09-10T10:59:31.124823+0000","last_became_peered":"2024-09-10T10:59:31.124823+0000","last_unstale":"2024-09-10T10:59:40.150564+0000","last_undegraded":"2024-09-10T10:59:40.150564+0000","last_fullsized":"2024-09-10T10:59:40.150564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:06.479220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157045+0000","last_change":"2024-09-10T10:59:31.124892+0000","last_active":"2024-09-10T10:59:40.157045+0000","last_peered":"2024-09-10T10:59:40.157045+0000","last_clean":"2024-09-10T10:59:40.157045+0000","last_became_active":"2024-09-10T10:59:31.124575+0000","last_became_peered":"2024-09-10T10:59:31.124575+0000","last_unstale":"2024-09-10T10:59:40.157045+0000","last_undegraded":"2024-09-10T10:59:40.157045+0000","last_fullsized":"2024-09-10T10:59:40.157045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:54.562406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.159964+0000","last_change":"2024-09-10T10:59:40.159510+0000","last_active":"2024-09-10T10:59:40.159964+0000","last_peered":"2024-09-10T10:59:40.159964+0000","last_clean":"2024-09-10T10:59:40.159964+0000","last_became_active":"2024-09-10T10:59:40.159115+0000","last_became_peered":"2024-09-10T10:59:40.159115+0000","last_unstale":"2024-09-10T10:59:40.159964+0000","last_undegraded":"2024-09-10T10:59:40.159964+0000","last_fullsized":"2024-09-10T10:59:40.159964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:28.390308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158008+0000","last_change":"2024-09-10T10:59:31.125849+0000","last_active":"2024-09-10T10:59:40.158008+0000","last_peered":"2024-09-10T10:59:40.158008+0000","last_clean":"2024-09-10T10:59:40.158008+0000","last_became_active":"2024-09-10T10:59:31.125487+0000","last_became_peered":"2024-09-10T10:59:31.125487+0000","last_unstale":"2024-09-10T10:59:40.158008+0000","last_undegraded":"2024-09-10T10:59:40.158008+0000","last_fullsized":"2024-09-10T10:59:40.158008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:56.364182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152718+0000","last_change":"2024-09-10T10:59:31.132717+0000","last_active":"2024-09-10T10:59:40.152718+0000","last_peered":"2024-09-10T10:59:40.152718+0000","last_clean":"2024-09-10T10:59:40.152718+0000","last_became_active":"2024-09-10T10:59:31.132258+0000","last_became_peered":"2024-09-10T10:59:31.132258+0000","last_unstale":"2024-09-10T10:59:40.152718+0000","last_undegraded":"2024-09-10T10:59:40.152718+0000","last_fullsized":"2024-09-10T10:59:40.152718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:27.910065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155638+0000","last_change":"2024-09-10T10:59:31.136320+0000","last_active":"2024-09-10T10:59:40.155638+0000","last_peered":"2024-09-10T10:59:40.155638+0000","last_clean":"2024-09-10T10:59:40.155638+0000","last_became_active":"2024-09-10T10:59:31.135970+0000","last_became_peered":"2024-09-10T10:59:31.135970+0000","last_unstale":"2024-09-10T10:59:40.155638+0000","last_undegraded":"2024-09-10T10:59:40.155638+0000","last_fullsized":"2024-09-10T10:59:40.155638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:19.380754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153513+0000","last_change":"2024-09-10T10:59:31.123793+0000","last_active":"2024-09-10T10:59:40.153513+0000","last_peered":"2024-09-10T10:59:40.153513+0000","last_clean":"2024-09-10T10:59:40.153513+0000","last_became_active":"2024-09-10T10:59:31.123502+0000","last_became_peered":"2024-09-10T10:59:31.123502+0000","last_unstale":"2024-09-10T10:59:40.153513+0000","last_undegraded":"2024-09-10T10:59:40.153513+0000","last_fullsized":"2024-09-10T10:59:40.153513+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:43.883652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211247+0000","last_change":"2024-09-10T10:59:31.127616+0000","last_active":"2024-09-10T10:59:40.211247+0000","last_peered":"2024-09-10T10:59:40.211247+0000","last_clean":"2024-09-10T10:59:40.211247+0000","last_became_active":"2024-09-10T10:59:31.127296+0000","last_became_peered":"2024-09-10T10:59:31.127296+0000","last_unstale":"2024-09-10T10:59:40.211247+0000","last_undegraded":"2024-09-10T10:59:40.211247+0000","last_fullsized":"2024-09-10T10:59:40.211247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:58.284180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212762+0000","last_change":"2024-09-10T10:59:40.212762+0000","last_active":"2024-09-10T10:59:40.212762+0000","last_peered":"2024-09-10T10:59:40.212762+0000","last_clean":"2024-09-10T10:59:40.212762+0000","last_became_active":"2024-09-10T10:59:40.212356+0000","last_became_peered":"2024-09-10T10:59:40.212356+0000","last_unstale":"2024-09-10T10:59:40.212762+0000","last_undegraded":"2024-09-10T10:59:40.212762+0000","last_fullsized":"2024-09-10T10:59:40.212762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:45.341432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.213553+0000","last_change":"2024-09-10T10:59:40.213553+0000","last_active":"2024-09-10T10:59:40.213553+0000","last_peered":"2024-09-10T10:59:40.213553+0000","last_clean":"2024-09-10T10:59:40.213553+0000","last_became_active":"2024-09-10T10:59:40.213104+0000","last_became_peered":"2024-09-10T10:59:40.213104+0000","last_unstale":"2024-09-10T10:59:40.213553+0000","last_undegraded":"2024-09-10T10:59:40.213553+0000","last_fullsized":"2024-09-10T10:59:40.213553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:24:09.901559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155007+0000","last_change":"2024-09-10T10:59:31.135637+0000","last_active":"2024-09-10T10:59:40.155007+0000","last_peered":"2024-09-10T10:59:40.155007+0000","last_clean":"2024-09-10T10:59:40.155007+0000","last_became_active":"2024-09-10T10:59:31.135286+0000","last_became_peered":"2024-09-10T10:59:31.135286+0000","last_unstale":"2024-09-10T10:59:40.155007+0000","last_undegraded":"2024-09-10T10:59:40.155007+0000","last_fullsized":"2024-09-10T10:59:40.155007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:44:56.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157927+0000","last_change":"2024-09-10T10:59:40.157927+0000","last_active":"2024-09-10T10:59:40.157927+0000","last_peered":"2024-09-10T10:59:40.157927+0000","last_clean":"2024-09-10T10:59:40.157927+0000","last_became_active":"2024-09-10T10:59:40.157506+0000","last_became_peered":"2024-09-10T10:59:40.157506+0000","last_unstale":"2024-09-10T10:59:40.157927+0000","last_undegraded":"2024-09-10T10:59:40.157927+0000","last_fullsized":"2024-09-10T10:59:40.157927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:18.848309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:37.251724+0000","last_change":"2024-09-10T10:59:28.980783+0000","last_active":"2024-09-10T11:00:37.251724+0000","last_peered":"2024-09-10T11:00:37.251724+0000","last_clean":"2024-09-10T11:00:37.251724+0000","last_became_active":"2024-09-10T10:59:28.980420+0000","last_became_peered":"2024-09-10T10:59:28.980420+0000","last_unstale":"2024-09-10T11:00:37.251724+0000","last_undegraded":"2024-09-10T11:00:37.251724+0000","last_fullsized":"2024-09-10T11:00:37.251724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:58.575440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211462+0000","last_change":"2024-09-10T10:59:31.133661+0000","last_active":"2024-09-10T10:59:40.211462+0000","last_peered":"2024-09-10T10:59:40.211462+0000","last_clean":"2024-09-10T10:59:40.211462+0000","last_became_active":"2024-09-10T10:59:31.133323+0000","last_became_peered":"2024-09-10T10:59:31.133323+0000","last_unstale":"2024-09-10T10:59:40.211462+0000","last_undegraded":"2024-09-10T10:59:40.211462+0000","last_fullsized":"2024-09-10T10:59:40.211462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:37.498128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170086+0000","last_change":"2024-09-10T10:59:28.976329+0000","last_active":"2024-09-10T10:59:41.170086+0000","last_peered":"2024-09-10T10:59:41.170086+0000","last_clean":"2024-09-10T10:59:41.170086+0000","last_became_active":"2024-09-10T10:59:28.975937+0000","last_became_peered":"2024-09-10T10:59:28.975937+0000","last_unstale":"2024-09-10T10:59:41.170086+0000","last_undegraded":"2024-09-10T10:59:41.170086+0000","last_fullsized":"2024-09-10T10:59:41.170086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:46.118954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170624+0000","last_change":"2024-09-10T10:59:28.976853+0000","last_active":"2024-09-10T10:59:41.170624+0000","last_peered":"2024-09-10T10:59:41.170624+0000","last_clean":"2024-09-10T10:59:41.170624+0000","last_became_active":"2024-09-10T10:59:28.976524+0000","last_became_peered":"2024-09-10T10:59:28.976524+0000","last_unstale":"2024-09-10T10:59:41.170624+0000","last_undegraded":"2024-09-10T10:59:41.170624+0000","last_fullsized":"2024-09-10T10:59:41.170624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:27.473954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157400+0000","last_change":"2024-09-10T10:59:31.124533+0000","last_active":"2024-09-10T10:59:40.157400+0000","last_peered":"2024-09-10T10:59:40.157400+0000","last_clean":"2024-09-10T10:59:40.157400+0000","last_became_active":"2024-09-10T10:59:31.124179+0000","last_became_peered":"2024-09-10T10:59:31.124179+0000","last_unstale":"2024-09-10T10:59:40.157400+0000","last_undegraded":"2024-09-10T10:59:40.157400+0000","last_fullsized":"2024-09-10T10:59:40.157400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:23.114178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211738+0000","last_change":"2024-09-10T10:59:28.974785+0000","last_active":"2024-09-10T10:59:40.211738+0000","last_peered":"2024-09-10T10:59:40.211738+0000","last_clean":"2024-09-10T10:59:40.211738+0000","last_became_active":"2024-09-10T10:59:28.974499+0000","last_became_peered":"2024-09-10T10:59:28.974499+0000","last_unstale":"2024-09-10T10:59:40.211738+0000","last_undegraded":"2024-09-10T10:59:40.211738+0000","last_fullsized":"2024-09-10T10:59:40.211738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:18.551425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.151294+0000","last_change":"2024-09-10T10:59:31.122040+0000","last_active":"2024-09-10T10:59:40.151294+0000","last_peered":"2024-09-10T10:59:40.151294+0000","last_clean":"2024-09-10T10:59:40.151294+0000","last_became_active":"2024-09-10T10:59:31.121683+0000","last_became_peered":"2024-09-10T10:59:31.121683+0000","last_unstale":"2024-09-10T10:59:40.151294+0000","last_undegraded":"2024-09-10T10:59:40.151294+0000","last_fullsized":"2024-09-10T10:59:40.151294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:42.783446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":82,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:37.251049+0000","last_change":"2024-09-10T10:59:28.979068+0000","last_active":"2024-09-10T11:00:37.251049+0000","last_peered":"2024-09-10T11:00:37.251049+0000","last_clean":"2024-09-10T11:00:37.251049+0000","last_became_active":"2024-09-10T10:59:28.978746+0000","last_became_peered":"2024-09-10T10:59:28.978746+0000","last_unstale":"2024-09-10T11:00:37.251049+0000","last_undegraded":"2024-09-10T11:00:37.251049+0000","last_fullsized":"2024-09-10T11:00:37.251049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:30.940050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150814+0000","last_change":"2024-09-10T10:59:31.130966+0000","last_active":"2024-09-10T10:59:40.150814+0000","last_peered":"2024-09-10T10:59:40.150814+0000","last_clean":"2024-09-10T10:59:40.150814+0000","last_became_active":"2024-09-10T10:59:31.130592+0000","last_became_peered":"2024-09-10T10:59:31.130592+0000","last_unstale":"2024-09-10T10:59:40.150814+0000","last_undegraded":"2024-09-10T10:59:40.150814+0000","last_fullsized":"2024-09-10T10:59:40.150814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:59.000694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.183919+0000","last_change":"2024-09-10T10:59:40.182217+0000","last_active":"2024-09-10T10:59:40.183919+0000","last_peered":"2024-09-10T10:59:40.183919+0000","last_clean":"2024-09-10T10:59:40.183919+0000","last_became_active":"2024-09-10T10:59:40.181771+0000","last_became_peered":"2024-09-10T10:59:40.181771+0000","last_unstale":"2024-09-10T10:59:40.183919+0000","last_undegraded":"2024-09-10T10:59:40.183919+0000","last_fullsized":"2024-09-10T10:59:40.183919+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:22.745512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211385+0000","last_change":"2024-09-10T10:59:31.123034+0000","last_active":"2024-09-10T10:59:40.211385+0000","last_peered":"2024-09-10T10:59:40.211385+0000","last_clean":"2024-09-10T10:59:40.211385+0000","last_became_active":"2024-09-10T10:59:31.122721+0000","last_became_peered":"2024-09-10T10:59:31.122721+0000","last_unstale":"2024-09-10T10:59:40.211385+0000","last_undegraded":"2024-09-10T10:59:40.211385+0000","last_fullsized":"2024-09-10T10:59:40.211385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:20.175740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212064+0000","last_change":"2024-09-10T10:59:29.230812+0000","last_active":"2024-09-10T10:59:40.212064+0000","last_peered":"2024-09-10T10:59:40.212064+0000","last_clean":"2024-09-10T10:59:40.212064+0000","last_became_active":"2024-09-10T10:59:29.230450+0000","last_became_peered":"2024-09-10T10:59:29.230450+0000","last_unstale":"2024-09-10T10:59:40.212064+0000","last_undegraded":"2024-09-10T10:59:40.212064+0000","last_fullsized":"2024-09-10T10:59:40.212064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:32.476465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150665+0000","last_change":"2024-09-10T10:59:31.129751+0000","last_active":"2024-09-10T10:59:40.150665+0000","last_peered":"2024-09-10T10:59:40.150665+0000","last_clean":"2024-09-10T10:59:40.150665+0000","last_became_active":"2024-09-10T10:59:31.129420+0000","last_became_peered":"2024-09-10T10:59:31.129420+0000","last_unstale":"2024-09-10T10:59:40.150665+0000","last_undegraded":"2024-09-10T10:59:40.150665+0000","last_fullsized":"2024-09-10T10:59:40.150665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:21.243051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'26","reported_seq":170,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:38.252571+0000","last_change":"2024-09-10T10:59:28.977234+0000","last_active":"2024-09-10T11:00:38.252571+0000","last_peered":"2024-09-10T11:00:38.252571+0000","last_clean":"2024-09-10T11:00:38.252571+0000","last_became_active":"2024-09-10T10:59:28.976897+0000","last_became_peered":"2024-09-10T10:59:28.976897+0000","last_unstale":"2024-09-10T11:00:38.252571+0000","last_undegraded":"2024-09-10T11:00:38.252571+0000","last_fullsized":"2024-09-10T11:00:38.252571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.937110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59211,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":27,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154209+0000","last_change":"2024-09-10T10:59:31.125741+0000","last_active":"2024-09-10T10:59:40.154209+0000","last_peered":"2024-09-10T10:59:40.154209+0000","last_clean":"2024-09-10T10:59:40.154209+0000","last_became_active":"2024-09-10T10:59:31.125369+0000","last_became_peered":"2024-09-10T10:59:31.125369+0000","last_unstale":"2024-09-10T10:59:40.154209+0000","last_undegraded":"2024-09-10T10:59:40.154209+0000","last_fullsized":"2024-09-10T10:59:40.154209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:26.873331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.168438+0000","last_change":"2024-09-10T10:59:28.975326+0000","last_active":"2024-09-10T10:59:41.168438+0000","last_peered":"2024-09-10T10:59:41.168438+0000","last_clean":"2024-09-10T10:59:41.168438+0000","last_became_active":"2024-09-10T10:59:28.975004+0000","last_became_peered":"2024-09-10T10:59:28.975004+0000","last_unstale":"2024-09-10T10:59:41.168438+0000","last_undegraded":"2024-09-10T10:59:41.168438+0000","last_fullsized":"2024-09-10T10:59:41.168438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:11.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153138+0000","last_change":"2024-09-10T10:59:31.125916+0000","last_active":"2024-09-10T10:59:40.153138+0000","last_peered":"2024-09-10T10:59:40.153138+0000","last_clean":"2024-09-10T10:59:40.153138+0000","last_became_active":"2024-09-10T10:59:31.125591+0000","last_became_peered":"2024-09-10T10:59:31.125591+0000","last_unstale":"2024-09-10T10:59:40.153138+0000","last_undegraded":"2024-09-10T10:59:40.153138+0000","last_fullsized":"2024-09-10T10:59:40.153138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:19.512266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211706+0000","last_change":"2024-09-10T10:59:28.980967+0000","last_active":"2024-09-10T10:59:40.211706+0000","last_peered":"2024-09-10T10:59:40.211706+0000","last_clean":"2024-09-10T10:59:40.211706+0000","last_became_active":"2024-09-10T10:59:28.980176+0000","last_became_peered":"2024-09-10T10:59:28.980176+0000","last_unstale":"2024-09-10T10:59:40.211706+0000","last_undegraded":"2024-09-10T10:59:40.211706+0000","last_fullsized":"2024-09-10T10:59:40.211706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:56.327936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152737+0000","last_change":"2024-09-10T10:59:31.127819+0000","last_active":"2024-09-10T10:59:40.152737+0000","last_peered":"2024-09-10T10:59:40.152737+0000","last_clean":"2024-09-10T10:59:40.152737+0000","last_became_active":"2024-09-10T10:59:31.127503+0000","last_became_peered":"2024-09-10T10:59:31.127503+0000","last_unstale":"2024-09-10T10:59:40.152737+0000","last_undegraded":"2024-09-10T10:59:40.152737+0000","last_fullsized":"2024-09-10T10:59:40.152737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:17.014121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'4","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:37.265313+0000","last_change":"2024-09-10T10:59:28.980881+0000","last_active":"2024-09-10T11:00:37.265313+0000","last_peered":"2024-09-10T11:00:37.265313+0000","last_clean":"2024-09-10T11:00:37.265313+0000","last_became_active":"2024-09-10T10:59:28.980452+0000","last_became_peered":"2024-09-10T10:59:28.980452+0000","last_unstale":"2024-09-10T11:00:37.265313+0000","last_undegraded":"2024-09-10T11:00:37.265313+0000","last_fullsized":"2024-09-10T11:00:37.265313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:00.373348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152392+0000","last_change":"2024-09-10T10:59:31.120463+0000","last_active":"2024-09-10T10:59:40.152392+0000","last_peered":"2024-09-10T10:59:40.152392+0000","last_clean":"2024-09-10T10:59:40.152392+0000","last_became_active":"2024-09-10T10:59:31.120122+0000","last_became_peered":"2024-09-10T10:59:31.120122+0000","last_unstale":"2024-09-10T10:59:40.152392+0000","last_undegraded":"2024-09-10T10:59:40.152392+0000","last_fullsized":"2024-09-10T10:59:40.152392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:37.425553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170329+0000","last_change":"2024-09-10T10:59:29.230592+0000","last_active":"2024-09-10T10:59:41.170329+0000","last_peered":"2024-09-10T10:59:41.170329+0000","last_clean":"2024-09-10T10:59:41.170329+0000","last_became_active":"2024-09-10T10:59:29.230205+0000","last_became_peered":"2024-09-10T10:59:29.230205+0000","last_unstale":"2024-09-10T10:59:41.170329+0000","last_undegraded":"2024-09-10T10:59:41.170329+0000","last_fullsized":"2024-09-10T10:59:41.170329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:00.671805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211929+0000","last_change":"2024-09-10T10:59:31.132506+0000","last_active":"2024-09-10T10:59:40.211929+0000","last_peered":"2024-09-10T10:59:40.211929+0000","last_clean":"2024-09-10T10:59:40.211929+0000","last_became_active":"2024-09-10T10:59:31.132038+0000","last_became_peered":"2024-09-10T10:59:31.132038+0000","last_unstale":"2024-09-10T10:59:40.211929+0000","last_undegraded":"2024-09-10T10:59:40.211929+0000","last_fullsized":"2024-09-10T10:59:40.211929+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:09.872032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:42.164709+0000","last_change":"2024-09-10T10:59:28.976756+0000","last_active":"2024-09-10T10:59:42.164709+0000","last_peered":"2024-09-10T10:59:42.164709+0000","last_clean":"2024-09-10T10:59:42.164709+0000","last_became_active":"2024-09-10T10:59:28.976429+0000","last_became_peered":"2024-09-10T10:59:28.976429+0000","last_unstale":"2024-09-10T10:59:42.164709+0000","last_undegraded":"2024-09-10T10:59:42.164709+0000","last_fullsized":"2024-09-10T10:59:42.164709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:41.679474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155401+0000","last_change":"2024-09-10T10:59:31.135768+0000","last_active":"2024-09-10T10:59:40.155401+0000","last_peered":"2024-09-10T10:59:40.155401+0000","last_clean":"2024-09-10T10:59:40.155401+0000","last_became_active":"2024-09-10T10:59:31.135420+0000","last_became_peered":"2024-09-10T10:59:31.135420+0000","last_unstale":"2024-09-10T10:59:40.155401+0000","last_undegraded":"2024-09-10T10:59:40.155401+0000","last_fullsized":"2024-09-10T10:59:40.155401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:02.983500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153716+0000","last_change":"2024-09-10T10:59:28.972185+0000","last_active":"2024-09-10T10:59:40.153716+0000","last_peered":"2024-09-10T10:59:40.153716+0000","last_clean":"2024-09-10T10:59:40.153716+0000","last_became_active":"2024-09-10T10:59:28.971813+0000","last_became_peered":"2024-09-10T10:59:28.971813+0000","last_unstale":"2024-09-10T10:59:40.153716+0000","last_undegraded":"2024-09-10T10:59:40.153716+0000","last_fullsized":"2024-09-10T10:59:40.153716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:53.612465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152705+0000","last_change":"2024-09-10T10:59:31.130197+0000","last_active":"2024-09-10T10:59:40.152705+0000","last_peered":"2024-09-10T10:59:40.152705+0000","last_clean":"2024-09-10T10:59:40.152705+0000","last_became_active":"2024-09-10T10:59:31.129596+0000","last_became_peered":"2024-09-10T10:59:31.129596+0000","last_unstale":"2024-09-10T10:59:40.152705+0000","last_undegraded":"2024-09-10T10:59:40.152705+0000","last_fullsized":"2024-09-10T10:59:40.152705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:23.962924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.212176+0000","last_change":"2024-09-10T10:59:28.973990+0000","last_active":"2024-09-10T10:59:40.212176+0000","last_peered":"2024-09-10T10:59:40.212176+0000","last_clean":"2024-09-10T10:59:40.212176+0000","last_became_active":"2024-09-10T10:59:28.973647+0000","last_became_peered":"2024-09-10T10:59:28.973647+0000","last_unstale":"2024-09-10T10:59:40.212176+0000","last_undegraded":"2024-09-10T10:59:40.212176+0000","last_fullsized":"2024-09-10T10:59:40.212176+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:25.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153427+0000","last_change":"2024-09-10T10:59:31.135603+0000","last_active":"2024-09-10T10:59:40.153427+0000","last_peered":"2024-09-10T10:59:40.153427+0000","last_clean":"2024-09-10T10:59:40.153427+0000","last_became_active":"2024-09-10T10:59:31.135208+0000","last_became_peered":"2024-09-10T10:59:31.135208+0000","last_unstale":"2024-09-10T10:59:40.153427+0000","last_undegraded":"2024-09-10T10:59:40.153427+0000","last_fullsized":"2024-09-10T10:59:40.153427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:50.578770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.476974+0000","last_change":"2024-09-10T10:59:40.212180+0000","last_active":"2024-09-10T10:59:41.476974+0000","last_peered":"2024-09-10T10:59:41.476974+0000","last_clean":"2024-09-10T10:59:41.476974+0000","last_became_active":"2024-09-10T10:59:40.211860+0000","last_became_peered":"2024-09-10T10:59:40.211860+0000","last_unstale":"2024-09-10T10:59:41.476974+0000","last_undegraded":"2024-09-10T10:59:41.476974+0000","last_fullsized":"2024-09-10T10:59:41.476974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:09.718612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153216+0000","last_change":"2024-09-10T10:59:31.126162+0000","last_active":"2024-09-10T10:59:40.153216+0000","last_peered":"2024-09-10T10:59:40.153216+0000","last_clean":"2024-09-10T10:59:40.153216+0000","last_became_active":"2024-09-10T10:59:31.125661+0000","last_became_peered":"2024-09-10T10:59:31.125661+0000","last_unstale":"2024-09-10T10:59:40.153216+0000","last_undegraded":"2024-09-10T10:59:40.153216+0000","last_fullsized":"2024-09-10T10:59:40.153216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:36.677732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152671+0000","last_change":"2024-09-10T10:58:17.630377+0000","last_active":"2024-09-10T10:59:40.152671+0000","last_peered":"2024-09-10T10:59:40.152671+0000","last_clean":"2024-09-10T10:59:40.152671+0000","last_became_active":"2024-09-10T10:58:17.629956+0000","last_became_peered":"2024-09-10T10:58:17.629956+0000","last_unstale":"2024-09-10T10:59:40.152671+0000","last_undegraded":"2024-09-10T10:59:40.152671+0000","last_fullsized":"2024-09-10T10:59:40.152671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:54:53.218596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:54:53.218596+0000","last_clean_scrub_stamp":"2024-09-10T10:54:53.218596+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:44.005115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:42.170755+0000","last_change":"2024-09-10T10:59:28.975307+0000","last_active":"2024-09-10T10:59:42.170755+0000","last_peered":"2024-09-10T10:59:42.170755+0000","last_clean":"2024-09-10T10:59:42.170755+0000","last_became_active":"2024-09-10T10:59:28.974959+0000","last_became_peered":"2024-09-10T10:59:28.974959+0000","last_unstale":"2024-09-10T10:59:42.170755+0000","last_undegraded":"2024-09-10T10:59:42.170755+0000","last_fullsized":"2024-09-10T10:59:42.170755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:59.923354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157346+0000","last_change":"2024-09-10T10:59:31.124267+0000","last_active":"2024-09-10T10:59:40.157346+0000","last_peered":"2024-09-10T10:59:40.157346+0000","last_clean":"2024-09-10T10:59:40.157346+0000","last_became_active":"2024-09-10T10:59:31.123894+0000","last_became_peered":"2024-09-10T10:59:31.123894+0000","last_unstale":"2024-09-10T10:59:40.157346+0000","last_undegraded":"2024-09-10T10:59:40.157346+0000","last_fullsized":"2024-09-10T10:59:40.157346+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:54.657970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.169251+0000","last_change":"2024-09-10T10:59:28.977213+0000","last_active":"2024-09-10T10:59:41.169251+0000","last_peered":"2024-09-10T10:59:41.169251+0000","last_clean":"2024-09-10T10:59:41.169251+0000","last_became_active":"2024-09-10T10:59:28.976909+0000","last_became_peered":"2024-09-10T10:59:28.976909+0000","last_unstale":"2024-09-10T10:59:41.169251+0000","last_undegraded":"2024-09-10T10:59:41.169251+0000","last_fullsized":"2024-09-10T10:59:41.169251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:24.640147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152773+0000","last_change":"2024-09-10T10:59:31.129703+0000","last_active":"2024-09-10T10:59:40.152773+0000","last_peered":"2024-09-10T10:59:40.152773+0000","last_clean":"2024-09-10T10:59:40.152773+0000","last_became_active":"2024-09-10T10:59:31.129401+0000","last_became_peered":"2024-09-10T10:59:31.129401+0000","last_unstale":"2024-09-10T10:59:40.152773+0000","last_undegraded":"2024-09-10T10:59:40.152773+0000","last_fullsized":"2024-09-10T10:59:40.152773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:37.431852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T11:00:37.264521+0000","last_change":"2024-09-10T10:59:29.230556+0000","last_active":"2024-09-10T11:00:37.264521+0000","last_peered":"2024-09-10T11:00:37.264521+0000","last_clean":"2024-09-10T11:00:37.264521+0000","last_became_active":"2024-09-10T10:59:29.230129+0000","last_became_peered":"2024-09-10T10:59:29.230129+0000","last_unstale":"2024-09-10T11:00:37.264521+0000","last_undegraded":"2024-09-10T11:00:37.264521+0000","last_fullsized":"2024-09-10T11:00:37.264521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:31.903008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211592+0000","last_change":"2024-09-10T10:59:31.131687+0000","last_active":"2024-09-10T10:59:40.211592+0000","last_peered":"2024-09-10T10:59:40.211592+0000","last_clean":"2024-09-10T10:59:40.211592+0000","last_became_active":"2024-09-10T10:59:31.131373+0000","last_became_peered":"2024-09-10T10:59:31.131373+0000","last_unstale":"2024-09-10T10:59:40.211592+0000","last_undegraded":"2024-09-10T10:59:40.211592+0000","last_fullsized":"2024-09-10T10:59:40.211592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:03.923639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152936+0000","last_change":"2024-09-10T10:59:28.977557+0000","last_active":"2024-09-10T10:59:40.152936+0000","last_peered":"2024-09-10T10:59:40.152936+0000","last_clean":"2024-09-10T10:59:40.152936+0000","last_became_active":"2024-09-10T10:59:28.977203+0000","last_became_peered":"2024-09-10T10:59:28.977203+0000","last_unstale":"2024-09-10T10:59:40.152936+0000","last_undegraded":"2024-09-10T10:59:40.152936+0000","last_fullsized":"2024-09-10T10:59:40.152936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:25:29.880758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153759+0000","last_change":"2024-09-10T10:59:31.123998+0000","last_active":"2024-09-10T10:59:40.153759+0000","last_peered":"2024-09-10T10:59:40.153759+0000","last_clean":"2024-09-10T10:59:40.153759+0000","last_became_active":"2024-09-10T10:59:31.123645+0000","last_became_peered":"2024-09-10T10:59:31.123645+0000","last_unstale":"2024-09-10T10:59:40.153759+0000","last_undegraded":"2024-09-10T10:59:40.153759+0000","last_fullsized":"2024-09-10T10:59:40.153759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:47.607733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152223+0000","last_change":"2024-09-10T10:59:29.231291+0000","last_active":"2024-09-10T10:59:40.152223+0000","last_peered":"2024-09-10T10:59:40.152223+0000","last_clean":"2024-09-10T10:59:40.152223+0000","last_became_active":"2024-09-10T10:59:29.230946+0000","last_became_peered":"2024-09-10T10:59:29.230946+0000","last_unstale":"2024-09-10T10:59:40.152223+0000","last_undegraded":"2024-09-10T10:59:40.152223+0000","last_fullsized":"2024-09-10T10:59:40.152223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:55.268743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153274+0000","last_change":"2024-09-10T10:59:31.122359+0000","last_active":"2024-09-10T10:59:40.153274+0000","last_peered":"2024-09-10T10:59:40.153274+0000","last_clean":"2024-09-10T10:59:40.153274+0000","last_became_active":"2024-09-10T10:59:31.120741+0000","last_became_peered":"2024-09-10T10:59:31.120741+0000","last_unstale":"2024-09-10T10:59:40.153274+0000","last_undegraded":"2024-09-10T10:59:40.153274+0000","last_fullsized":"2024-09-10T10:59:40.153274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:02.827031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154484+0000","last_change":"2024-09-10T10:59:29.231008+0000","last_active":"2024-09-10T10:59:40.154484+0000","last_peered":"2024-09-10T10:59:40.154484+0000","last_clean":"2024-09-10T10:59:40.154484+0000","last_became_active":"2024-09-10T10:59:29.230638+0000","last_became_peered":"2024-09-10T10:59:29.230638+0000","last_unstale":"2024-09-10T10:59:40.154484+0000","last_undegraded":"2024-09-10T10:59:40.154484+0000","last_fullsized":"2024-09-10T10:59:40.154484+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.358831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153600+0000","last_change":"2024-09-10T10:59:31.129049+0000","last_active":"2024-09-10T10:59:40.153600+0000","last_peered":"2024-09-10T10:59:40.153600+0000","last_clean":"2024-09-10T10:59:40.153600+0000","last_became_active":"2024-09-10T10:59:31.128746+0000","last_became_peered":"2024-09-10T10:59:31.128746+0000","last_unstale":"2024-09-10T10:59:40.153600+0000","last_undegraded":"2024-09-10T10:59:40.153600+0000","last_fullsized":"2024-09-10T10:59:40.153600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:25.719609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:56.119318+0000","last_change":"2024-09-10T10:59:28.973043+0000","last_active":"2024-09-10T10:59:56.119318+0000","last_peered":"2024-09-10T10:59:56.119318+0000","last_clean":"2024-09-10T10:59:56.119318+0000","last_became_active":"2024-09-10T10:59:28.972633+0000","last_became_peered":"2024-09-10T10:59:28.972633+0000","last_unstale":"2024-09-10T10:59:56.119318+0000","last_undegraded":"2024-09-10T10:59:56.119318+0000","last_fullsized":"2024-09-10T10:59:56.119318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:51.858279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158104+0000","last_change":"2024-09-10T10:59:31.124663+0000","last_active":"2024-09-10T10:59:40.158104+0000","last_peered":"2024-09-10T10:59:40.158104+0000","last_clean":"2024-09-10T10:59:40.158104+0000","last_became_active":"2024-09-10T10:59:31.124312+0000","last_became_peered":"2024-09-10T10:59:31.124312+0000","last_unstale":"2024-09-10T10:59:40.158104+0000","last_undegraded":"2024-09-10T10:59:40.158104+0000","last_fullsized":"2024-09-10T10:59:40.158104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:03.530208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.180952+0000","last_change":"2024-09-10T10:59:29.461846+0000","last_active":"2024-09-10T10:59:40.180952+0000","last_peered":"2024-09-10T10:59:40.180952+0000","last_clean":"2024-09-10T10:59:40.180952+0000","last_became_active":"2024-09-10T10:59:29.461485+0000","last_became_peered":"2024-09-10T10:59:29.461485+0000","last_unstale":"2024-09-10T10:59:40.180952+0000","last_undegraded":"2024-09-10T10:59:40.180952+0000","last_fullsized":"2024-09-10T10:59:40.180952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:28.071947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211184+0000","last_change":"2024-09-10T10:59:31.122234+0000","last_active":"2024-09-10T10:59:40.211184+0000","last_peered":"2024-09-10T10:59:40.211184+0000","last_clean":"2024-09-10T10:59:40.211184+0000","last_became_active":"2024-09-10T10:59:31.121909+0000","last_became_peered":"2024-09-10T10:59:31.121909+0000","last_unstale":"2024-09-10T10:59:40.211184+0000","last_undegraded":"2024-09-10T10:59:40.211184+0000","last_fullsized":"2024-09-10T10:59:40.211184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:37.263257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150552+0000","last_change":"2024-09-10T10:59:29.230543+0000","last_active":"2024-09-10T10:59:40.150552+0000","last_peered":"2024-09-10T10:59:40.150552+0000","last_clean":"2024-09-10T10:59:40.150552+0000","last_became_active":"2024-09-10T10:59:29.230256+0000","last_became_peered":"2024-09-10T10:59:29.230256+0000","last_unstale":"2024-09-10T10:59:40.150552+0000","last_undegraded":"2024-09-10T10:59:40.150552+0000","last_fullsized":"2024-09-10T10:59:40.150552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:05.336402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.153044+0000","last_change":"2024-09-10T10:59:31.121898+0000","last_active":"2024-09-10T10:59:40.153044+0000","last_peered":"2024-09-10T10:59:40.153044+0000","last_clean":"2024-09-10T10:59:40.153044+0000","last_became_active":"2024-09-10T10:59:31.121478+0000","last_became_peered":"2024-09-10T10:59:31.121478+0000","last_unstale":"2024-09-10T10:59:40.153044+0000","last_undegraded":"2024-09-10T10:59:40.153044+0000","last_fullsized":"2024-09-10T10:59:40.153044+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:01.805762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157141+0000","last_change":"2024-09-10T10:59:28.974086+0000","last_active":"2024-09-10T10:59:40.157141+0000","last_peered":"2024-09-10T10:59:40.157141+0000","last_clean":"2024-09-10T10:59:40.157141+0000","last_became_active":"2024-09-10T10:59:28.973801+0000","last_became_peered":"2024-09-10T10:59:28.973801+0000","last_unstale":"2024-09-10T10:59:40.157141+0000","last_undegraded":"2024-09-10T10:59:40.157141+0000","last_fullsized":"2024-09-10T10:59:40.157141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:10.338340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.155611+0000","last_change":"2024-09-10T10:59:31.130301+0000","last_active":"2024-09-10T10:59:40.155611+0000","last_peered":"2024-09-10T10:59:40.155611+0000","last_clean":"2024-09-10T10:59:40.155611+0000","last_became_active":"2024-09-10T10:59:31.129959+0000","last_became_peered":"2024-09-10T10:59:31.129959+0000","last_unstale":"2024-09-10T10:59:40.155611+0000","last_undegraded":"2024-09-10T10:59:40.155611+0000","last_fullsized":"2024-09-10T10:59:40.155611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:32.131310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152650+0000","last_change":"2024-09-10T10:59:28.976683+0000","last_active":"2024-09-10T10:59:40.152650+0000","last_peered":"2024-09-10T10:59:40.152650+0000","last_clean":"2024-09-10T10:59:40.152650+0000","last_became_active":"2024-09-10T10:59:28.976278+0000","last_became_peered":"2024-09-10T10:59:28.976278+0000","last_unstale":"2024-09-10T10:59:40.152650+0000","last_undegraded":"2024-09-10T10:59:40.152650+0000","last_fullsized":"2024-09-10T10:59:40.152650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:49.100274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157441+0000","last_change":"2024-09-10T10:59:31.118400+0000","last_active":"2024-09-10T10:59:40.157441+0000","last_peered":"2024-09-10T10:59:40.157441+0000","last_clean":"2024-09-10T10:59:40.157441+0000","last_became_active":"2024-09-10T10:59:31.118067+0000","last_became_peered":"2024-09-10T10:59:31.118067+0000","last_unstale":"2024-09-10T10:59:40.157441+0000","last_undegraded":"2024-09-10T10:59:40.157441+0000","last_fullsized":"2024-09-10T10:59:40.157441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:03.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.162110+0000","last_change":"2024-09-10T10:59:40.161592+0000","last_active":"2024-09-10T10:59:40.162110+0000","last_peered":"2024-09-10T10:59:40.162110+0000","last_clean":"2024-09-10T10:59:40.162110+0000","last_became_active":"2024-09-10T10:59:40.156968+0000","last_became_peered":"2024-09-10T10:59:40.156968+0000","last_unstale":"2024-09-10T10:59:40.162110+0000","last_undegraded":"2024-09-10T10:59:40.162110+0000","last_fullsized":"2024-09-10T10:59:40.162110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:20.107251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.152634+0000","last_change":"2024-09-10T10:59:31.132779+0000","last_active":"2024-09-10T10:59:40.152634+0000","last_peered":"2024-09-10T10:59:40.152634+0000","last_clean":"2024-09-10T10:59:40.152634+0000","last_became_active":"2024-09-10T10:59:31.132417+0000","last_became_peered":"2024-09-10T10:59:31.132417+0000","last_unstale":"2024-09-10T10:59:40.152634+0000","last_undegraded":"2024-09-10T10:59:40.152634+0000","last_fullsized":"2024-09-10T10:59:40.152634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:47.640774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211900+0000","last_change":"2024-09-10T10:59:31.133370+0000","last_active":"2024-09-10T10:59:40.211900+0000","last_peered":"2024-09-10T10:59:40.211900+0000","last_clean":"2024-09-10T10:59:40.211900+0000","last_became_active":"2024-09-10T10:59:31.133027+0000","last_became_peered":"2024-09-10T10:59:31.133027+0000","last_unstale":"2024-09-10T10:59:40.211900+0000","last_undegraded":"2024-09-10T10:59:40.211900+0000","last_fullsized":"2024-09-10T10:59:40.211900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:24.550987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.154242+0000","last_change":"2024-09-10T10:59:28.973416+0000","last_active":"2024-09-10T10:59:40.154242+0000","last_peered":"2024-09-10T10:59:40.154242+0000","last_clean":"2024-09-10T10:59:40.154242+0000","last_became_active":"2024-09-10T10:59:28.973050+0000","last_became_peered":"2024-09-10T10:59:28.973050+0000","last_unstale":"2024-09-10T10:59:40.154242+0000","last_undegraded":"2024-09-10T10:59:40.154242+0000","last_fullsized":"2024-09-10T10:59:40.154242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:00.013173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.150537+0000","last_change":"2024-09-10T10:59:31.132568+0000","last_active":"2024-09-10T10:59:40.150537+0000","last_peered":"2024-09-10T10:59:40.150537+0000","last_clean":"2024-09-10T10:59:40.150537+0000","last_became_active":"2024-09-10T10:59:31.132260+0000","last_became_peered":"2024-09-10T10:59:31.132260+0000","last_unstale":"2024-09-10T10:59:40.150537+0000","last_undegraded":"2024-09-10T10:59:40.150537+0000","last_fullsized":"2024-09-10T10:59:40.150537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:14.420293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.169008+0000","last_change":"2024-09-10T10:59:28.981404+0000","last_active":"2024-09-10T10:59:41.169008+0000","last_peered":"2024-09-10T10:59:41.169008+0000","last_clean":"2024-09-10T10:59:41.169008+0000","last_became_active":"2024-09-10T10:59:28.981066+0000","last_became_peered":"2024-09-10T10:59:28.981066+0000","last_unstale":"2024-09-10T10:59:41.169008+0000","last_undegraded":"2024-09-10T10:59:41.169008+0000","last_fullsized":"2024-09-10T10:59:41.169008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:16.075280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.211311+0000","last_change":"2024-09-10T10:59:31.133696+0000","last_active":"2024-09-10T10:59:40.211311+0000","last_peered":"2024-09-10T10:59:40.211311+0000","last_clean":"2024-09-10T10:59:40.211311+0000","last_became_active":"2024-09-10T10:59:31.132978+0000","last_became_peered":"2024-09-10T10:59:31.132978+0000","last_unstale":"2024-09-10T10:59:40.211311+0000","last_undegraded":"2024-09-10T10:59:40.211311+0000","last_fullsized":"2024-09-10T10:59:40.211311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:37.273524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.158089+0000","last_change":"2024-09-10T10:59:29.230472+0000","last_active":"2024-09-10T10:59:40.158089+0000","last_peered":"2024-09-10T10:59:40.158089+0000","last_clean":"2024-09-10T10:59:40.158089+0000","last_became_active":"2024-09-10T10:59:29.230128+0000","last_became_peered":"2024-09-10T10:59:29.230128+0000","last_unstale":"2024-09-10T10:59:40.158089+0000","last_undegraded":"2024-09-10T10:59:40.158089+0000","last_fullsized":"2024-09-10T10:59:40.158089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:26.116922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:40.157847+0000","last_change":"2024-09-10T10:59:31.132406+0000","last_active":"2024-09-10T10:59:40.157847+0000","last_peered":"2024-09-10T10:59:40.157847+0000","last_clean":"2024-09-10T10:59:40.157847+0000","last_became_active":"2024-09-10T10:59:31.132088+0000","last_became_peered":"2024-09-10T10:59:31.132088+0000","last_unstale":"2024-09-10T10:59:40.157847+0000","last_undegraded":"2024-09-10T10:59:40.157847+0000","last_fullsized":"2024-09-10T10:59:40.157847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:30.089344+0000","last_clean_scrub_stamp":"2024-09-10T10:59:30.089344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:47.222192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:59:41.170194+0000","last_change":"2024-09-10T10:59:28.978103+0000","last_active":"2024-09-10T10:59:41.170194+0000","last_peered":"2024-09-10T10:59:41.170194+0000","last_clean":"2024-09-10T10:59:41.170194+0000","last_became_active":"2024-09-10T10:59:28.977918+0000","last_became_peered":"2024-09-10T10:59:28.977918+0000","last_unstale":"2024-09-10T10:59:41.170194+0000","last_undegraded":"2024-09-10T10:59:41.170194+0000","last_fullsized":"2024-09-10T10:59:41.170194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:59:27.959111+0000","last_clean_scrub_stamp":"2024-09-10T10:59:27.959111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:46.157534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63607,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":370,"num_read_kb":252,"num_write":159,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":212318,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547228,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":438088,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":1089173,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438324,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438244,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030569,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561077,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":437713,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790010,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":1029860,"data_compressed":41698,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":438543,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215171,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438024,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":497878,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":497299,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":438984,"data_compressed":5765,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34293,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34293,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35933,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:00:41.324 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T11:00:41.324 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T11:00:41.324 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T11:00:41.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:42.006 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:41 smithi059 ceph-mon[30978]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T11:00:42.006 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:41 smithi059 ceph-mon[30978]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T11:00:42.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.086+0000 7f310714f640 1 -- 172.21.15.59:0/2794655755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100102790 msgr2=0x7f31001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:42.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.086+0000 7f310714f640 1 --2- 172.21.15.59:0/2794655755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100102790 0x7f31001067e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009900 tx=0x7f30f402a410 comp rx=0 tx=0).stop 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.086+0000 7f310714f640 1 -- 172.21.15.59:0/2794655755 shutdown_connections 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.086+0000 7f310714f640 1 --2- 172.21.15.59:0/2794655755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3100106f10 0x7f310010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.086+0000 7f310714f640 1 --2- 172.21.15.59:0/2794655755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100102790 0x7f31001067e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.086+0000 7f310714f640 1 --2- 172.21.15.59:0/2794655755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3100101de0 0x7f31001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.086+0000 7f310714f640 1 -- 172.21.15.59:0/2794655755 >> 172.21.15.59:0/2794655755 conn(0x7f31000fd8c0 msgr2=0x7f31000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.086+0000 7f310714f640 1 -- 172.21.15.59:0/2794655755 shutdown_connections 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.086+0000 7f310714f640 1 -- 172.21.15.59:0/2794655755 wait complete. 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f310714f640 1 Processor -- start 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f310714f640 1 -- start start 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f310714f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100101de0 0x7f31000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f310714f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3100102790 0x7f3100074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:42.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f310714f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3100106f10 0x7f3100074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f310714f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3100111f70 con 0x7f3100101de0 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f310714f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3100111df0 con 0x7f3100102790 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f310714f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f31001120f0 con 0x7f3100106f10 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f3104eeb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100101de0 0x7f31000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f3104eeb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100101de0 0x7f31000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57154/0 (socket says 172.21.15.59:57154) 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f3104eeb640 1 -- 172.21.15.59:0/4014334778 learned_addr learned my addr 172.21.15.59:0/4014334778 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f30fffff640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3100102790 0x7f3100074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f31056ec640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3100106f10 0x7f3100074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f3104eeb640 1 -- 172.21.15.59:0/4014334778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3100106f10 msgr2=0x7f3100074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f3104eeb640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3100106f10 0x7f3100074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f3104eeb640 1 -- 172.21.15.59:0/4014334778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3100102790 msgr2=0x7f3100074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:42.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f3104eeb640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3100102790 0x7f3100074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.087+0000 7f3104eeb640 1 -- 172.21.15.59:0/4014334778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31001a6900 con 0x7f3100101de0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.088+0000 7f3104eeb640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100101de0 0x7f31000744f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c890 tx=0x7f30f000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.088+0000 7f30fdffb640 1 -- 172.21.15.59:0/4014334778 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0004220 con 0x7f3100101de0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.088+0000 7f30fdffb640 1 -- 172.21.15.59:0/4014334778 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30f00043c0 con 0x7f3100101de0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.088+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31001a6bf0 con 0x7f3100101de0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.088+0000 7f30fdffb640 1 -- 172.21.15.59:0/4014334778 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00049e0 con 0x7f3100101de0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.088+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31001a7150 con 0x7f3100101de0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.089+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31001021c0 con 0x7f3100101de0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.090+0000 7f30fdffb640 1 -- 172.21.15.59:0/4014334778 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f30f00079b0 con 0x7f3100101de0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.091+0000 7f30fdffb640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e80a2c90 0x7f30e80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.091+0000 7f30fffff640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e80a2c90 0x7f30e80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:42.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.091+0000 7f30fdffb640 1 -- 172.21.15.59:0/4014334778 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f30f00cf140 con 0x7f3100101de0 2024-09-10T11:00:42.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.091+0000 7f30fffff640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e80a2c90 0x7f30e80a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009230 tx=0x7f30f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:42.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.095+0000 7f30fdffb640 1 -- 172.21.15.59:0/4014334778 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30f0014030 con 0x7f3100101de0 2024-09-10T11:00:42.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:41 smithi181 ceph-mon[35409]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T11:00:42.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:41 smithi181 ceph-mon[35409]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T11:00:42.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:41 smithi115 ceph-mon[34719]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T11:00:42.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:41 smithi115 ceph-mon[34719]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T11:00:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.308+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f310002d7c0 con 0x7f3100101de0 2024-09-10T11:00:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.308+0000 7f30fdffb640 1 -- 172.21.15.59:0/4014334778 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f30f009b8b0 con 0x7f3100101de0 2024-09-10T11:00:42.309 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:42.309 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T11:00:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e80a2c90 msgr2=0x7f30e80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e80a2c90 0x7f30e80a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009230 tx=0x7f30f40058d0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100101de0 msgr2=0x7f31000744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100101de0 0x7f31000744f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c890 tx=0x7f30f000cd50 comp rx=0 tx=0).stop 2024-09-10T11:00:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 shutdown_connections 2024-09-10T11:00:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f30e80a2c90 0x7f30e80a5150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3100106f10 0x7f3100074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3100102790 0x7f3100074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 --2- 172.21.15.59:0/4014334778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100101de0 0x7f31000744f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 >> 172.21.15.59:0/4014334778 conn(0x7f31000fd8c0 msgr2=0x7f31000fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 shutdown_connections 2024-09-10T11:00:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:42.310+0000 7f310714f640 1 -- 172.21.15.59:0/4014334778 wait complete. 2024-09-10T11:00:43.010 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:42 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/4014334778' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T11:00:43.040 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T11:00:43.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:00:43.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:42 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/4014334778' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T11:00:43.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:42 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/4014334778' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T11:00:43.300 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:43.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.822+0000 7f5a5d199640 1 -- 172.21.15.59:0/777458313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58106f10 msgr2=0x7f5a5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:43.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.822+0000 7f5a5d199640 1 --2- 172.21.15.59:0/777458313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58106f10 0x7f5a5810ea90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009ca0 tx=0x7f5a5002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:00:43.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.822+0000 7f5a5d199640 1 -- 172.21.15.59:0/777458313 shutdown_connections 2024-09-10T11:00:43.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.822+0000 7f5a5d199640 1 --2- 172.21.15.59:0/777458313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58106f10 0x7f5a5810ea90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.822+0000 7f5a5d199640 1 --2- 172.21.15.59:0/777458313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a58102790 0x7f5a581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.822+0000 7f5a5d199640 1 --2- 172.21.15.59:0/777458313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a58101de0 0x7f5a581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.822+0000 7f5a5d199640 1 -- 172.21.15.59:0/777458313 >> 172.21.15.59:0/777458313 conn(0x7f5a580fd8c0 msgr2=0x7f5a580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.822+0000 7f5a5d199640 1 -- 172.21.15.59:0/777458313 shutdown_connections 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.822+0000 7f5a5d199640 1 -- 172.21.15.59:0/777458313 wait complete. 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a5d199640 1 Processor -- start 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a5d199640 1 -- start start 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a5d199640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58101de0 0x7f5a580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a5d199640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a58102790 0x7f5a58074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a5d199640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a58106f10 0x7f5a58074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a5d199640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5a58111f70 con 0x7f5a58101de0 2024-09-10T11:00:43.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a5d199640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5a58111df0 con 0x7f5a58106f10 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a5d199640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5a581120f0 con 0x7f5a58102790 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a56d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58101de0 0x7f5a580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a56d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58101de0 0x7f5a580744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57174/0 (socket says 172.21.15.59:57174) 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a56d9d640 1 -- 172.21.15.59:0/3919652505 learned_addr learned my addr 172.21.15.59:0/3919652505 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a4ffff640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a58102790 0x7f5a58074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.823+0000 7f5a5759e640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a58106f10 0x7f5a58074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a56d9d640 1 -- 172.21.15.59:0/3919652505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a58102790 msgr2=0x7f5a58074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a56d9d640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a58102790 0x7f5a58074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a56d9d640 1 -- 172.21.15.59:0/3919652505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a58106f10 msgr2=0x7f5a58074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a56d9d640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a58106f10 0x7f5a58074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a56d9d640 1 -- 172.21.15.59:0/3919652505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a581a6800 con 0x7f5a58101de0 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a4ffff640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a58102790 0x7f5a58074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a56d9d640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58101de0 0x7f5a580744f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800d770 tx=0x7f5a4800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:43.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a54d99640 1 -- 172.21.15.59:0/3919652505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48017070 con 0x7f5a58101de0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a54d99640 1 -- 172.21.15.59:0/3919652505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a48005500 con 0x7f5a58101de0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a581a6af0 con 0x7f5a58101de0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a54d99640 1 -- 172.21.15.59:0/3919652505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48004e00 con 0x7f5a58101de0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.824+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a581a6fe0 con 0x7f5a58101de0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.825+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a581021c0 con 0x7f5a58101de0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.826+0000 7f5a54d99640 1 -- 172.21.15.59:0/3919652505 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5a48004fa0 con 0x7f5a58101de0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.827+0000 7f5a54d99640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5a440a2c10 0x7f5a440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.827+0000 7f5a4ffff640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5a440a2c10 0x7f5a440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.827+0000 7f5a54d99640 1 -- 172.21.15.59:0/3919652505 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f5a480ced40 con 0x7f5a58101de0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.827+0000 7f5a4ffff640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5a440a2c10 0x7f5a440a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a40005e10 tx=0x7f5a40005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:43.831+0000 7f5a54d99640 1 -- 172.21.15.59:0/3919652505 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a4809bb00 con 0x7f5a58101de0 2024-09-10T11:00:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.044+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a5810a150 con 0x7f5a58101de0 2024-09-10T11:00:44.046 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:43 smithi059 ceph-mon[30978]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T11:00:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.045+0000 7f5a54d99640 1 -- 172.21.15.59:0/3919652505 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7f5a4809b400 con 0x7f5a58101de0 2024-09-10T11:00:44.047 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:44.047 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"btime":"2024-09-10T10:59:43:166834+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:59:31.833573+0000","modified":"2024-09-10T10:59:42.866432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24470,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/411505011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":411505011},{"type":"v1","addr":"172.21.15.115:6839","nonce":411505011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24466,24470,24497]},"id":1}]} 2024-09-10T11:00:44.048 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 24 2024-09-10T11:00:44.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5a440a2c10 msgr2=0x7f5a440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:44.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5a440a2c10 0x7f5a440a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a40005e10 tx=0x7f5a40005da0 comp rx=0 tx=0).stop 2024-09-10T11:00:44.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58101de0 msgr2=0x7f5a580744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:44.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58101de0 0x7f5a580744f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800d770 tx=0x7f5a4800dc30 comp rx=0 tx=0).stop 2024-09-10T11:00:44.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 shutdown_connections 2024-09-10T11:00:44.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5a440a2c10 0x7f5a440a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:44.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a58106f10 0x7f5a58074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:44.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5a58102790 0x7f5a58074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:44.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 --2- 172.21.15.59:0/3919652505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a58101de0 0x7f5a580744f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:44.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.047+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 >> 172.21.15.59:0/3919652505 conn(0x7f5a580fd8c0 msgr2=0x7f5a580febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:44.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.048+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 shutdown_connections 2024-09-10T11:00:44.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:44.048+0000 7f5a5d199640 1 -- 172.21.15.59:0/3919652505 wait complete. 2024-09-10T11:00:44.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:43 smithi181 ceph-mon[35409]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T11:00:44.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:43 smithi115 ceph-mon[34719]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T11:00:44.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:00:45.060 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:45.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:44 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3919652505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:00:45.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:44 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3919652505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:00:45.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:44 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3919652505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:00:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.568+0000 7fd6c1590640 1 -- 172.21.15.59:0/1702209860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 msgr2=0x7fd6bc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.568+0000 7fd6c1590640 1 --2- 172.21.15.59:0/1702209860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 0x7fd6bc103110 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009cd0 tx=0x7fd6ac02a8e0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 -- 172.21.15.59:0/1702209860 shutdown_connections 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 --2- 172.21.15.59:0/1702209860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6bc1082a0 0x7fd6bc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 --2- 172.21.15.59:0/1702209860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6bc1036e0 0x7fd6bc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 --2- 172.21.15.59:0/1702209860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 0x7fd6bc103110 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 -- 172.21.15.59:0/1702209860 >> 172.21.15.59:0/1702209860 conn(0x7fd6bc0fc7d0 msgr2=0x7fd6bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 -- 172.21.15.59:0/1702209860 shutdown_connections 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 -- 172.21.15.59:0/1702209860 wait complete. 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 Processor -- start 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 -- start start 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.569+0000 7fd6c1590640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 0x7fd6bc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6c1590640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6bc1036e0 0x7fd6bc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6c1590640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6bc1082a0 0x7fd6bc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6c1590640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc112100 con 0x7fd6bc102d30 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6c1590640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc111f80 con 0x7fd6bc1082a0 2024-09-10T11:00:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6c1590640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc112280 con 0x7fd6bc1036e0 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6baffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 0x7fd6bc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6baffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 0x7fd6bc198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57196/0 (socket says 172.21.15.59:57196) 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6baffd640 1 -- 172.21.15.59:0/852988800 learned_addr learned my addr 172.21.15.59:0/852988800 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6baffd640 1 -- 172.21.15.59:0/852988800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6bc1036e0 msgr2=0x7fd6bc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6baffd640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6bc1036e0 0x7fd6bc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6baffd640 1 -- 172.21.15.59:0/852988800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6bc1082a0 msgr2=0x7fd6bc19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6baffd640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6bc1082a0 0x7fd6bc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6baffd640 1 -- 172.21.15.59:0/852988800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6bc19d4e0 con 0x7fd6bc102d30 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6baffd640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 0x7fd6bc198530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac02ae00 tx=0x7fd6ac003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6a3fff640 1 -- 172.21.15.59:0/852988800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac004240 con 0x7fd6bc102d30 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6a3fff640 1 -- 172.21.15.59:0/852988800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6ac0305a0 con 0x7fd6bc102d30 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6a3fff640 1 -- 172.21.15.59:0/852988800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac03a660 con 0x7fd6bc102d30 2024-09-10T11:00:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6bc19d770 con 0x7fd6bc102d30 2024-09-10T11:00:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.570+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6bc1a50b0 con 0x7fd6bc102d30 2024-09-10T11:00:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.571+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6bc103110 con 0x7fd6bc102d30 2024-09-10T11:00:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.572+0000 7fd6a3fff640 1 -- 172.21.15.59:0/852988800 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd6ac030ac0 con 0x7fd6bc102d30 2024-09-10T11:00:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.573+0000 7fd6a3fff640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6a40a2c10 0x7fd6a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.573+0000 7fd6ba7fc640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6a40a2c10 0x7fd6a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.573+0000 7fd6a3fff640 1 -- 172.21.15.59:0/852988800 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7fd6ac02e030 con 0x7fd6bc102d30 2024-09-10T11:00:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.574+0000 7fd6ba7fc640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6a40a2c10 0x7fd6a40a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0feda0 tx=0x7fd6b0005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.577+0000 7fd6a3fff640 1 -- 172.21.15.59:0/852988800 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6ac0098b0 con 0x7fd6bc102d30 2024-09-10T11:00:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.788+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6bc10a2b0 con 0x7fd6bc102d30 2024-09-10T11:00:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.789+0000 7fd6a3fff640 1 -- 172.21.15.59:0/852988800 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7fd6ac0a7020 con 0x7fd6bc102d30 2024-09-10T11:00:45.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:45.791 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"btime":"2024-09-10T10:59:43:166834+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:59:31.833573+0000","modified":"2024-09-10T10:59:42.866432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24470,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/411505011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":411505011},{"type":"v1","addr":"172.21.15.115:6839","nonce":411505011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24466,24470,24497]},"id":1}]} 2024-09-10T11:00:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 24 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6a40a2c10 msgr2=0x7fd6a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6a40a2c10 0x7fd6a40a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0feda0 tx=0x7fd6b0005c70 comp rx=0 tx=0).stop 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 msgr2=0x7fd6bc198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 0x7fd6bc198530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac02ae00 tx=0x7fd6ac003ba0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 shutdown_connections 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fd6a40a2c10 0x7fd6a40a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6bc1082a0 0x7fd6bc19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6bc1036e0 0x7fd6bc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 --2- 172.21.15.59:0/852988800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6bc102d30 0x7fd6bc198530 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 >> 172.21.15.59:0/852988800 conn(0x7fd6bc0fc7d0 msgr2=0x7fd6bc105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 shutdown_connections 2024-09-10T11:00:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:45.791+0000 7fd6c1590640 1 -- 172.21.15.59:0/852988800 wait complete. 2024-09-10T11:00:46.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:45 smithi059 ceph-mon[30978]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T11:00:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:45 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/852988800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:00:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:45 smithi181 ceph-mon[35409]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T11:00:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:45 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/852988800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:00:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:45 smithi115 ceph-mon[34719]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T11:00:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:45 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/852988800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:00:46.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:00:46.771 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.268+0000 7f3e214a4640 1 -- 172.21.15.59:0/3880736949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c106a80 msgr2=0x7f3e1c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.268+0000 7f3e214a4640 1 --2- 172.21.15.59:0/3880736949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c106a80 0x7f3e1c106e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009930 tx=0x7f3e0c02a420 comp rx=0 tx=0).stop 2024-09-10T11:00:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.268+0000 7f3e214a4640 1 -- 172.21.15.59:0/3880736949 shutdown_connections 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.268+0000 7f3e214a4640 1 --2- 172.21.15.59:0/3880736949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c101420 0x7f3e1c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.268+0000 7f3e214a4640 1 --2- 172.21.15.59:0/3880736949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c100a80 0x7f3e1c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.268+0000 7f3e214a4640 1 --2- 172.21.15.59:0/3880736949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c106a80 0x7f3e1c106e60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.268+0000 7f3e214a4640 1 -- 172.21.15.59:0/3880736949 >> 172.21.15.59:0/3880736949 conn(0x7f3e1c0fc7a0 msgr2=0x7f3e1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.268+0000 7f3e214a4640 1 -- 172.21.15.59:0/3880736949 shutdown_connections 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.268+0000 7f3e214a4640 1 -- 172.21.15.59:0/3880736949 wait complete. 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e214a4640 1 Processor -- start 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e214a4640 1 -- start start 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e214a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c100a80 0x7f3e1c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e214a4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c101420 0x7f3e1c199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e214a4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c106a80 0x7f3e1c1a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e214a4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c110e80 con 0x7f3e1c100a80 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e214a4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c110d00 con 0x7f3e1c101420 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e214a4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c111000 con 0x7f3e1c106a80 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e1affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c100a80 0x7f3e1c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e1affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c100a80 0x7f3e1c199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38310/0 (socket says 172.21.15.59:38310) 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e1affd640 1 -- 172.21.15.59:0/1414059266 learned_addr learned my addr 172.21.15.59:0/1414059266 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e13fff640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c101420 0x7f3e1c199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.269+0000 7f3e1b7fe640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c106a80 0x7f3e1c1a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e1affd640 1 -- 172.21.15.59:0/1414059266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c106a80 msgr2=0x7f3e1c1a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e1affd640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c106a80 0x7f3e1c1a42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e1affd640 1 -- 172.21.15.59:0/1414059266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c101420 msgr2=0x7f3e1c199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e1affd640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c101420 0x7f3e1c199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e1affd640 1 -- 172.21.15.59:0/1414059266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c1a47f0 con 0x7f3e1c100a80 2024-09-10T11:00:47.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e1affd640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c100a80 0x7f3e1c199230 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009230 tx=0x7f3e0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e18ff9640 1 -- 172.21.15.59:0/1414059266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c03f030 con 0x7f3e1c100a80 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e18ff9640 1 -- 172.21.15.59:0/1414059266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e0c003ad0 con 0x7f3e1c100a80 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c1a49c0 con 0x7f3e1c100a80 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e18ff9640 1 -- 172.21.15.59:0/1414059266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c035070 con 0x7f3e1c100a80 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.270+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c1a4e70 con 0x7f3e1c100a80 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.271+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c100ee0 con 0x7f3e1c100a80 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.272+0000 7f3e18ff9640 1 -- 172.21.15.59:0/1414059266 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3e0c042030 con 0x7f3e1c100a80 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.273+0000 7f3e18ff9640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3e080a2c10 0x7f3e080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.274+0000 7f3e13fff640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3e080a2c10 0x7f3e080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.274+0000 7f3e18ff9640 1 -- 172.21.15.59:0/1414059266 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f3e0c0efc50 con 0x7f3e1c100a80 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.274+0000 7f3e13fff640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3e080a2c10 0x7f3e080a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c06b320 tx=0x7f3e04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.277+0000 7f3e18ff9640 1 -- 172.21.15.59:0/1414059266 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e0c0bc360 con 0x7f3e1c100a80 2024-09-10T11:00:47.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.457+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e1c06adc0 con 0x7f3e1c100a80 2024-09-10T11:00:47.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.459+0000 7f3e18ff9640 1 -- 172.21.15.59:0/1414059266 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22832 (secure 0 0 0) 0x7f3e0c0c0660 con 0x7f3e1c100a80 2024-09-10T11:00:47.461 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:47.461 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":85,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T11:00:40.888492+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:59:27.480743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:59:30.088912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:00:47.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3e080a2c10 msgr2=0x7f3e080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3e080a2c10 0x7f3e080a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c06b320 tx=0x7f3e04005f90 comp rx=0 tx=0).stop 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c100a80 msgr2=0x7f3e1c199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c100a80 0x7f3e1c199230 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009230 tx=0x7f3e0c004270 comp rx=0 tx=0).stop 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 shutdown_connections 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3e080a2c10 0x7f3e080a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e1c106a80 0x7f3e1c1a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c101420 0x7f3e1c199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 --2- 172.21.15.59:0/1414059266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1c100a80 0x7f3e1c199230 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.461+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 >> 172.21.15.59:0/1414059266 conn(0x7f3e1c0fc7a0 msgr2=0x7f3e1c0fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.462+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 shutdown_connections 2024-09-10T11:00:47.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:47.462+0000 7f3e214a4640 1 -- 172.21.15.59:0/1414059266 wait complete. 2024-09-10T11:00:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:47 smithi059 ceph-mon[30978]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T11:00:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:47 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1414059266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:00:48.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:47 smithi181 ceph-mon[35409]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T11:00:48.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:47 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1414059266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:00:48.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:00:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:47 smithi115 ceph-mon[34719]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T11:00:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:47 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1414059266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:00:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.979+0000 7f48167d9640 1 -- 172.21.15.59:0/1070543542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810106f10 msgr2=0x7f481010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.979+0000 7f48167d9640 1 --2- 172.21.15.59:0/1070543542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810106f10 0x7f481010ea90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4808009ca0 tx=0x7f480802a8c0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.979+0000 7f48167d9640 1 -- 172.21.15.59:0/1070543542 shutdown_connections 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.979+0000 7f48167d9640 1 --2- 172.21.15.59:0/1070543542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810106f10 0x7f481010ea90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.979+0000 7f48167d9640 1 --2- 172.21.15.59:0/1070543542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4810102790 0x7f48101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.979+0000 7f48167d9640 1 --2- 172.21.15.59:0/1070543542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4810101de0 0x7f48101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.979+0000 7f48167d9640 1 -- 172.21.15.59:0/1070543542 >> 172.21.15.59:0/1070543542 conn(0x7f48100fd8c0 msgr2=0x7f48100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.979+0000 7f48167d9640 1 -- 172.21.15.59:0/1070543542 shutdown_connections 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.979+0000 7f48167d9640 1 -- 172.21.15.59:0/1070543542 wait complete. 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f48167d9640 1 Processor -- start 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f48167d9640 1 -- start start 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f48167d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4810101de0 0x7f48101983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f48167d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810102790 0x7f48101988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f48167d9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4810106f10 0x7f481019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f48167d9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4810111fc0 con 0x7f4810102790 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f48167d9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4810111e40 con 0x7f4810106f10 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f48167d9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4810112140 con 0x7f4810101de0 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f480f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810102790 0x7f48101988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f480f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810102790 0x7f48101988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38322/0 (socket says 172.21.15.59:38322) 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f480f7fe640 1 -- 172.21.15.59:0/2304477982 learned_addr learned my addr 172.21.15.59:0/2304477982 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.980+0000 7f4814d76640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4810106f10 0x7f481019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480ffff640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4810101de0 0x7f48101983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480f7fe640 1 -- 172.21.15.59:0/2304477982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4810101de0 msgr2=0x7f48101983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480f7fe640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4810101de0 0x7f48101983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480f7fe640 1 -- 172.21.15.59:0/2304477982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4810106f10 msgr2=0x7f481019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480f7fe640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4810106f10 0x7f481019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480f7fe640 1 -- 172.21.15.59:0/2304477982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481019d350 con 0x7f4810102790 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480f7fe640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810102790 0x7f48101988e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f480400e9f0 tx=0x7f480400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480d7fa640 1 -- 172.21.15.59:0/2304477982 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480400cd80 con 0x7f4810102790 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480d7fa640 1 -- 172.21.15.59:0/2304477982 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4804005500 con 0x7f4810102790 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481019d640 con 0x7f4810102790 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f480d7fa640 1 -- 172.21.15.59:0/2304477982 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804010690 con 0x7f4810102790 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.981+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48101a4f20 con 0x7f4810102790 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.982+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48101021c0 con 0x7f4810102790 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.983+0000 7f480d7fa640 1 -- 172.21.15.59:0/2304477982 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f48040046c0 con 0x7f4810102790 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.984+0000 7f480d7fa640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f47f80a2c90 0x7f47f80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.984+0000 7f480ffff640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f47f80a2c90 0x7f47f80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.985+0000 7f480d7fa640 1 -- 172.21.15.59:0/2304477982 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f48040cf610 con 0x7f4810102790 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.985+0000 7f480ffff640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f47f80a2c90 0x7f47f80a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4800005fd0 tx=0x7f480000b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:48.989+0000 7f480d7fa640 1 -- 172.21.15.59:0/2304477982 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f480409c3d0 con 0x7f4810102790 2024-09-10T11:00:49.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.199+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4810199700 con 0x7f4810102790 2024-09-10T11:00:49.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.200+0000 7f480d7fa640 1 -- 172.21.15.59:0/2304477982 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7f4810199700 con 0x7f4810102790 2024-09-10T11:00:49.202 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:00:49.202 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"btime":"2024-09-10T10:59:43:166834+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:59:31.833573+0000","modified":"2024-09-10T10:59:42.866432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24470,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/411505011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":411505011},{"type":"v1","addr":"172.21.15.115:6839","nonce":411505011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24466,24470,24497]},"id":1}]} 2024-09-10T11:00:49.202 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 24 2024-09-10T11:00:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f47f80a2c90 msgr2=0x7f47f80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f47f80a2c90 0x7f47f80a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4800005fd0 tx=0x7f480000b590 comp rx=0 tx=0).stop 2024-09-10T11:00:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810102790 msgr2=0x7f48101988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810102790 0x7f48101988e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f480400e9f0 tx=0x7f480400edf0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 shutdown_connections 2024-09-10T11:00:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f47f80a2c90 0x7f47f80a5150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4810106f10 0x7f481019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810102790 0x7f48101988e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 --2- 172.21.15.59:0/2304477982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4810101de0 0x7f48101983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.202+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 >> 172.21.15.59:0/2304477982 conn(0x7f48100fd8c0 msgr2=0x7f48100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.203+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 shutdown_connections 2024-09-10T11:00:49.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:49.203+0000 7f48167d9640 1 -- 172.21.15.59:0/2304477982 wait complete. 2024-09-10T11:00:49.918 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T10:59:31.833573+0000', 'modified': '2024-09-10T10:59:42.866432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24497, 'mds_1': 24470, 'mds_2': 24466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/3551536786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 3551536786}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 3551536786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.115:6835/3263764144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3263764144}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3263764144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6837/4124427529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 4124427529}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 4124427529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.181:6839/262209213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 262209213}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 262209213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.115:6837/417494518', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 417494518}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 417494518}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.115:6839/411505011', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 411505011}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 411505011}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24466, 24470, 24497]} 2024-09-10T11:00:49.918 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T11:00:49.918 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T11:00:50.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:49 smithi059 ceph-mon[30978]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T11:00:50.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:49 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2304477982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:00:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:50.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:49 smithi181 ceph-mon[35409]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T11:00:50.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:49 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2304477982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:00:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:49 smithi115 ceph-mon[34719]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T11:00:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:49 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2304477982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:00:50.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.670+0000 7f2f90555640 1 -- 172.21.15.59:0/2400098343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 msgr2=0x7f2f8810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.670+0000 7f2f90555640 1 --2- 172.21.15.59:0/2400098343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 0x7f2f8810d950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009cd0 tx=0x7f2f8002a8e0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.670+0000 7f2f90555640 1 -- 172.21.15.59:0/2400098343 shutdown_connections 2024-09-10T11:00:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.670+0000 7f2f90555640 1 --2- 172.21.15.59:0/2400098343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 0x7f2f8810d950 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.670+0000 7f2f90555640 1 --2- 172.21.15.59:0/2400098343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f88100a80 0x7f2f88100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.670+0000 7f2f90555640 1 --2- 172.21.15.59:0/2400098343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f88106a80 0x7f2f88106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.670+0000 7f2f90555640 1 -- 172.21.15.59:0/2400098343 >> 172.21.15.59:0/2400098343 conn(0x7f2f880fc7a0 msgr2=0x7f2f880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.670+0000 7f2f90555640 1 -- 172.21.15.59:0/2400098343 shutdown_connections 2024-09-10T11:00:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.670+0000 7f2f90555640 1 -- 172.21.15.59:0/2400098343 wait complete. 2024-09-10T11:00:50.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f90555640 1 Processor -- start 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f90555640 1 -- start start 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f90555640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f88100a80 0x7f2f88198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f90555640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 0x7f2f88198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f90555640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f88106a80 0x7f2f8819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f90555640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88110e80 con 0x7f2f88101420 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f90555640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88110d00 con 0x7f2f88106a80 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f90555640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88111000 con 0x7f2f88100a80 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8daf0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 0x7f2f88198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8daf0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 0x7f2f88198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38352/0 (socket says 172.21.15.59:38352) 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8daf0640 1 -- 172.21.15.59:0/3067037317 learned_addr learned my addr 172.21.15.59:0/3067037317 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8eaf2640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f88106a80 0x7f2f8819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f88100a80 0x7f2f88198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8daf0640 1 -- 172.21.15.59:0/3067037317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f88100a80 msgr2=0x7f2f88198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f88100a80 0x7f2f88198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8daf0640 1 -- 172.21.15.59:0/3067037317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f88106a80 msgr2=0x7f2f8819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f88106a80 0x7f2f8819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.671+0000 7f2f8daf0640 1 -- 172.21.15.59:0/3067037317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8819d3d0 con 0x7f2f88101420 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.672+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 0x7f2f88198960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800c970 tx=0x7f2f7800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.672+0000 7f2f7f7fe640 1 -- 172.21.15.59:0/3067037317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78007bb0 con 0x7f2f88101420 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.672+0000 7f2f7f7fe640 1 -- 172.21.15.59:0/3067037317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f78007d50 con 0x7f2f88101420 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.672+0000 7f2f90555640 1 -- 172.21.15.59:0/3067037317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8819d6c0 con 0x7f2f88101420 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.672+0000 7f2f7f7fe640 1 -- 172.21.15.59:0/3067037317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800f450 con 0x7f2f88101420 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.672+0000 7f2f90555640 1 -- 172.21.15.59:0/3067037317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f881a4fa0 con 0x7f2f88101420 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.674+0000 7f2f7f7fe640 1 -- 172.21.15.59:0/3067037317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2f78005020 con 0x7f2f88101420 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.674+0000 7f2f9292e740 1 Processor -- start 2024-09-10T11:00:50.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f9292e740 1 -- start start 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 0x55f132734db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f13273fbb0 0x55f132741fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f9292e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f13269b090 con 0x55f13273fbb0 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f9292e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f132642a70 con 0x55f1327352f0 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f9292e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f132697050 con 0x55f1327349d0 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f7f7fe640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2f740a2c10 0x7f2f740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8daf0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f13273fbb0 0x55f132741fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8eaf2640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2f740a2c10 0x7f2f740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8daf0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f13273fbb0 0x55f132741fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38362/0 (socket says 172.21.15.59:38362) 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8daf0640 1 -- 172.21.15.59:0/1278391044 learned_addr learned my addr 172.21.15.59:0/1278391044 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:50.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8eaf2640 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 0x55f132734db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f7f7fe640 1 -- 172.21.15.59:0/3067037317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f2f780cf050 con 0x7f2f88101420 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8daf0640 1 -- 172.21.15.59:0/1278391044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 msgr2=0x55f132734db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 0x55f132734db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8daf0640 1 -- 172.21.15.59:0/1278391044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 msgr2=0x55f13273f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8daf0640 1 -- 172.21.15.59:0/1278391044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13264f130 con 0x55f13273fbb0 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.675+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.676+0000 7f2f8eaf2640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2f740a2c10 0x7f2f740a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2f80005fe0 tx=0x7f2f80009a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.676+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f13273fbb0 0x55f132741fa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f780058c0 tx=0x7f2f780c6240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e093205bb419e571 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.676+0000 7f2f7cff9640 1 -- 172.21.15.59:0/1278391044 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7809bdb0 con 0x55f13273fbb0 2024-09-10T11:00:50.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.676+0000 7f2f7cff9640 1 -- 172.21.15.59:0/1278391044 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f7809b6b0 con 0x55f13273fbb0 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.676+0000 7f2f7cff9640 1 -- 172.21.15.59:0/1278391044 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78005310 con 0x55f13273fbb0 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 -- 172.21.15.59:0/1278391044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f13273fbb0 msgr2=0x55f132741fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f13273fbb0 0x55f132741fa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f780058c0 tx=0x7f2f780c6240 comp rx=0 tx=0).stop 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 -- 172.21.15.59:0/1278391044 shutdown_connections 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f13273fbb0 0x55f132741fa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 --2- 172.21.15.59:0/1278391044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 0x55f132734db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 -- 172.21.15.59:0/1278391044 >> 172.21.15.59:0/1278391044 conn(0x55f132730f60 msgr2=0x55f132731340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 -- 172.21.15.59:0/1278391044 shutdown_connections 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 -- 172.21.15.59:0/1278391044 wait complete. 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 -- start start 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 Processor -- start 2024-09-10T11:00:50.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f13273f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f13273fbb0 0x55f13273cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f132742780 con 0x55f1327349d0 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f132655f20 con 0x55f1327352f0 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f132742900 con 0x55f13273fbb0 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.677+0000 7f2f9292e740 10 client.0 _ll_register_callbacks cb 0x55f13261f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8e2f1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f13273f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8e2f1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f13273f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38366/0 (socket says 172.21.15.59:38366) 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8e2f1640 1 -- 172.21.15.59:0/4063934570 learned_addr learned my addr 172.21.15.59:0/4063934570 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8eaf2640 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f13273fbb0 0x55f13273cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8e2f1640 1 -- 172.21.15.59:0/4063934570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f13273fbb0 msgr2=0x55f13273cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f13273fbb0 0x55f13273cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8e2f1640 1 -- 172.21.15.59:0/4063934570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 msgr2=0x55f13273c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8e2f1640 1 -- 172.21.15.59:0/4063934570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f13240c2b0 con 0x55f1327349d0 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f13273f430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2f84011780 tx=0x7f2f84011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c230540adfb8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f71ffb640 1 -- 172.21.15.59:0/4063934570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400fdb0 con 0x55f1327349d0 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f71ffb640 1 -- 172.21.15.59:0/4063934570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f2f84004020 con 0x55f1327349d0 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f9292e740 1 -- 172.21.15.59:0/4063934570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f7809b6b0 con 0x55f1327349d0 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f71ffb640 1 -- 172.21.15.59:0/4063934570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2f84004220 con 0x55f1327349d0 2024-09-10T11:00:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f9292e740 10 client.14952 fetch_fsmap learned FSMap version 24 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.678+0000 7f2f9292e740 1 -- 172.21.15.59:0/4063934570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f13274e130 con 0x55f1327349d0 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.679+0000 7f2f71ffb640 1 -- 172.21.15.59:0/4063934570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f7809b6b0 con 0x55f1327349d0 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.679+0000 7f2f71ffb640 1 -- 172.21.15.59:0/4063934570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2f84018030 con 0x55f1327349d0 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.679+0000 7f2f9292e740 10 client.14952 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.679+0000 7f2f9292e740 10 client.14952 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.679+0000 7f2f9292e740 20 client.14952 populate_metadata read hostname 'smithi059' 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.679+0000 7f2f9292e740 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1327507c0 0x55f132751c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.679+0000 7f2f9292e740 4 client.14952 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.679+0000 7f2f9292e740 1 -- 172.21.15.59:0/4063934570 --> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1326a8600 con 0x55f1327507c0 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.679+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1327507c0 0x55f132751c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.680+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1327507c0 0x55f132751c30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25122bbe03a3883f server_cookie=5b5ce829f3a9fe74 in_seq=0 out_seq=0 2024-09-10T11:00:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.680+0000 7f2f71ffb640 10 client.14952 ms_handle_connect on v2:172.21.15.181:6838/262209213 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.680+0000 7f2f71ffb640 1 -- 172.21.15.59:0/4063934570 <== mds.2 v2:172.21.15.181:6838/262209213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1326a8600 con 0x55f1327507c0 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.680+0000 7f2f71ffb640 10 client.14952 handle_command_reply: tid=0 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.680+0000 7f2f9292e740 1 client.14952 shutdown 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 -- 172.21.15.59:0/4063934570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 msgr2=0x55f13273f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f13273f430 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2f84011780 tx=0x7f2f84011c40 comp rx=0 tx=0).stop 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 -- 172.21.15.59:0/4063934570 shutdown_connections 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1327507c0 0x55f132751c30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f13273fbb0 0x55f13273cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1327352f0 0x55f13273c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f71ffb640 0 client.14952 ms_handle_reset on v2:172.21.15.181:6838/262209213 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 --2- 172.21.15.59:0/4063934570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f13273f430 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 -- 172.21.15.59:0/4063934570 >> 172.21.15.59:0/4063934570 conn(0x55f132730f60 msgr2=0x55f132736c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 -- 172.21.15.59:0/4063934570 shutdown_connections 2024-09-10T11:00:50.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 1 -- 172.21.15.59:0/4063934570 wait complete. 2024-09-10T11:00:50.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.681+0000 7f2f9292e740 20 client.14952 trim_cache size 0 max 16384 2024-09-10T11:00:50.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.698+0000 7f2f9292e740 1 Processor -- start 2024-09-10T11:00:50.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.698+0000 7f2f9292e740 1 -- start start 2024-09-10T11:00:50.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f132751c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327352f0 0x55f132759f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 0x55f13275a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f9292e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f13274ff70 con 0x55f1327349d0 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f9292e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f132750640 con 0x55f13273fbb0 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f9292e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f132750d10 con 0x55f1327352f0 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8e2f1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f132751c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8e2f1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f132751c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38376/0 (socket says 172.21.15.59:38376) 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8e2f1640 1 -- 172.21.15.59:0/1788263902 learned_addr learned my addr 172.21.15.59:0/1788263902 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327352f0 0x55f132759f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8e2f1640 1 -- 172.21.15.59:0/1788263902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327352f0 msgr2=0x55f132759f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327352f0 0x55f132759f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8eaf2640 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 0x55f13275a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8e2f1640 1 -- 172.21.15.59:0/1788263902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 msgr2=0x55f13275a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 0x55f13275a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8e2f1640 1 -- 172.21.15.59:0/1788263902 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f132735120 con 0x55f1327349d0 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8eaf2640 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 0x55f13275a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.699+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f132751c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2f84006010 tx=0x7f2f840056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e14c1f47141e756 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f73fff640 1 -- 172.21.15.59:0/1788263902 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84028040 con 0x55f1327349d0 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f73fff640 1 -- 172.21.15.59:0/1788263902 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f8400fdb0 con 0x55f1327349d0 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f73fff640 1 -- 172.21.15.59:0/1788263902 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f840249e0 con 0x55f1327349d0 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f9292e740 1 -- 172.21.15.59:0/1788263902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 msgr2=0x55f132751c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f9292e740 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f132751c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2f84006010 tx=0x7f2f840056f0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f9292e740 1 -- 172.21.15.59:0/1788263902 shutdown_connections 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f9292e740 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 0x55f13275a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f9292e740 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327352f0 0x55f132759f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f9292e740 1 --2- 172.21.15.59:0/1788263902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327349d0 0x55f132751c30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f9292e740 1 -- 172.21.15.59:0/1788263902 >> 172.21.15.59:0/1788263902 conn(0x55f132730f60 msgr2=0x55f13273b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f9292e740 1 -- 172.21.15.59:0/1788263902 shutdown_connections 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.700+0000 7f2f9292e740 1 -- 172.21.15.59:0/1788263902 wait complete. 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f9292e740 1 -- start start 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f9292e740 1 Processor -- start 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 0x55f132754dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327352f0 0x55f132755300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f9292e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 0x55f132755840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f9292e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f132751ab0 con 0x55f1327352f0 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f9292e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f1327513e0 con 0x55f13273fbb0 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f9292e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f132752180 con 0x55f1327349d0 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f9292e740 10 client.0 _ll_register_callbacks cb 0x7f2f8400c6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8daf0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327352f0 0x55f132755300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8daf0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327352f0 0x55f132755300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38390/0 (socket says 172.21.15.59:38390) 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8daf0640 1 -- 172.21.15.59:0/707051866 learned_addr learned my addr 172.21.15.59:0/707051866 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 0x55f132754dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8eaf2640 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 0x55f132755840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8daf0640 1 -- 172.21.15.59:0/707051866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 msgr2=0x55f132754dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 0x55f132754dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8daf0640 1 -- 172.21.15.59:0/707051866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 msgr2=0x55f132755840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 0x55f132755840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.701+0000 7f2f8daf0640 1 -- 172.21.15.59:0/707051866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1327b9070 con 0x55f1327352f0 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f8daf0640 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327352f0 0x55f132755300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2f78007590 tx=0x7f2f780cf2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d096a946e42fa9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f71ffb640 1 -- 172.21.15.59:0/707051866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7801d040 con 0x55f1327352f0 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f71ffb640 1 -- 172.21.15.59:0/707051866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f2f780b7170 con 0x55f1327352f0 2024-09-10T11:00:50.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f9292e740 1 -- 172.21.15.59:0/707051866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f8400fdb0 con 0x55f1327352f0 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f71ffb640 1 -- 172.21.15.59:0/707051866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2f780ba0c0 con 0x55f1327352f0 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f9292e740 10 client.14958 fetch_fsmap learned FSMap version 24 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f9292e740 1 -- 172.21.15.59:0/707051866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f1327ba2a0 con 0x55f1327352f0 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f71ffb640 1 -- 172.21.15.59:0/707051866 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f8400fdb0 con 0x55f1327352f0 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f71ffb640 1 -- 172.21.15.59:0/707051866 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2f780bb070 con 0x55f1327352f0 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f9292e740 10 client.14958 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f9292e740 10 client.14958 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f9292e740 20 client.14958 populate_metadata read hostname 'smithi059' 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f9292e740 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1327be9e0 0x55f1327bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f9292e740 4 client.14958 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.702+0000 7f2f9292e740 1 -- 172.21.15.59:0/707051866 --> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] -- command(tid 0: {"prefix": "status"}) -- 0x55f1326a2b10 con 0x55f1327be9e0 2024-09-10T11:00:50.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.703+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1327be9e0 0x55f1327bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.703+0000 7f2f71ffb640 10 client.14958 ms_handle_connect on v2:172.21.15.181:6838/262209213 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.703+0000 7f2f8e2f1640 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1327be9e0 0x55f1327bd6f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29668de972442fc3 server_cookie=da3b259a595a5e80 in_seq=0 out_seq=0 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.703+0000 7f2f71ffb640 1 -- 172.21.15.59:0/707051866 <== mds.2 v2:172.21.15.181:6838/262209213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f1326a2b10 con 0x55f1327be9e0 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.703+0000 7f2f71ffb640 10 client.14958 handle_command_reply: tid=0 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.703+0000 7f2f9292e740 1 client.14958 shutdown 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.703+0000 7f2f9292e740 1 -- 172.21.15.59:0/707051866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327352f0 msgr2=0x55f132755300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.703+0000 7f2f9292e740 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327352f0 0x55f132755300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2f78007590 tx=0x7f2f780cf2d0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f9292e740 1 -- 172.21.15.59:0/707051866 shutdown_connections 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f9292e740 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1327be9e0 0x55f1327bd6f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f9292e740 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f13273fbb0 0x55f132755840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f9292e740 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1327352f0 0x55f132755300 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f9292e740 1 --2- 172.21.15.59:0/707051866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1327349d0 0x55f132754dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f9292e740 1 -- 172.21.15.59:0/707051866 >> 172.21.15.59:0/707051866 conn(0x55f132730f60 msgr2=0x55f13273de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f71ffb640 0 client.14958 ms_handle_reset on v2:172.21.15.181:6838/262209213 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f9292e740 1 -- 172.21.15.59:0/707051866 shutdown_connections 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f9292e740 1 -- 172.21.15.59:0/707051866 wait complete. 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f9292e740 20 client.14958 trim_cache size 0 max 16384 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "86a09b02-6f62-11ef-bcea-c7b262605968", 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 2, 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24466, 2024-09-10T11:00:50.712 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T11:00:50.713 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T11:00:50.713 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T11:00:50.713 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 69.544897879999994, 2024-09-10T11:00:50.713 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 24, 2024-09-10T11:00:50.713 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 85, 2024-09-10T11:00:50.713 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T11:00:50.713 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 98.781368369000006 2024-09-10T11:00:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 -- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2f740a2c10 msgr2=0x7f2f740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2f740a2c10 0x7f2f740a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2f80005fe0 tx=0x7f2f80009a20 comp rx=0 tx=0).stop 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 -- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 msgr2=0x7f2f88198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 0x7f2f88198960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800c970 tx=0x7f2f7800ce30 comp rx=0 tx=0).stop 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 -- 172.21.15.59:0/3067037317 shutdown_connections 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2f740a2c10 0x7f2f740a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f88106a80 0x7f2f8819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f88101420 0x7f2f88198960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 --2- 172.21.15.59:0/3067037317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f88100a80 0x7f2f88198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.704+0000 7f2f90555640 1 -- 172.21.15.59:0/3067037317 >> 172.21.15.59:0/3067037317 conn(0x7f2f880fc7a0 msgr2=0x7f2f8806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.705+0000 7f2f90555640 1 -- 172.21.15.59:0/3067037317 shutdown_connections 2024-09-10T11:00:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:50.705+0000 7f2f90555640 1 -- 172.21.15.59:0/3067037317 wait complete. 2024-09-10T11:00:51.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T11:00:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:52.091 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:51 smithi059 ceph-mon[30978]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T11:00:52.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:51 smithi181 ceph-mon[35409]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T11:00:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/322779773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681082a0 msgr2=0x7ffb6810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/322779773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681082a0 0x7ffb6810ec40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009cd0 tx=0x7ffb6002a8e0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/322779773 shutdown_connections 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/322779773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681082a0 0x7ffb6810ec40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/322779773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb681036e0 0x7ffb68107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/322779773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb68102d30 0x7ffb68103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/322779773 >> 172.21.15.59:0/322779773 conn(0x7ffb680fc7d0 msgr2=0x7ffb680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/322779773 shutdown_connections 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/322779773 wait complete. 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.172+0000 7ffb6d2d4640 1 Processor -- start 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb6d2d4640 1 -- start start 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb6d2d4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb68102d30 0x7ffb68198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb6d2d4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681036e0 0x7ffb68198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb6d2d4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb681082a0 0x7ffb6819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb6d2d4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb681120a0 con 0x7ffb681036e0 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb6d2d4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68111f20 con 0x7ffb68102d30 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb6d2d4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68112220 con 0x7ffb681082a0 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb667fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681036e0 0x7ffb68198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb667fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681036e0 0x7ffb68198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38412/0 (socket says 172.21.15.59:38412) 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb667fc640 1 -- 172.21.15.59:0/1235354545 learned_addr learned my addr 172.21.15.59:0/1235354545 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb677fe640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb681082a0 0x7ffb6819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb68102d30 0x7ffb68198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb667fc640 1 -- 172.21.15.59:0/1235354545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb681082a0 msgr2=0x7ffb6819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb667fc640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb681082a0 0x7ffb6819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb667fc640 1 -- 172.21.15.59:0/1235354545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb68102d30 msgr2=0x7ffb68198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb667fc640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb68102d30 0x7ffb68198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb667fc640 1 -- 172.21.15.59:0/1235354545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6819d510 con 0x7ffb681036e0 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.173+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb68102d30 0x7ffb68198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.174+0000 7ffb667fc640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681036e0 0x7ffb68198aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00d750 tx=0x7ffb5c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.174+0000 7ffb4ffff640 1 -- 172.21.15.59:0/1235354545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c017070 con 0x7ffb681036e0 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.174+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/1235354545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6819d800 con 0x7ffb681036e0 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.174+0000 7ffb4ffff640 1 -- 172.21.15.59:0/1235354545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb5c005500 con 0x7ffb681036e0 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.174+0000 7ffb4ffff640 1 -- 172.21.15.59:0/1235354545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c004e00 con 0x7ffb681036e0 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.174+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/1235354545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb681008c0 con 0x7ffb681036e0 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.176+0000 7ffb4ffff640 1 -- 172.21.15.59:0/1235354545 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffb5c004fa0 con 0x7ffb681036e0 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.176+0000 7ffb6f6ad740 1 Processor -- start 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.176+0000 7ffb6f6ad740 1 -- start start 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.176+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72421db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.176+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 0x55eb7242c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb7242cbb0 0x55eb7242efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eb72388090 con 0x55eb724219d0 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eb7232fa70 con 0x55eb7242cbb0 2024-09-10T11:00:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eb72384050 con 0x55eb724222f0 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72421db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72421db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38426/0 (socket says 172.21.15.59:38426) 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 -- 172.21.15.59:0/4275936820 learned_addr learned my addr 172.21.15.59:0/4275936820 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 0x55eb7242c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb4ffff640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ffb500a7020 0x7ffb500a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 -- 172.21.15.59:0/4275936820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 msgr2=0x55eb7242c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb667fc640 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb7242cbb0 0x55eb7242efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 0x55eb7242c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 -- 172.21.15.59:0/4275936820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb7242cbb0 msgr2=0x55eb7242efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb7242cbb0 0x55eb7242efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 -- 172.21.15.59:0/4275936820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb7233c130 con 0x55eb724219d0 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 0x55eb7242c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb4ffff640 1 -- 172.21.15.59:0/1235354545 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7ffb5c0ceb50 con 0x7ffb681036e0 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ffb500a7020 0x7ffb500a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.177+0000 7ffb677fe640 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72421db0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffb60035000 tx=0x7ffb60031570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd9506614f987a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb4d7fa640 1 -- 172.21.15.59:0/4275936820 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60031bc0 con 0x55eb724219d0 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb4d7fa640 1 -- 172.21.15.59:0/4275936820 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb60036070 con 0x55eb724219d0 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb4d7fa640 1 -- 172.21.15.59:0/4275936820 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60030800 con 0x55eb724219d0 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/4275936820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 msgr2=0x55eb72421db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb677fe640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ffb500a7020 0x7ffb500a94e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb60049000 tx=0x7ffb60030e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72421db0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffb60035000 tx=0x7ffb60031570 comp rx=0 tx=0).stop 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/4275936820 shutdown_connections 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb7242cbb0 0x55eb7242efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 0x55eb7242c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/4275936820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72421db0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/4275936820 >> 172.21.15.59:0/4275936820 conn(0x55eb7241df60 msgr2=0x55eb7241e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/4275936820 shutdown_connections 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.178+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/4275936820 wait complete. 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb6f6ad740 1 -- start start 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb6f6ad740 1 Processor -- start 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724219d0 0x55eb7242c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 0x55eb72429760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb72429ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eb7242f780 con 0x55eb7242cbb0 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eb72342f20 con 0x55eb724222f0 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eb7242f900 con 0x55eb724219d0 2024-09-10T11:00:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb6f6ad740 10 client.0 _ll_register_callbacks cb 0x55eb7230c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb72429ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb72429ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38430/0 (socket says 172.21.15.59:38430) 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb677fe640 1 -- 172.21.15.59:0/585121741 learned_addr learned my addr 172.21.15.59:0/585121741 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724219d0 0x55eb7242c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb667fc640 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 0x55eb72429760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb677fe640 1 -- 172.21.15.59:0/585121741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724219d0 msgr2=0x55eb7242c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.179+0000 7ffb677fe640 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724219d0 0x55eb7242c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb677fe640 1 -- 172.21.15.59:0/585121741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 msgr2=0x55eb72429760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb677fe640 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 0x55eb72429760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb677fe640 1 -- 172.21.15.59:0/585121741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb720f92b0 con 0x55eb7242cbb0 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb677fe640 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb72429ca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffb60004640 tx=0x7ffb60041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5fee06168a3937 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:00:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb4aff5640 1 -- 172.21.15.59:0/585121741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60004840 con 0x55eb7242cbb0 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb4aff5640 1 -- 172.21.15.59:0/585121741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7ffb60004b40 con 0x55eb7242cbb0 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/585121741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb60036070 con 0x55eb7242cbb0 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb4aff5640 1 -- 172.21.15.59:0/585121741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffb600307b0 con 0x55eb7242cbb0 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb6f6ad740 10 client.14970 fetch_fsmap learned FSMap version 24 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/585121741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eb7242f780 con 0x55eb7242cbb0 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb4aff5640 1 -- 172.21.15.59:0/585121741 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb60036070 con 0x55eb7242cbb0 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.180+0000 7ffb4aff5640 1 -- 172.21.15.59:0/585121741 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ffb60042040 con 0x55eb7242cbb0 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.181+0000 7ffb6f6ad740 10 client.14970 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.181+0000 7ffb6f6ad740 10 client.14970 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.181+0000 7ffb6f6ad740 20 client.14970 populate_metadata read hostname 'smithi059' 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.181+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x55eb7243d300 0x55eb7243e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.181+0000 7ffb6f6ad740 4 client.14970 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.181+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/585121741 --> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb72395600 con 0x55eb7243d300 2024-09-10T11:00:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.181+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x55eb7243d300 0x55eb7243e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.181+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x55eb7243d300 0x55eb7243e770 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8438d9854fc0429d server_cookie=30df18eeca403784 in_seq=0 out_seq=0 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.181+0000 7ffb4aff5640 10 client.14970 ms_handle_connect on v2:172.21.15.115:6836/417494518 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb4aff5640 1 -- 172.21.15.59:0/585121741 <== mds.1 v2:172.21.15.115:6836/417494518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb72395600 con 0x55eb7243d300 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb4aff5640 10 client.14970 handle_command_reply: tid=0 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 client.14970 shutdown 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/585121741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 msgr2=0x55eb72429ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb72429ca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffb60004640 tx=0x7ffb60041000 comp rx=0 tx=0).stop 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/585121741 shutdown_connections 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x55eb7243d300 0x55eb7243e770 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb72429ca0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb4aff5640 0 client.14970 ms_handle_reset on v2:172.21.15.115:6836/417494518 2024-09-10T11:00:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 0x55eb72429760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/585121741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724219d0 0x55eb7242c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/585121741 >> 172.21.15.59:0/585121741 conn(0x55eb7241df60 msgr2=0x55eb72423c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/585121741 shutdown_connections 2024-09-10T11:00:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/585121741 wait complete. 2024-09-10T11:00:52.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.182+0000 7ffb6f6ad740 20 client.14970 trim_cache size 0 max 16384 2024-09-10T11:00:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb6f6ad740 1 Processor -- start 2024-09-10T11:00:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb6f6ad740 1 -- start start 2024-09-10T11:00:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724219d0 0x55eb724269e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 0x55eb72426f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb724245a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eb7243cab0 con 0x55eb7242cbb0 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eb7243d180 con 0x55eb724219d0 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eb7243d850 con 0x55eb724222f0 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb724245a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb724245a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38434/0 (socket says 172.21.15.59:38434) 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb677fe640 1 -- 172.21.15.59:0/783418835 learned_addr learned my addr 172.21.15.59:0/783418835 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb667fc640 1 --2- 172.21.15.59:0/783418835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 0x55eb72426f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/783418835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724219d0 0x55eb724269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb677fe640 1 -- 172.21.15.59:0/783418835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 msgr2=0x55eb72426f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb677fe640 1 --2- 172.21.15.59:0/783418835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 0x55eb72426f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb677fe640 1 -- 172.21.15.59:0/783418835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724219d0 msgr2=0x55eb724269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb677fe640 1 --2- 172.21.15.59:0/783418835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724219d0 0x55eb724269e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb677fe640 1 -- 172.21.15.59:0/783418835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb7241eb60 con 0x55eb7242cbb0 2024-09-10T11:00:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.201+0000 7ffb677fe640 1 --2- 172.21.15.59:0/783418835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb724245a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb6002ae00 tx=0x7ffb60000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fc11440bb58328 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb4cff9640 1 -- 172.21.15.59:0/783418835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60003bc0 con 0x55eb7242cbb0 2024-09-10T11:00:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb4cff9640 1 -- 172.21.15.59:0/783418835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb60036070 con 0x55eb7242cbb0 2024-09-10T11:00:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb4cff9640 1 -- 172.21.15.59:0/783418835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60045990 con 0x55eb7242cbb0 2024-09-10T11:00:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/783418835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 msgr2=0x55eb724245a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/783418835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb724245a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb6002ae00 tx=0x7ffb60000f40 comp rx=0 tx=0).stop 2024-09-10T11:00:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/783418835 shutdown_connections 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/783418835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb7242cbb0 0x55eb724245a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/783418835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb724222f0 0x55eb72426f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/783418835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724219d0 0x55eb724269e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.202+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/783418835 >> 172.21.15.59:0/783418835 conn(0x55eb7241df60 msgr2=0x55eb72428030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/783418835 shutdown_connections 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/783418835 wait complete. 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 -- start start 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 Processor -- start 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72425d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 0x55eb72426290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb7242cbb0 0x55eb72445a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eb7243e5f0 con 0x55eb724219d0 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eb7243df20 con 0x55eb724222f0 2024-09-10T11:00:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eb7243ecc0 con 0x55eb7242cbb0 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb6f6ad740 10 client.0 _ll_register_callbacks cb 0x7ffb60048020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb66ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72425d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb66ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72425d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38444/0 (socket says 172.21.15.59:38444) 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb66ffd640 1 -- 172.21.15.59:0/1407370729 learned_addr learned my addr 172.21.15.59:0/1407370729 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb667fc640 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 0x55eb72426290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.203+0000 7ffb677fe640 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb7242cbb0 0x55eb72445a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb66ffd640 1 -- 172.21.15.59:0/1407370729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb7242cbb0 msgr2=0x55eb72445a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb7242cbb0 0x55eb72445a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb66ffd640 1 -- 172.21.15.59:0/1407370729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 msgr2=0x55eb72426290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 0x55eb72426290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb66ffd640 1 -- 172.21.15.59:0/1407370729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb72445f70 con 0x55eb724219d0 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb667fc640 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 0x55eb72426290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb66ffd640 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72425d50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb58005d90 tx=0x7ffb58004b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7beaec1b88bc19cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb4aff5640 1 -- 172.21.15.59:0/1407370729 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800cb60 con 0x55eb724219d0 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb4aff5640 1 -- 172.21.15.59:0/1407370729 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7ffb580118f0 con 0x55eb724219d0 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/1407370729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb60036070 con 0x55eb724219d0 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb4aff5640 1 -- 172.21.15.59:0/1407370729 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffb58011af0 con 0x55eb724219d0 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb6f6ad740 10 client.14976 fetch_fsmap learned FSMap version 24 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/1407370729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eb72447230 con 0x55eb724219d0 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb4aff5640 1 -- 172.21.15.59:0/1407370729 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb60036070 con 0x55eb724219d0 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.204+0000 7ffb4aff5640 1 -- 172.21.15.59:0/1407370729 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ffb60031bc0 con 0x55eb724219d0 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb6f6ad740 10 client.14976 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb6f6ad740 10 client.14976 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb6f6ad740 20 client.14976 populate_metadata read hostname 'smithi059' 2024-09-10T11:00:52.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x55eb724abf20 0x55eb724aac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb6f6ad740 4 client.14976 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/1407370729 --> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] -- command(tid 0: {"prefix": "status"}) -- 0x55eb7238fb10 con 0x55eb724abf20 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb667fc640 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x55eb724abf20 0x55eb724aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb667fc640 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x55eb724abf20 0x55eb724aac30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e30347c64cc48b3 server_cookie=ca5ad711fa53c142 in_seq=0 out_seq=0 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb4aff5640 10 client.14976 ms_handle_connect on v2:172.21.15.115:6836/417494518 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb4aff5640 1 -- 172.21.15.59:0/1407370729 <== mds.1 v2:172.21.15.115:6836/417494518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55eb7238fb10 con 0x55eb724abf20 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb4aff5640 10 client.14976 handle_command_reply: tid=0 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.205+0000 7ffb6f6ad740 1 client.14976 shutdown 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/1407370729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 msgr2=0x55eb72425d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72425d50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb58005d90 tx=0x7ffb58004b70 comp rx=0 tx=0).stop 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/1407370729 shutdown_connections 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x55eb724abf20 0x55eb724aac30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb7242cbb0 0x55eb72445a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb724222f0 0x55eb72426290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb4aff5640 0 client.14976 ms_handle_reset on v2:172.21.15.115:6836/417494518 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 --2- 172.21.15.59:0/1407370729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb724219d0 0x55eb72425d50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/1407370729 >> 172.21.15.59:0/1407370729 conn(0x55eb7241df60 msgr2=0x55eb72424dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/1407370729 shutdown_connections 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 1 -- 172.21.15.59:0/1407370729 wait complete. 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6f6ad740 20 client.14976 trim_cache size 0 max 16384 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "86a09b02-6f62-11ef-bcea-c7b262605968", 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 1, 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24470, 2024-09-10T11:00:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T11:00:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T11:00:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T11:00:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 73.058662006999995, 2024-09-10T11:00:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 24, 2024-09-10T11:00:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 85, 2024-09-10T11:00:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T11:00:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 103.025158468 2024-09-10T11:00:52.214 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:00:52.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ffb500a7020 msgr2=0x7ffb500a94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ffb500a7020 0x7ffb500a94e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb60049000 tx=0x7ffb60030e50 comp rx=0 tx=0).stop 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681036e0 msgr2=0x7ffb68198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681036e0 0x7ffb68198aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00d750 tx=0x7ffb5c00dc10 comp rx=0 tx=0).stop 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/1235354545 shutdown_connections 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7ffb500a7020 0x7ffb500a94e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb681082a0 0x7ffb6819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb681036e0 0x7ffb68198aa0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.206+0000 7ffb6d2d4640 1 --2- 172.21.15.59:0/1235354545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb68102d30 0x7ffb68198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.207+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/1235354545 >> 172.21.15.59:0/1235354545 conn(0x7ffb680fc7d0 msgr2=0x7ffb68105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.207+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/1235354545 shutdown_connections 2024-09-10T11:00:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:52.207+0000 7ffb6d2d4640 1 -- 172.21.15.59:0/1235354545 wait complete. 2024-09-10T11:00:52.216 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:51 smithi115 ceph-mon[34719]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T11:00:52.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T11:00:53.159 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:53.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 -- 172.21.15.59:0/2791993106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102ef0 msgr2=0x7f7e5810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 --2- 172.21.15.59:0/2791993106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102ef0 0x7f7e5810da40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009ca0 tx=0x7f7e5002a950 comp rx=0 tx=0).stop 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 -- 172.21.15.59:0/2791993106 shutdown_connections 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 --2- 172.21.15.59:0/2791993106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102ef0 0x7f7e5810da40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 --2- 172.21.15.59:0/2791993106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e58102570 0x7f7e581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 --2- 172.21.15.59:0/2791993106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58100e20 0x7f7e58101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 -- 172.21.15.59:0/2791993106 >> 172.21.15.59:0/2791993106 conn(0x7f7e580fc7d0 msgr2=0x7f7e580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 -- 172.21.15.59:0/2791993106 shutdown_connections 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 -- 172.21.15.59:0/2791993106 wait complete. 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 Processor -- start 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.624+0000 7f7e5e627640 1 -- start start 2024-09-10T11:00:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e5e627640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58100e20 0x7f7e581974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e5e627640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102570 0x7f7e58197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e5e627640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e58102ef0 0x7f7e5819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e5e627640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e58111020 con 0x7f7e58102570 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e5e627640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7e58110ea0 con 0x7f7e58100e20 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e5e627640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7e581111a0 con 0x7f7e58102ef0 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102570 0x7f7e58197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102570 0x7f7e58197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38470/0 (socket says 172.21.15.59:38470) 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e577fe640 1 -- 172.21.15.59:0/1915356279 learned_addr learned my addr 172.21.15.59:0/1915356279 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e58102ef0 0x7f7e5819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e57fff640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58100e20 0x7f7e581974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e577fe640 1 -- 172.21.15.59:0/1915356279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e58102ef0 msgr2=0x7f7e5819bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e577fe640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e58102ef0 0x7f7e5819bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e577fe640 1 -- 172.21.15.59:0/1915356279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58100e20 msgr2=0x7f7e581974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e577fe640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58100e20 0x7f7e581974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e577fe640 1 -- 172.21.15.59:0/1915356279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5819c490 con 0x7f7e58102570 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e57fff640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58100e20 0x7f7e581974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.625+0000 7f7e577fe640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102570 0x7f7e58197a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00b4a0 tx=0x7f7e4c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.626+0000 7f7e557fa640 1 -- 172.21.15.59:0/1915356279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c014070 con 0x7f7e58102570 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.626+0000 7f7e5e627640 1 -- 172.21.15.59:0/1915356279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5819c780 con 0x7f7e58102570 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.626+0000 7f7e557fa640 1 -- 172.21.15.59:0/1915356279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e4c010af0 con 0x7f7e58102570 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.626+0000 7f7e557fa640 1 -- 172.21.15.59:0/1915356279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c017d10 con 0x7f7e58102570 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.626+0000 7f7e5e627640 1 -- 172.21.15.59:0/1915356279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e581a4060 con 0x7f7e58102570 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.628+0000 7f7e557fa640 1 -- 172.21.15.59:0/1915356279 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7e4c017070 con 0x7f7e58102570 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.628+0000 7f7e60a00740 1 Processor -- start 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.628+0000 7f7e60a00740 1 -- start start 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.628+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fcf8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.628+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcf90b0 0x55824fcf9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.628+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 0x55824fd08080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.628+0000 7f7e60a00740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55824fc5d090 con 0x55824fcfa270 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.628+0000 7f7e60a00740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55824fc04a70 con 0x55824fcf90b0 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.628+0000 7f7e60a00740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55824fc59050 con 0x55824fd05c70 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fcf8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fcf8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38486/0 (socket says 172.21.15.59:38486) 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 -- 172.21.15.59:0/2030267712 learned_addr learned my addr 172.21.15.59:0/2030267712 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e57fff640 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcf90b0 0x55824fcf9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e577fe640 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 0x55824fd08080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e557fa640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7e400a2c10 0x7f7e400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 -- 172.21.15.59:0/2030267712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 msgr2=0x55824fd08080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 0x55824fd08080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 -- 172.21.15.59:0/2030267712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcf90b0 msgr2=0x55824fcf9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcf90b0 0x55824fcf9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 -- 172.21.15.59:0/2030267712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55824fc11130 con 0x55824fcfa270 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e577fe640 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 0x55824fd08080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e557fa640 1 -- 172.21.15.59:0/1915356279 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f7e4c0ce540 con 0x7f7e58102570 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7e400a2c10 0x7f7e400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fcf8ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7e50035000 tx=0x7f7e5002ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1dd0e4e683abfc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.629+0000 7f7e3e7fc640 1 -- 172.21.15.59:0/2030267712 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e50034040 con 0x55824fcfa270 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e3e7fc640 1 -- 172.21.15.59:0/2030267712 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e5002f620 con 0x55824fcfa270 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e3e7fc640 1 -- 172.21.15.59:0/2030267712 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e50030790 con 0x55824fcfa270 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e60a00740 1 -- 172.21.15.59:0/2030267712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 msgr2=0x55824fcf8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e60a00740 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fcf8ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7e50035000 tx=0x7f7e5002ff40 comp rx=0 tx=0).stop 2024-09-10T11:00:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7e400a2c10 0x7f7e400a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7e5004a000 tx=0x7f7e5004d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e60a00740 1 -- 172.21.15.59:0/2030267712 shutdown_connections 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e60a00740 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 0x55824fd08080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e60a00740 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcf90b0 0x55824fcf9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e60a00740 1 --2- 172.21.15.59:0/2030267712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fcf8ae0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e60a00740 1 -- 172.21.15.59:0/2030267712 >> 172.21.15.59:0/2030267712 conn(0x55824fcf5170 msgr2=0x55824fcf5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e60a00740 1 -- 172.21.15.59:0/2030267712 shutdown_connections 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.630+0000 7f7e60a00740 1 -- 172.21.15.59:0/2030267712 wait complete. 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e60a00740 1 -- start start 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e60a00740 1 Processor -- start 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 0x55824fd05560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 0x55824fd028b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fd05c70 0x55824fd02df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e60a00740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55824fd08b40 con 0x55824fd05c70 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e60a00740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55824fc17f20 con 0x55824fcfa270 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e60a00740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55824fd08cc0 con 0x55824fcf90b0 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e60a00740 10 client.0 _ll_register_callbacks cb 0x55824fbe1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e5cbc4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fd05c70 0x55824fd02df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e5cbc4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fd05c70 0x55824fd02df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38492/0 (socket says 172.21.15.59:38492) 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.631+0000 7f7e5cbc4640 1 -- 172.21.15.59:0/716944069 learned_addr learned my addr 172.21.15.59:0/716944069 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e57fff640 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 0x55824fd05560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e577fe640 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 0x55824fd028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e5cbc4640 1 -- 172.21.15.59:0/716944069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 msgr2=0x55824fd05560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 0x55824fd05560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e5cbc4640 1 -- 172.21.15.59:0/716944069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 msgr2=0x55824fd028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 0x55824fd028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e5cbc4640 1 -- 172.21.15.59:0/716944069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55824f9ce2b0 con 0x55824fd05c70 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e57fff640 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 0x55824fd05560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e577fe640 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 0x55824fd028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fd05c70 0x55824fd02df0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7e5002a990 tx=0x7f7e50030c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64420a354651c167 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e377fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e377fe640 1 -- 172.21.15.59:0/716944069 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5005c060 con 0x55824fd05c70 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e377fe640 1 -- 172.21.15.59:0/716944069 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f7e50004110 con 0x55824fd05c70 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e60a00740 1 -- 172.21.15.59:0/716944069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e5002f620 con 0x55824fd05c70 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e377fe640 1 -- 172.21.15.59:0/716944069 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7e50034070 con 0x55824fd05c70 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e60a00740 10 client.14988 fetch_fsmap learned FSMap version 24 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e60a00740 1 -- 172.21.15.59:0/716944069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55824fd14460 con 0x55824fd05c70 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.632+0000 7f7e377fe640 1 -- 172.21.15.59:0/716944069 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e5002f620 con 0x55824fd05c70 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e377fe640 1 -- 172.21.15.59:0/716944069 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7e5004f910 con 0x55824fd05c70 2024-09-10T11:00:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e60a00740 10 client.14988 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e60a00740 10 client.14988 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e60a00740 20 client.14988 populate_metadata read hostname 'smithi059' 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e60a00740 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55824fd165c0 0x55824fd17a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e60a00740 4 client.14988 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e60a00740 1 -- 172.21.15.59:0/716944069 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55824fc6a600 con 0x55824fd165c0 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e57fff640 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55824fd165c0 0x55824fd17a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e57fff640 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55824fd165c0 0x55824fd17a30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cd783aebeb013d4 server_cookie=34c0f6b97e08f788 in_seq=0 out_seq=0 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.633+0000 7f7e377fe640 10 client.14988 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.634+0000 7f7e377fe640 1 -- 172.21.15.59:0/716944069 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55824fc6a600 con 0x55824fd165c0 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.634+0000 7f7e377fe640 10 client.14988 handle_command_reply: tid=0 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.634+0000 7f7e60a00740 1 client.14988 shutdown 2024-09-10T11:00:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 -- 172.21.15.59:0/716944069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fd05c70 msgr2=0x55824fd02df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fd05c70 0x55824fd02df0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7e5002a990 tx=0x7f7e50030c20 comp rx=0 tx=0).stop 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 -- 172.21.15.59:0/716944069 shutdown_connections 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55824fd165c0 0x55824fd17a30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fd05c70 0x55824fd02df0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 0x55824fd028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 --2- 172.21.15.59:0/716944069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 0x55824fd05560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e377fe640 0 client.14988 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 -- 172.21.15.59:0/716944069 >> 172.21.15.59:0/716944069 conn(0x55824fcf5170 msgr2=0x55824fcfaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 -- 172.21.15.59:0/716944069 shutdown_connections 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 1 -- 172.21.15.59:0/716944069 wait complete. 2024-09-10T11:00:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.635+0000 7f7e60a00740 20 client.14988 trim_cache size 0 max 16384 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.652+0000 7f7e60a00740 1 Processor -- start 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e60a00740 1 -- start start 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcf90b0 0x55824fcfa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 0x55824fcfab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 0x55824fcfb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e60a00740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55824fd15d70 con 0x55824fcf90b0 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e60a00740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55824fd16440 con 0x55824fcfa270 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e60a00740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55824fd16b10 con 0x55824fd05c70 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e57fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcf90b0 0x55824fcfa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e57fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcf90b0 0x55824fcfa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38494/0 (socket says 172.21.15.59:38494) 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e57fff640 1 -- 172.21.15.59:0/4216210228 learned_addr learned my addr 172.21.15.59:0/4216210228 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e57fff640 1 -- 172.21.15.59:0/4216210228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 msgr2=0x55824fcfb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e57fff640 1 --2- 172.21.15.59:0/4216210228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 0x55824fcfb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e57fff640 1 -- 172.21.15.59:0/4216210228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 msgr2=0x55824fcfab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e57fff640 1 --2- 172.21.15.59:0/4216210228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 0x55824fcfab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e57fff640 1 -- 172.21.15.59:0/4216210228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55824fd08cb0 con 0x55824fcf90b0 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e57fff640 1 --2- 172.21.15.59:0/4216210228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcf90b0 0x55824fcfa650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55824fd18260 tx=0x7f7e4800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eae7125225553a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e3dffb640 1 -- 172.21.15.59:0/4216210228 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48016b80 con 0x55824fcf90b0 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e3dffb640 1 -- 172.21.15.59:0/4216210228 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e48016d20 con 0x55824fcf90b0 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.653+0000 7f7e3dffb640 1 -- 172.21.15.59:0/4216210228 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4801b430 con 0x55824fcf90b0 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 -- 172.21.15.59:0/4216210228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcf90b0 msgr2=0x55824fcfa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 --2- 172.21.15.59:0/4216210228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcf90b0 0x55824fcfa650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55824fd18260 tx=0x7f7e4800b910 comp rx=0 tx=0).stop 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 -- 172.21.15.59:0/4216210228 shutdown_connections 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 --2- 172.21.15.59:0/4216210228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fd05c70 0x55824fcfb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 --2- 172.21.15.59:0/4216210228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fcfa270 0x55824fcfab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 --2- 172.21.15.59:0/4216210228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcf90b0 0x55824fcfa650 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 -- 172.21.15.59:0/4216210228 >> 172.21.15.59:0/4216210228 conn(0x55824fcf5170 msgr2=0x55824fcedce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 -- 172.21.15.59:0/4216210228 shutdown_connections 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 -- 172.21.15.59:0/4216210228 wait complete. 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.654+0000 7f7e60a00740 1 -- start start 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e60a00740 1 Processor -- start 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 0x55824fd19e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fd1a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e60a00740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fd05c70 0x55824fd1e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e60a00740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55824fd178b0 con 0x55824fcfa270 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e60a00740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55824fd171e0 con 0x55824fd05c70 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e60a00740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55824fd17f80 con 0x55824fcf90b0 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e60a00740 10 client.0 _ll_register_callbacks cb 0x7f7e5002fe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fd1a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fd1a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38510/0 (socket says 172.21.15.59:38510) 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e577fe640 1 -- 172.21.15.59:0/3131623778 learned_addr learned my addr 172.21.15.59:0/3131623778 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e57fff640 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 0x55824fd19e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e5cbc4640 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fd05c70 0x55824fd1e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e577fe640 1 -- 172.21.15.59:0/3131623778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 msgr2=0x55824fd19e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e577fe640 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 0x55824fd19e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e577fe640 1 -- 172.21.15.59:0/3131623778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fd05c70 msgr2=0x55824fd1e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:00:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e577fe640 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fd05c70 0x55824fd1e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.655+0000 7f7e577fe640 1 -- 172.21.15.59:0/3131623778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55824fd1eb30 con 0x55824fcfa270 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e577fe640 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fd1a340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0976e0 tx=0x7f7e4c09a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621a8fb8733a600f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e377fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e377fe640 1 -- 172.21.15.59:0/3131623778 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c01e040 con 0x55824fcfa270 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e377fe640 1 -- 172.21.15.59:0/3131623778 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f7e4c097380 con 0x55824fcfa270 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e60a00740 1 -- 172.21.15.59:0/3131623778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e48016d20 con 0x55824fcfa270 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e377fe640 1 -- 172.21.15.59:0/3131623778 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7e4c09f0c0 con 0x55824fcfa270 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e60a00740 10 client.14994 fetch_fsmap learned FSMap version 24 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e60a00740 1 -- 172.21.15.59:0/3131623778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55824fd813f0 con 0x55824fcfa270 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e377fe640 1 -- 172.21.15.59:0/3131623778 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e48016d20 con 0x55824fcfa270 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e377fe640 1 -- 172.21.15.59:0/3131623778 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7e4c0ce100 con 0x55824fcfa270 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e60a00740 10 client.14994 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e60a00740 10 client.14994 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e60a00740 20 client.14994 populate_metadata read hostname 'smithi059' 2024-09-10T11:00:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e60a00740 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55824fd85ec0 0x55824fd84bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e60a00740 4 client.14994 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.656+0000 7f7e60a00740 1 -- 172.21.15.59:0/3131623778 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "status"}) -- 0x55824fc64b10 con 0x55824fd85ec0 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e57fff640 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55824fd85ec0 0x55824fd84bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e57fff640 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55824fd85ec0 0x55824fd84bd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca59fa290908aae7 server_cookie=54845e3daa7e1391 in_seq=0 out_seq=0 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e377fe640 10 client.14994 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e377fe640 1 -- 172.21.15.59:0/3131623778 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55824fc64b10 con 0x55824fd85ec0 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e377fe640 10 client.14994 handle_command_reply: tid=0 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e60a00740 1 client.14994 shutdown 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e60a00740 1 -- 172.21.15.59:0/3131623778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 msgr2=0x55824fd1a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e60a00740 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fd1a340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0976e0 tx=0x7f7e4c09a730 comp rx=0 tx=0).stop 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e60a00740 1 -- 172.21.15.59:0/3131623778 shutdown_connections 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e60a00740 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55824fd85ec0 0x55824fd84bd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.657+0000 7f7e60a00740 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55824fd05c70 0x55824fd1e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e60a00740 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55824fcfa270 0x55824fd1a340 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e60a00740 1 --2- 172.21.15.59:0/3131623778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55824fcf90b0 0x55824fd19e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e60a00740 1 -- 172.21.15.59:0/3131623778 >> 172.21.15.59:0/3131623778 conn(0x55824fcf5170 msgr2=0x55824fcfa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e377fe640 0 client.14994 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e60a00740 1 -- 172.21.15.59:0/3131623778 shutdown_connections 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e60a00740 1 -- 172.21.15.59:0/3131623778 wait complete. 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e60a00740 20 client.14994 trim_cache size 0 max 16384 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "86a09b02-6f62-11ef-bcea-c7b262605968", 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24497, 2024-09-10T11:00:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T11:00:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T11:00:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T11:00:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 81.548425635000001, 2024-09-10T11:00:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 24, 2024-09-10T11:00:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 85, 2024-09-10T11:00:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T11:00:53.673 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 92.696479126 2024-09-10T11:00:53.673 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 -- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7e400a2c10 msgr2=0x7f7e400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7e400a2c10 0x7f7e400a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7e5004a000 tx=0x7f7e5004d000 comp rx=0 tx=0).stop 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 -- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102570 msgr2=0x7f7e58197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102570 0x7f7e58197a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00b4a0 tx=0x7f7e4c00b960 comp rx=0 tx=0).stop 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 -- 172.21.15.59:0/1915356279 shutdown_connections 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7e400a2c10 0x7f7e400a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e58102ef0 0x7f7e5819bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e58102570 0x7f7e58197a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 --2- 172.21.15.59:0/1915356279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e58100e20 0x7f7e581974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 -- 172.21.15.59:0/1915356279 >> 172.21.15.59:0/1915356279 conn(0x7f7e580fc7d0 msgr2=0x7f7e580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.658+0000 7f7e5e627640 1 -- 172.21.15.59:0/1915356279 shutdown_connections 2024-09-10T11:00:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:53.659+0000 7f7e5e627640 1 -- 172.21.15.59:0/1915356279 wait complete. 2024-09-10T11:00:54.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:53 smithi181 ceph-mon[35409]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T11:00:54.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:53 smithi115 ceph-mon[34719]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T11:00:54.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:53 smithi059 ceph-mon[30978]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T11:00:54.421 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T11:00:54.421 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T11:00:54.433 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:00:54.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T11:00:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.175+0000 7f5b595a7640 1 -- 172.21.15.59:0/2722696516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54100290 msgr2=0x7f5b54100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.175+0000 7f5b595a7640 1 --2- 172.21.15.59:0/2722696516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54100290 0x7f5b54100690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009900 tx=0x7f5b4402a3f0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.175+0000 7f5b595a7640 1 -- 172.21.15.59:0/2722696516 shutdown_connections 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.175+0000 7f5b595a7640 1 --2- 172.21.15.59:0/2722696516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b54101e50 0x7f5b541086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.175+0000 7f5b595a7640 1 --2- 172.21.15.59:0/2722696516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b54101490 0x7f5b54101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.175+0000 7f5b595a7640 1 --2- 172.21.15.59:0/2722696516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54100290 0x7f5b54100690 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.175+0000 7f5b595a7640 1 -- 172.21.15.59:0/2722696516 >> 172.21.15.59:0/2722696516 conn(0x7f5b540fba40 msgr2=0x7f5b540fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.175+0000 7f5b595a7640 1 -- 172.21.15.59:0/2722696516 shutdown_connections 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.175+0000 7f5b595a7640 1 -- 172.21.15.59:0/2722696516 wait complete. 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b595a7640 1 Processor -- start 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b595a7640 1 -- start start 2024-09-10T11:00:55.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b595a7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b54100290 0x7f5b54104220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b595a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b54101490 0x7f5b54102870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b595a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54101e50 0x7f5b54102db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b595a7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5410bf70 con 0x7f5b54101e50 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b595a7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5410bdf0 con 0x7f5b54100290 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b595a7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5410c0f0 con 0x7f5b54101490 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54101e50 0x7f5b54102db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54101e50 0x7f5b54102db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38524/0 (socket says 172.21.15.59:38524) 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b537fe640 1 -- 172.21.15.59:0/405988552 learned_addr learned my addr 172.21.15.59:0/405988552 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b52ffd640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b54100290 0x7f5b54104220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b527fc640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b54101490 0x7f5b54102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b537fe640 1 -- 172.21.15.59:0/405988552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b54101490 msgr2=0x7f5b54102870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b537fe640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b54101490 0x7f5b54102870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b537fe640 1 -- 172.21.15.59:0/405988552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b54100290 msgr2=0x7f5b54104220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b537fe640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b54100290 0x7f5b54104220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.176+0000 7f5b537fe640 1 -- 172.21.15.59:0/405988552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b54103670 con 0x7f5b54101e50 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.177+0000 7f5b537fe640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54101e50 0x7f5b54102db0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00b970 tx=0x7f5b4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.177+0000 7f5b3bfff640 1 -- 172.21.15.59:0/405988552 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c019070 con 0x7f5b54101e50 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.177+0000 7f5b3bfff640 1 -- 172.21.15.59:0/405988552 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4c00cb40 con 0x7f5b54101e50 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.177+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b541a2100 con 0x7f5b54101e50 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.177+0000 7f5b3bfff640 1 -- 172.21.15.59:0/405988552 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c007650 con 0x7f5b54101e50 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.177+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b541a2640 con 0x7f5b54101e50 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.178+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b54100690 con 0x7f5b54101e50 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.180+0000 7f5b3bfff640 1 -- 172.21.15.59:0/405988552 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5b4c01c070 con 0x7f5b54101e50 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.181+0000 7f5b3bfff640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5b3c0a2c10 0x7f5b3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.181+0000 7f5b52ffd640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5b3c0a2c10 0x7f5b3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.181+0000 7f5b3bfff640 1 -- 172.21.15.59:0/405988552 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f5b4c0ceb70 con 0x7f5b54101e50 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.181+0000 7f5b52ffd640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5b3c0a2c10 0x7f5b3c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b440314e0 tx=0x7f5b440315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:55.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.184+0000 7f5b3bfff640 1 -- 172.21.15.59:0/405988552 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b4c09b390 con 0x7f5b54101e50 2024-09-10T11:00:55.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.374+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f5b54062630 con 0x7f5b3c0a2c10 2024-09-10T11:00:55.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.375+0000 7f5b3bfff640 1 -- 172.21.15.59:0/405988552 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5b54062630 con 0x7f5b3c0a2c10 2024-09-10T11:00:55.377 INFO:teuthology.orchestra.run.smithi059.stdout:Backend: cephadm 2024-09-10T11:00:55.377 INFO:teuthology.orchestra.run.smithi059.stdout:Available: Yes 2024-09-10T11:00:55.377 INFO:teuthology.orchestra.run.smithi059.stdout:Paused: No 2024-09-10T11:00:55.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5b3c0a2c10 msgr2=0x7f5b3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:55.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5b3c0a2c10 0x7f5b3c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b440314e0 tx=0x7f5b440315b0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54101e50 msgr2=0x7f5b54102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:55.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54101e50 0x7f5b54102db0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00b970 tx=0x7f5b4c00be30 comp rx=0 tx=0).stop 2024-09-10T11:00:55.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 shutdown_connections 2024-09-10T11:00:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f5b3c0a2c10 0x7f5b3c0a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b54101e50 0x7f5b54102db0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5b54101490 0x7f5b54102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 --2- 172.21.15.59:0/405988552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b54100290 0x7f5b54104220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 >> 172.21.15.59:0/405988552 conn(0x7f5b540fba40 msgr2=0x7f5b5410cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 shutdown_connections 2024-09-10T11:00:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:55.377+0000 7f5b595a7640 1 -- 172.21.15.59:0/405988552 wait complete. 2024-09-10T11:00:56.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T11:00:56.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:55 smithi059 ceph-mon[30978]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T11:00:56.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:55 smithi059 ceph-mon[30978]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:00:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:55 smithi181 ceph-mon[35409]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T11:00:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:55 smithi181 ceph-mon[35409]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:00:56.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:55 smithi115 ceph-mon[34719]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T11:00:56.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:55 smithi115 ceph-mon[34719]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:00:56.309 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.837+0000 7fa6d9098640 1 -- 172.21.15.59:0/2779287841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4107900 msgr2=0x7fa6d4109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.837+0000 7fa6d9098640 1 --2- 172.21.15.59:0/2779287841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4107900 0x7fa6d4109d50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009ca0 tx=0x7fa6cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:00:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.837+0000 7fa6d9098640 1 -- 172.21.15.59:0/2779287841 shutdown_connections 2024-09-10T11:00:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.837+0000 7fa6d9098640 1 --2- 172.21.15.59:0/2779287841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4107900 0x7fa6d4109d50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.837+0000 7fa6d9098640 1 --2- 172.21.15.59:0/2779287841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6d4104fd0 0x7fa6d41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.837+0000 7fa6d9098640 1 --2- 172.21.15.59:0/2779287841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d41026a0 0x7fa6d4104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.837+0000 7fa6d9098640 1 -- 172.21.15.59:0/2779287841 >> 172.21.15.59:0/2779287841 conn(0x7fa6d40fc2a0 msgr2=0x7fa6d40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.837+0000 7fa6d9098640 1 -- 172.21.15.59:0/2779287841 shutdown_connections 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.837+0000 7fa6d9098640 1 -- 172.21.15.59:0/2779287841 wait complete. 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d9098640 1 Processor -- start 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d9098640 1 -- start start 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d9098640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d41026a0 0x7fa6d4197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d9098640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4104fd0 0x7fa6d41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d9098640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6d4107900 0x7fa6d419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d9098640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d410d940 con 0x7fa6d4104fd0 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d9098640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d410d7c0 con 0x7fa6d41026a0 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d9098640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d410dac0 con 0x7fa6d4107900 2024-09-10T11:00:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4104fd0 0x7fa6d41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4104fd0 0x7fa6d41984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39812/0 (socket says 172.21.15.59:39812) 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d259c640 1 -- 172.21.15.59:0/1914982627 learned_addr learned my addr 172.21.15.59:0/1914982627 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d2d9d640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d41026a0 0x7fa6d4197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.838+0000 7fa6d359e640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6d4107900 0x7fa6d419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6d259c640 1 -- 172.21.15.59:0/1914982627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6d4107900 msgr2=0x7fa6d419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6d259c640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6d4107900 0x7fa6d419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6d259c640 1 -- 172.21.15.59:0/1914982627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d41026a0 msgr2=0x7fa6d4197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6d259c640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d41026a0 0x7fa6d4197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6d259c640 1 -- 172.21.15.59:0/1914982627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d419fba0 con 0x7fa6d4104fd0 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6d259c640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4104fd0 0x7fa6d41984b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c970 tx=0x7fa6c800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6bbfff640 1 -- 172.21.15.59:0/1914982627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8007bb0 con 0x7fa6d4104fd0 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d419fe90 con 0x7fa6d4104fd0 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6bbfff640 1 -- 172.21.15.59:0/1914982627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c8007d50 con 0x7fa6d4104fd0 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6bbfff640 1 -- 172.21.15.59:0/1914982627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8018870 con 0x7fa6d4104fd0 2024-09-10T11:00:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.839+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d41a03c0 con 0x7fa6d4104fd0 2024-09-10T11:00:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.840+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d40fdd90 con 0x7fa6d4104fd0 2024-09-10T11:00:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.842+0000 7fa6bbfff640 1 -- 172.21.15.59:0/1914982627 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa6c8018a10 con 0x7fa6d4104fd0 2024-09-10T11:00:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.842+0000 7fa6bbfff640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6bc0a2c40 0x7fa6bc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.842+0000 7fa6d2d9d640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6bc0a2c40 0x7fa6bc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.842+0000 7fa6bbfff640 1 -- 172.21.15.59:0/1914982627 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7fa6c80cf620 con 0x7fa6d4104fd0 2024-09-10T11:00:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.843+0000 7fa6d2d9d640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6bc0a2c40 0x7fa6bc0a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009990 tx=0x7fa6c4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:56.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:56.845+0000 7fa6bbfff640 1 -- 172.21.15.59:0/1914982627 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6c8014030 con 0x7fa6d4104fd0 2024-09-10T11:00:57.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.033+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa6d4062630 con 0x7fa6bc0a2c40 2024-09-10T11:00:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.047+0000 7fa6bbfff640 1 -- 172.21.15.59:0/1914982627 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fa6d4062630 con 0x7fa6bc0a2c40 2024-09-10T11:00:57.049 INFO:teuthology.orchestra.run.smithi059.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T11:00:57.049 INFO:teuthology.orchestra.run.smithi059.stdout:mds.a smithi059 running (99s) 19s ago 98s 14.0M - 19.1.1-305-g1cf819b7 41d671128357 c7177cafb17b 2024-09-10T11:00:57.049 INFO:teuthology.orchestra.run.smithi059.stdout:mds.b smithi115 running (96s) 28s ago 96s 26.2M - 19.1.1-305-g1cf819b7 41d671128357 7c22dccd8514 2024-09-10T11:00:57.049 INFO:teuthology.orchestra.run.smithi059.stdout:mds.c smithi181 running (110s) 28s ago 110s 19.5M - 19.1.1-305-g1cf819b7 41d671128357 4c5c205ff791 2024-09-10T11:00:57.049 INFO:teuthology.orchestra.run.smithi059.stdout:mds.d smithi059 running (118s) 19s ago 118s 15.9M - 19.1.1-305-g1cf819b7 41d671128357 384041201ca9 2024-09-10T11:00:57.049 INFO:teuthology.orchestra.run.smithi059.stdout:mds.e smithi115 running (116s) 28s ago 115s 15.9M - 19.1.1-305-g1cf819b7 41d671128357 7dc7dcbb6de7 2024-09-10T11:00:57.049 INFO:teuthology.orchestra.run.smithi059.stdout:mds.f smithi181 running (113s) 28s ago 113s 16.9M - 19.1.1-305-g1cf819b7 41d671128357 8c4d874877d8 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mds.g smithi059 running (102s) 19s ago 101s 14.0M - 19.1.1-305-g1cf819b7 41d671128357 8a47b092f746 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mds.h smithi115 running (108s) 28s ago 107s 20.5M - 19.1.1-305-g1cf819b7 41d671128357 ded43844aba2 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mds.i smithi181 running (105s) 28s ago 105s 20.3M - 19.1.1-305-g1cf819b7 41d671128357 aa81da2952fd 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mds.j smithi059 running (2m) 19s ago 2m 16.0M - 19.1.1-305-g1cf819b7 41d671128357 719175ea0b31 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mds.k smithi115 running (2m) 28s ago 2m 16.7M - 19.1.1-305-g1cf819b7 41d671128357 d9a80b5aec54 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mds.l smithi181 running (2m) 28s ago 2m 15.9M - 19.1.1-305-g1cf819b7 41d671128357 e1dd3464e4eb 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mgr.x smithi059 *:9283,8765 running (8m) 19s ago 8m 508M - 19.1.1-305-g1cf819b7 41d671128357 25d8ecb57e9b 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mgr.y smithi115 *:8443,8765 running (7m) 28s ago 7m 441M - 19.1.1-305-g1cf819b7 41d671128357 f81e84745418 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mgr.z smithi181 *:8443,8765 running (7m) 28s ago 7m 441M - 19.1.1-305-g1cf819b7 41d671128357 5186d3b5526b 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mon.a smithi059 running (8m) 19s ago 9m 49.3M 2048M 19.1.1-305-g1cf819b7 41d671128357 f6b2538fa8e4 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mon.b smithi115 running (7m) 28s ago 7m 40.6M 2048M 19.1.1-305-g1cf819b7 41d671128357 32a1631198bf 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:mon.c smithi181 running (7m) 28s ago 7m 40.3M 2048M 19.1.1-305-g1cf819b7 41d671128357 7582c7f71e5f 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0 smithi059 running (7m) 19s ago 7m 56.6M 4273M 19.1.1-305-g1cf819b7 41d671128357 acee1f1d7653 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1 smithi115 running (6m) 28s ago 6m 45.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 c6e7d27bc6f7 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2 smithi181 running (6m) 28s ago 6m 58.7M 4272M 19.1.1-305-g1cf819b7 41d671128357 cca97aa5e1b3 2024-09-10T11:00:57.050 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3 smithi059 running (5m) 19s ago 5m 43.6M 4273M 19.1.1-305-g1cf819b7 41d671128357 cbc5896ce4ea 2024-09-10T11:00:57.051 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4 smithi115 running (5m) 28s ago 5m 54.4M 4272M 19.1.1-305-g1cf819b7 41d671128357 c2f2ffbf06cd 2024-09-10T11:00:57.051 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5 smithi181 running (4m) 28s ago 4m 54.7M 4272M 19.1.1-305-g1cf819b7 41d671128357 5d15d7dcdc4d 2024-09-10T11:00:57.051 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6 smithi059 running (4m) 19s ago 4m 53.1M 4273M 19.1.1-305-g1cf819b7 41d671128357 4daae53351f2 2024-09-10T11:00:57.051 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7 smithi115 running (4m) 28s ago 4m 46.0M 4272M 19.1.1-305-g1cf819b7 41d671128357 2b45d5398e1a 2024-09-10T11:00:57.051 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8 smithi181 running (3m) 28s ago 3m 42.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 e67ec1751f6e 2024-09-10T11:00:57.051 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9 smithi059 running (3m) 19s ago 3m 41.5M 4273M 19.1.1-305-g1cf819b7 41d671128357 3ae62eed86c5 2024-09-10T11:00:57.051 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10 smithi115 running (2m) 28s ago 2m 57.9M 4272M 19.1.1-305-g1cf819b7 41d671128357 22d595cbd5ff 2024-09-10T11:00:57.051 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11 smithi181 running (2m) 28s ago 2m 50.7M 4272M 19.1.1-305-g1cf819b7 41d671128357 0999e238ddea 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6bc0a2c40 msgr2=0x7fa6bc0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6bc0a2c40 0x7fa6bc0a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009990 tx=0x7fa6c4009110 comp rx=0 tx=0).stop 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4104fd0 msgr2=0x7fa6d41984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4104fd0 0x7fa6d41984b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c970 tx=0x7fa6c800cd70 comp rx=0 tx=0).stop 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 shutdown_connections 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa6bc0a2c40 0x7fa6bc0a5100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6d4107900 0x7fa6d419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d4104fd0 0x7fa6d41984b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 --2- 172.21.15.59:0/1914982627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6d41026a0 0x7fa6d4197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.049+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 >> 172.21.15.59:0/1914982627 conn(0x7fa6d40fc2a0 msgr2=0x7fa6d4102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:57.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.050+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 shutdown_connections 2024-09-10T11:00:57.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:57.050+0000 7fa6d9098640 1 -- 172.21.15.59:0/1914982627 wait complete. 2024-09-10T11:00:57.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T11:00:57.953 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:57 smithi181 ceph-mon[35409]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:57 smithi181 ceph-mon[35409]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:00:58.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:57 smithi115 ceph-mon[34719]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:58.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:57 smithi115 ceph-mon[34719]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:00:58.219 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:57 smithi059 ceph-mon[30978]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:00:58.219 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:57 smithi059 ceph-mon[30978]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.453+0000 7f4a31dc5640 1 -- 172.21.15.59:0/1576712929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c101c00 msgr2=0x7f4a2c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.453+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/1576712929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c101c00 0x7f4a2c102000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009900 tx=0x7f4a1402a410 comp rx=0 tx=0).stop 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.453+0000 7f4a31dc5640 1 -- 172.21.15.59:0/1576712929 shutdown_connections 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.453+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/1576712929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2c1037c0 0x7f4a2c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.453+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/1576712929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a2c102e00 0x7f4a2c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.453+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/1576712929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c101c00 0x7f4a2c102000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.453+0000 7f4a31dc5640 1 -- 172.21.15.59:0/1576712929 >> 172.21.15.59:0/1576712929 conn(0x7f4a2c0fd390 msgr2=0x7f4a2c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.453+0000 7f4a31dc5640 1 -- 172.21.15.59:0/1576712929 shutdown_connections 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.453+0000 7f4a31dc5640 1 -- 172.21.15.59:0/1576712929 wait complete. 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.454+0000 7f4a31dc5640 1 Processor -- start 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.454+0000 7f4a31dc5640 1 -- start start 2024-09-10T11:00:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.454+0000 7f4a31dc5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2c101c00 0x7f4a2c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.454+0000 7f4a31dc5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a2c102e00 0x7f4a2c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.454+0000 7f4a31dc5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c1037c0 0x7f4a2c19f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.454+0000 7f4a31dc5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c10d900 con 0x7f4a2c1037c0 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.454+0000 7f4a31dc5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c10d780 con 0x7f4a2c102e00 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.454+0000 7f4a31dc5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c10da80 con 0x7f4a2c101c00 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.454+0000 7f4a2bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c1037c0 0x7f4a2c19f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c1037c0 0x7f4a2c19f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39834/0 (socket says 172.21.15.59:39834) 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2bfff640 1 -- 172.21.15.59:0/461513368 learned_addr learned my addr 172.21.15.59:0/461513368 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2b7fe640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2c101c00 0x7f4a2c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2affd640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a2c102e00 0x7f4a2c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2bfff640 1 -- 172.21.15.59:0/461513368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2c101c00 msgr2=0x7f4a2c197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2bfff640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2c101c00 0x7f4a2c197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2bfff640 1 -- 172.21.15.59:0/461513368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a2c102e00 msgr2=0x7f4a2c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2bfff640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a2c102e00 0x7f4a2c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2bfff640 1 -- 172.21.15.59:0/461513368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c19fba0 con 0x7f4a2c1037c0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2b7fe640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2c101c00 0x7f4a2c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a2bfff640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c1037c0 0x7f4a2c19f530 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400eaa0 tx=0x7f4a2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a28ff9640 1 -- 172.21.15.59:0/461513368 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400cdb0 con 0x7f4a2c1037c0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a28ff9640 1 -- 172.21.15.59:0/461513368 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a24005020 con 0x7f4a2c1037c0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2c19fe90 con 0x7f4a2c1037c0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a28ff9640 1 -- 172.21.15.59:0/461513368 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a240116b0 con 0x7f4a2c1037c0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.455+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2c1a0410 con 0x7f4a2c1037c0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.456+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2c109000 con 0x7f4a2c1037c0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.457+0000 7f4a28ff9640 1 -- 172.21.15.59:0/461513368 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4a24005560 con 0x7f4a2c1037c0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.459+0000 7f4a28ff9640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a180a2cc0 0x7f4a180a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.459+0000 7f4a2b7fe640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a180a2cc0 0x7f4a180a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:00:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.459+0000 7f4a28ff9640 1 -- 172.21.15.59:0/461513368 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f4a240cf420 con 0x7f4a2c1037c0 2024-09-10T11:00:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.459+0000 7f4a2b7fe640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a180a2cc0 0x7f4a180a5180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a14006010 tx=0x7f4a14032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:00:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.463+0000 7f4a28ff9640 1 -- 172.21.15.59:0/461513368 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a24016030 con 0x7f4a2c1037c0 2024-09-10T11:00:58.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.648+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f4a2c062630 con 0x7f4a180a2cc0 2024-09-10T11:00:58.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.654+0000 7f4a28ff9640 1 -- 172.21.15.59:0/461513368 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f4a2c062630 con 0x7f4a180a2cc0 2024-09-10T11:00:58.656 INFO:teuthology.orchestra.run.smithi059.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T11:00:58.656 INFO:teuthology.orchestra.run.smithi059.stdout:mds.all 12/12 30s ago 2m smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-10T11:00:58.656 INFO:teuthology.orchestra.run.smithi059.stdout:mgr 3/3 30s ago 7m smithi059=x;smithi115=y;smithi181=z;count:3 2024-09-10T11:00:58.656 INFO:teuthology.orchestra.run.smithi059.stdout:mon 3/3 30s ago 7m smithi059:172.21.15.59=a;smithi115:172.21.15.115=b;smithi181:172.21.15.181=c;count:3 2024-09-10T11:00:58.656 INFO:teuthology.orchestra.run.smithi059.stdout:osd 12 30s ago - 2024-09-10T11:00:58.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a180a2cc0 msgr2=0x7f4a180a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:58.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a180a2cc0 0x7f4a180a5180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a14006010 tx=0x7f4a14032dd0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c1037c0 msgr2=0x7f4a2c19f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:00:58.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c1037c0 0x7f4a2c19f530 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400eaa0 tx=0x7f4a2400ef60 comp rx=0 tx=0).stop 2024-09-10T11:00:58.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 shutdown_connections 2024-09-10T11:00:58.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f4a180a2cc0 0x7f4a180a5180 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a2c1037c0 0x7f4a2c19f530 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a2c102e00 0x7f4a2c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 --2- 172.21.15.59:0/461513368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a2c101c00 0x7f4a2c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:00:58.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.656+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 >> 172.21.15.59:0/461513368 conn(0x7f4a2c0fd390 msgr2=0x7f4a2c1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:00:58.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.657+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 shutdown_connections 2024-09-10T11:00:58.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:00:58.657+0000 7f4a31dc5640 1 -- 172.21.15.59:0/461513368 wait complete. 2024-09-10T11:00:59.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:58 smithi181 ceph-mon[35409]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:00:59.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:58 smithi115 ceph-mon[34719]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:00:59.286 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:58 smithi059 ceph-mon[30978]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:00:59.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T11:00:59.582 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:00:59.990 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:00:59 smithi059 ceph-mon[30978]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:01:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.072+0000 7fa43b8b3640 1 -- 172.21.15.59:0/2625350962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4341026d0 msgr2=0x7fa434108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.072+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/2625350962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4341026d0 0x7fa434108f60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009ca0 tx=0x7fa42c02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.072+0000 7fa43b8b3640 1 -- 172.21.15.59:0/2625350962 shutdown_connections 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.072+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/2625350962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4341026d0 0x7fa434108f60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.072+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/2625350962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa434101d10 0x7fa434102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.072+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/2625350962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa434100b10 0x7fa434100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.072+0000 7fa43b8b3640 1 -- 172.21.15.59:0/2625350962 >> 172.21.15.59:0/2625350962 conn(0x7fa4340fc2a0 msgr2=0x7fa4340fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.072+0000 7fa43b8b3640 1 -- 172.21.15.59:0/2625350962 shutdown_connections 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.072+0000 7fa43b8b3640 1 -- 172.21.15.59:0/2625350962 wait complete. 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa43b8b3640 1 Processor -- start 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa43b8b3640 1 -- start start 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa43b8b3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa434100b10 0x7fa434197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa43b8b3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434101d10 0x7fa434198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa43b8b3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4341026d0 0x7fa43419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa43b8b3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa43410d900 con 0x7fa434101d10 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa43b8b3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa43410d780 con 0x7fa4341026d0 2024-09-10T11:01:00.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa43b8b3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa43410da80 con 0x7fa434100b10 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa438e4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434101d10 0x7fa434198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa438e4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434101d10 0x7fa434198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39852/0 (socket says 172.21.15.59:39852) 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa438e4e640 1 -- 172.21.15.59:0/4211209462 learned_addr learned my addr 172.21.15.59:0/4211209462 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa43964f640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa434100b10 0x7fa434197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.073+0000 7fa439e50640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4341026d0 0x7fa43419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa438e4e640 1 -- 172.21.15.59:0/4211209462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa434100b10 msgr2=0x7fa434197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa438e4e640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa434100b10 0x7fa434197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa438e4e640 1 -- 172.21.15.59:0/4211209462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4341026d0 msgr2=0x7fa43419f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa438e4e640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4341026d0 0x7fa43419f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa438e4e640 1 -- 172.21.15.59:0/4211209462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43419fb50 con 0x7fa434101d10 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa438e4e640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434101d10 0x7fa434198460 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b4a0 tx=0x7fa42400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa42a7fc640 1 -- 172.21.15.59:0/4211209462 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424014070 con 0x7fa434101d10 2024-09-10T11:01:00.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa42a7fc640 1 -- 172.21.15.59:0/4211209462 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa424010af0 con 0x7fa434101d10 2024-09-10T11:01:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43419fe40 con 0x7fa434101d10 2024-09-10T11:01:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa42a7fc640 1 -- 172.21.15.59:0/4211209462 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424017d10 con 0x7fa434101d10 2024-09-10T11:01:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.074+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4341a0320 con 0x7fa434101d10 2024-09-10T11:01:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.075+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa434107ec0 con 0x7fa434101d10 2024-09-10T11:01:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.076+0000 7fa42a7fc640 1 -- 172.21.15.59:0/4211209462 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa424017070 con 0x7fa434101d10 2024-09-10T11:01:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.077+0000 7fa42a7fc640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa4200a2c40 0x7fa4200a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.077+0000 7fa43964f640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa4200a2c40 0x7fa4200a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.077+0000 7fa42a7fc640 1 -- 172.21.15.59:0/4211209462 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7fa4240ce820 con 0x7fa434101d10 2024-09-10T11:01:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.077+0000 7fa43964f640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa4200a2c40 0x7fa4200a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa434101b70 tx=0x7fa43000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.080+0000 7fa42a7fc640 1 -- 172.21.15.59:0/4211209462 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa42409b6f0 con 0x7fa434101d10 2024-09-10T11:01:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:00:59 smithi181 ceph-mon[35409]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:01:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:00:59 smithi115 ceph-mon[34719]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:01:00.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.262+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fa434062630 con 0x7fa4200a2c40 2024-09-10T11:01:00.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.264+0000 7fa42a7fc640 1 -- 172.21.15.59:0/4211209462 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fa434062630 con 0x7fa4200a2c40 2024-09-10T11:01:00.266 INFO:teuthology.orchestra.run.smithi059.stdout:HOST ADDR LABELS STATUS 2024-09-10T11:01:00.266 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059 172.21.15.59 2024-09-10T11:01:00.266 INFO:teuthology.orchestra.run.smithi059.stdout:smithi115 172.21.15.115 2024-09-10T11:01:00.266 INFO:teuthology.orchestra.run.smithi059.stdout:smithi181 172.21.15.181 2024-09-10T11:01:00.266 INFO:teuthology.orchestra.run.smithi059.stdout:3 hosts in cluster 2024-09-10T11:01:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa4200a2c40 msgr2=0x7fa4200a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa4200a2c40 0x7fa4200a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa434101b70 tx=0x7fa43000b390 comp rx=0 tx=0).stop 2024-09-10T11:01:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434101d10 msgr2=0x7fa434198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434101d10 0x7fa434198460 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b4a0 tx=0x7fa42400b960 comp rx=0 tx=0).stop 2024-09-10T11:01:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 shutdown_connections 2024-09-10T11:01:00.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fa4200a2c40 0x7fa4200a5100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4341026d0 0x7fa43419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434101d10 0x7fa434198460 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 --2- 172.21.15.59:0/4211209462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa434100b10 0x7fa434197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 >> 172.21.15.59:0/4211209462 conn(0x7fa4340fc2a0 msgr2=0x7fa434105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 shutdown_connections 2024-09-10T11:01:00.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:00.266+0000 7fa43b8b3640 1 -- 172.21.15.59:0/4211209462 wait complete. 2024-09-10T11:01:00.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T11:01:01.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:00 smithi059 ceph-mon[30978]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:01.183 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:01.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:00 smithi115 ceph-mon[34719]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:01.314 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:00 smithi181 ceph-mon[35409]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:01.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 -- 172.21.15.59:0/629099249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944103870 msgr2=0x7f594410a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:01.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 --2- 172.21.15.59:0/629099249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944103870 0x7f594410a100 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f593c009cd0 tx=0x7f593c02a8e0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 -- 172.21.15.59:0/629099249 shutdown_connections 2024-09-10T11:01:01.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 --2- 172.21.15.59:0/629099249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5944103870 0x7f594410a100 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 --2- 172.21.15.59:0/629099249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5944102eb0 0x7f5944103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 --2- 172.21.15.59:0/629099249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f59440ffed0 0x7f59441002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 -- 172.21.15.59:0/629099249 >> 172.21.15.59:0/629099249 conn(0x7f59440fba40 msgr2=0x7f59440fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 -- 172.21.15.59:0/629099249 shutdown_connections 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 -- 172.21.15.59:0/629099249 wait complete. 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 Processor -- start 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.682+0000 7f594abea640 1 -- start start 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f594abea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59440ffed0 0x7f5944102810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f594abea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5944102eb0 0x7f5944100e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f594abea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5944103870 0x7f59441013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f594abea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f594410d930 con 0x7f59440ffed0 2024-09-10T11:01:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f594abea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f594410d7b0 con 0x7f5944102eb0 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f594abea640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f594410dab0 con 0x7f5944103870 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5948986640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59440ffed0 0x7f5944102810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5948986640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59440ffed0 0x7f5944102810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39866/0 (socket says 172.21.15.59:39866) 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5948986640 1 -- 172.21.15.59:0/2528114846 learned_addr learned my addr 172.21.15.59:0/2528114846 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5943fff640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5944102eb0 0x7f5944100e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5949187640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5944103870 0x7f59441013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5948986640 1 -- 172.21.15.59:0/2528114846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5944103870 msgr2=0x7f59441013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5948986640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5944103870 0x7f59441013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5948986640 1 -- 172.21.15.59:0/2528114846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5944102eb0 msgr2=0x7f5944100e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5948986640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5944102eb0 0x7f5944100e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5948986640 1 -- 172.21.15.59:0/2528114846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5944101c60 con 0x7f59440ffed0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.683+0000 7f5948986640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59440ffed0 0x7f5944102810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f593800b450 tx=0x7f593800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.684+0000 7f5941ffb640 1 -- 172.21.15.59:0/2528114846 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5938015020 con 0x7f59440ffed0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.684+0000 7f5941ffb640 1 -- 172.21.15.59:0/2528114846 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5938011d10 con 0x7f59440ffed0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.684+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59441a20b0 con 0x7f59440ffed0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.684+0000 7f5941ffb640 1 -- 172.21.15.59:0/2528114846 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593800f2e0 con 0x7f59440ffed0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.684+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59441a2640 con 0x7f59440ffed0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.685+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5944109060 con 0x7f59440ffed0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.686+0000 7f5941ffb640 1 -- 172.21.15.59:0/2528114846 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5938018020 con 0x7f59440ffed0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.686+0000 7f5941ffb640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f59340a2c90 0x7f59340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.687+0000 7f5941ffb640 1 -- 172.21.15.59:0/2528114846 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f59380ce970 con 0x7f59440ffed0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.687+0000 7f5943fff640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f59340a2c90 0x7f59340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.687+0000 7f5943fff640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f59340a2c90 0x7f59340a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5944102590 tx=0x7f593000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.691+0000 7f5941ffb640 1 -- 172.21.15.59:0/2528114846 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f593801f020 con 0x7f59440ffed0 2024-09-10T11:01:01.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.874+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5944062630 con 0x7f59340a2c90 2024-09-10T11:01:01.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.876+0000 7f5941ffb640 1 -- 172.21.15.59:0/2528114846 <== mgr.14150 v2:172.21.15.59:6800/3145930564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f5944062630 con 0x7f59340a2c90 2024-09-10T11:01:01.878 INFO:teuthology.orchestra.run.smithi059.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T11:01:01.878 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009L400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T11:01:01.878 INFO:teuthology.orchestra.run.smithi059.stdout:smithi115 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T11:01:01.878 INFO:teuthology.orchestra.run.smithi059.stdout:smithi181 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000E400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T11:01:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f59340a2c90 msgr2=0x7f59340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f59340a2c90 0x7f59340a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5944102590 tx=0x7f593000a2d0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59440ffed0 msgr2=0x7f5944102810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:01.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59440ffed0 0x7f5944102810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f593800b450 tx=0x7f593800b850 comp rx=0 tx=0).stop 2024-09-10T11:01:01.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 shutdown_connections 2024-09-10T11:01:01.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f59340a2c90 0x7f59340a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5944103870 0x7f59441013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5944102eb0 0x7f5944100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 --2- 172.21.15.59:0/2528114846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59440ffed0 0x7f5944102810 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 >> 172.21.15.59:0/2528114846 conn(0x7f59440fba40 msgr2=0x7f5944106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 shutdown_connections 2024-09-10T11:01:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:01.879+0000 7f594abea640 1 -- 172.21.15.59:0/2528114846 wait complete. 2024-09-10T11:01:02.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:01 smithi059 ceph-mon[30978]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:01 smithi115 ceph-mon[34719]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:02.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:01 smithi181 ceph-mon[35409]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:02.691 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T11:01:02.701 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:01:02.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T11:01:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:03.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:02 smithi115 ceph-mon[34719]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:03.232 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:02 smithi059 ceph-mon[30978]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:03.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:02 smithi181 ceph-mon[35409]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:03.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 -- 172.21.15.59:0/3626804964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 msgr2=0x7f7ce810bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:03.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 --2- 172.21.15.59:0/3626804964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 0x7f7ce810bf30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009ca0 tx=0x7f7ce002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 -- 172.21.15.59:0/3626804964 shutdown_connections 2024-09-10T11:01:03.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 --2- 172.21.15.59:0/3626804964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 0x7f7ce810bf30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 --2- 172.21.15.59:0/3626804964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ce8074b40 0x7f7ce8074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 --2- 172.21.15.59:0/3626804964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce80761a0 0x7f7ce8074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 -- 172.21.15.59:0/3626804964 >> 172.21.15.59:0/3626804964 conn(0x7f7ce80fd390 msgr2=0x7f7ce80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 -- 172.21.15.59:0/3626804964 shutdown_connections 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 -- 172.21.15.59:0/3626804964 wait complete. 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 Processor -- start 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.460+0000 7f7cee379640 1 -- start start 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cee379640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ce8074b40 0x7f7ce819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cee379640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce80761a0 0x7f7ce819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cee379640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 0x7f7ce81a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cee379640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce810fba0 con 0x7f7ce8109a70 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cee379640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce810fa20 con 0x7f7ce80761a0 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cee379640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce810fd20 con 0x7f7ce8074b40 2024-09-10T11:01:03.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cec916640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 0x7f7ce81a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cec916640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 0x7f7ce81a1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39888/0 (socket says 172.21.15.59:39888) 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cec916640 1 -- 172.21.15.59:0/3925887780 learned_addr learned my addr 172.21.15.59:0/3925887780 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7ce7fff640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ce8074b40 0x7f7ce819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7ce77fe640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce80761a0 0x7f7ce819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cec916640 1 -- 172.21.15.59:0/3925887780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ce8074b40 msgr2=0x7f7ce819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cec916640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ce8074b40 0x7f7ce819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cec916640 1 -- 172.21.15.59:0/3925887780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce80761a0 msgr2=0x7f7ce819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cec916640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce80761a0 0x7f7ce819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cec916640 1 -- 172.21.15.59:0/3925887780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce81a1e00 con 0x7f7ce8109a70 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7ce77fe640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce80761a0 0x7f7ce819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.461+0000 7f7cec916640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 0x7f7ce81a1790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0003ba0 tx=0x7f7ce0003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.462+0000 7f7ce57fa640 1 -- 172.21.15.59:0/3925887780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0004040 con 0x7f7ce8109a70 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.462+0000 7f7ce57fa640 1 -- 172.21.15.59:0/3925887780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ce00046c0 con 0x7f7ce8109a70 2024-09-10T11:01:03.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.462+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce81a2090 con 0x7f7ce8109a70 2024-09-10T11:01:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.462+0000 7f7ce57fa640 1 -- 172.21.15.59:0/3925887780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce002fda0 con 0x7f7ce8109a70 2024-09-10T11:01:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.462+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce81a2650 con 0x7f7ce8109a70 2024-09-10T11:01:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.463+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce8108880 con 0x7f7ce8109a70 2024-09-10T11:01:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.464+0000 7f7ce57fa640 1 -- 172.21.15.59:0/3925887780 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7ce00041e0 con 0x7f7ce8109a70 2024-09-10T11:01:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.465+0000 7f7ce57fa640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7cd00a2c40 0x7f7cd00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.465+0000 7f7ce7fff640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7cd00a2c40 0x7f7cd00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.465+0000 7f7ce57fa640 1 -- 172.21.15.59:0/3925887780 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f7ce00f08e0 con 0x7f7ce8109a70 2024-09-10T11:01:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.465+0000 7f7ce7fff640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7cd00a2c40 0x7f7cd00a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009990 tx=0x7f7cd8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:03.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.469+0000 7f7ce57fa640 1 -- 172.21.15.59:0/3925887780 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ce00bd750 con 0x7f7ce8109a70 2024-09-10T11:01:03.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.683+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7ce802d7c0 con 0x7f7ce8109a70 2024-09-10T11:01:03.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.683+0000 7f7ce57fa640 1 -- 172.21.15.59:0/3925887780 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3086 (secure 0 0 0) 0x7f7ce00bd050 con 0x7f7ce8109a70 2024-09-10T11:01:03.685 INFO:teuthology.orchestra.run.smithi059.stdout:e24 2024-09-10T11:01:03.685 INFO:teuthology.orchestra.run.smithi059.stdout:btime 2024-09-10T10:59:43:166834+0000 2024-09-10T11:01:03.685 INFO:teuthology.orchestra.run.smithi059.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T11:01:03.685 INFO:teuthology.orchestra.run.smithi059.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T11:01:03.685 INFO:teuthology.orchestra.run.smithi059.stdout:legacy client fscid: 1 2024-09-10T11:01:03.685 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:Filesystem 'cephfs' (1) 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:fs_name cephfs 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 24 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-09-10T10:59:31.833573+0000 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:modified 2024-09-10T10:59:42.866432+0000 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:tableserver 0 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:root 0 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:session_timeout 300 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:session_autoclose 300 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:max_file_size 1099511627776 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:max_xattr_size 65536 2024-09-10T11:01:03.686 INFO:teuthology.orchestra.run.smithi059.stdout:required_client_features {} 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:last_failure 0 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:last_failure_osd_epoch 0 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:max_mds 3 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:in 0,1,2 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:up {0=24497,1=24470,2=24466} 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:failed 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:damaged 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:stopped 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:data_pools [3] 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:metadata_pool 2 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:inline_data disabled 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:balancer 2024-09-10T11:01:03.687 INFO:teuthology.orchestra.run.smithi059.stdout:bal_rank_mask -1 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:standby_count_wanted 0 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:qdb_cluster leader: 24497 members: 24466,24470,24497 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b{0:24497} state up:active seq 4 addr [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c{0:24451} state up:standby-replay seq 1 addr [v2:172.21.15.181:6836/4124427529,v1:172.21.15.181:6837/4124427529] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.h{1:24470} state up:active seq 9 addr [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.e{1:24446} state up:standby-replay seq 1 addr [v2:172.21.15.115:6834/3263764144,v1:172.21.15.115:6835/3263764144] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.i{2:24466} state up:active seq 9 addr [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.f{2:24445} state up:standby-replay seq 1 addr [v2:172.21.15.181:6834/3551536786,v1:172.21.15.181:6835/3551536786] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:Standby daemons: 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.59:6834/2132184928,v1:172.21.15.59:6835/2132184928] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.688 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.59:6836/138342907,v1:172.21.15.59:6837/138342907] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.689 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.g{-1:14592} state up:standby seq 1 addr [v2:172.21.15.59:6838/1687951839,v1:172.21.15.59:6839/1687951839] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.689 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a{-1:14598} state up:standby seq 1 addr [v2:172.21.15.59:6840/2789106247,v1:172.21.15.59:6841/2789106247] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.689 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.l{-1:24415} state up:standby seq 1 addr [v2:172.21.15.181:6832/2390302822,v1:172.21.15.181:6833/2390302822] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.689 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.k{-1:24428} state up:standby seq 1 addr [v2:172.21.15.115:6832/293569527,v1:172.21.15.115:6833/293569527] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 24 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7cd00a2c40 msgr2=0x7f7cd00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7cd00a2c40 0x7f7cd00a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009990 tx=0x7f7cd8009110 comp rx=0 tx=0).stop 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 msgr2=0x7f7ce81a1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 0x7f7ce81a1790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0003ba0 tx=0x7f7ce0003bd0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 shutdown_connections 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f7cd00a2c40 0x7f7cd00a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ce8109a70 0x7f7ce81a1790 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ce80761a0 0x7f7ce819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 --2- 172.21.15.59:0/3925887780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ce8074b40 0x7f7ce819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:03.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 >> 172.21.15.59:0/3925887780 conn(0x7f7ce80fd390 msgr2=0x7f7ce8105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 shutdown_connections 2024-09-10T11:01:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:03.685+0000 7f7cee379640 1 -- 172.21.15.59:0/3925887780 wait complete. 2024-09-10T11:01:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:03 smithi115 ceph-mon[34719]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:03 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3925887780' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T11:01:04.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:03 smithi059 ceph-mon[30978]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:04.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:03 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3925887780' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T11:01:04.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:03 smithi181 ceph-mon[35409]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:04.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:03 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3925887780' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T11:01:04.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T11:01:04.773 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:05.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.259+0000 7f80f90fe640 1 -- 172.21.15.59:0/2573491962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4107900 msgr2=0x7f80f4109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:05.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.259+0000 7f80f90fe640 1 --2- 172.21.15.59:0/2573491962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4107900 0x7f80f4109d50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009ca0 tx=0x7f80ec02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.259+0000 7f80f90fe640 1 -- 172.21.15.59:0/2573491962 shutdown_connections 2024-09-10T11:01:05.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.259+0000 7f80f90fe640 1 --2- 172.21.15.59:0/2573491962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4107900 0x7f80f4109d50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.259+0000 7f80f90fe640 1 --2- 172.21.15.59:0/2573491962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f4104fd0 0x7f80f41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.259+0000 7f80f90fe640 1 --2- 172.21.15.59:0/2573491962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80f41026a0 0x7f80f4104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.259+0000 7f80f90fe640 1 -- 172.21.15.59:0/2573491962 >> 172.21.15.59:0/2573491962 conn(0x7f80f40fc2a0 msgr2=0x7f80f40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:05.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.259+0000 7f80f90fe640 1 -- 172.21.15.59:0/2573491962 shutdown_connections 2024-09-10T11:01:05.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.259+0000 7f80f90fe640 1 -- 172.21.15.59:0/2573491962 wait complete. 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.260+0000 7f80f90fe640 1 Processor -- start 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.260+0000 7f80f90fe640 1 -- start start 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f90fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f41026a0 0x7f80f4198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f90fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4104fd0 0x7f80f4198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f90fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80f4107900 0x7f80f419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f90fe640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80f410d990 con 0x7f80f4104fd0 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f90fe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f80f410d810 con 0x7f80f41026a0 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f90fe640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f80f410db10 con 0x7f80f4107900 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4104fd0 0x7f80f4198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4104fd0 0x7f80f4198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39914/0 (socket says 172.21.15.59:39914) 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f259c640 1 -- 172.21.15.59:0/3296094701 learned_addr learned my addr 172.21.15.59:0/3296094701 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f2d9d640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f41026a0 0x7f80f4198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:05.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f359e640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80f4107900 0x7f80f419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f259c640 1 -- 172.21.15.59:0/3296094701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80f4107900 msgr2=0x7f80f419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f259c640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80f4107900 0x7f80f419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f259c640 1 -- 172.21.15.59:0/3296094701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f41026a0 msgr2=0x7f80f4198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f259c640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f41026a0 0x7f80f4198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f259c640 1 -- 172.21.15.59:0/3296094701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f419fc70 con 0x7f80f4104fd0 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f2d9d640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f41026a0 0x7f80f4198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f259c640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4104fd0 0x7f80f4198580 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f80e800b450 tx=0x7f80e800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80dbfff640 1 -- 172.21.15.59:0/3296094701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8015020 con 0x7f80f4104fd0 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f419ff60 con 0x7f80f4104fd0 2024-09-10T11:01:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80dbfff640 1 -- 172.21.15.59:0/3296094701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80e8011d70 con 0x7f80f4104fd0 2024-09-10T11:01:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.261+0000 7f80dbfff640 1 -- 172.21.15.59:0/3296094701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e800f340 con 0x7f80f4104fd0 2024-09-10T11:01:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.262+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f41a0490 con 0x7f80f4104fd0 2024-09-10T11:01:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.263+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f40fdd90 con 0x7f80f4104fd0 2024-09-10T11:01:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.264+0000 7f80dbfff640 1 -- 172.21.15.59:0/3296094701 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f80e8018020 con 0x7f80f4104fd0 2024-09-10T11:01:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.265+0000 7f80dbfff640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f80dc0a2c40 0x7f80dc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.265+0000 7f80f2d9d640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f80dc0a2c40 0x7f80dc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.265+0000 7f80dbfff640 1 -- 172.21.15.59:0/3296094701 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f80e80cf0e0 con 0x7f80f4104fd0 2024-09-10T11:01:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.265+0000 7f80f2d9d640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f80dc0a2c40 0x7f80dc0a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009930 tx=0x7f80e4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:05.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.268+0000 7f80dbfff640 1 -- 172.21.15.59:0/3296094701 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80e801f020 con 0x7f80f4104fd0 2024-09-10T11:01:05.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.446+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f80f402d9c0 con 0x7f80f4104fd0 2024-09-10T11:01:05.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.447+0000 7f80dbfff640 1 -- 172.21.15.59:0/3296094701 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) ==== 56+0+5352 (secure 0 0 0) 0x7f80e800d040 con 0x7f80f4104fd0 2024-09-10T11:01:05.449 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 85 2024-09-10T11:01:05.449 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T11:01:05.449 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-09-10T10:51:53.731664+0000 2024-09-10T11:01:05.449 INFO:teuthology.orchestra.run.smithi059.stdout:modified 2024-09-10T11:00:40.888492+0000 2024-09-10T11:01:05.449 INFO:teuthology.orchestra.run.smithi059.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T11:01:05.449 INFO:teuthology.orchestra.run.smithi059.stdout:crush_version 26 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:full_ratio 0.95 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:backfillfull_ratio 0.9 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:nearfull_ratio 0.85 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:require_min_compat_client luminous 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:min_compat_client luminous 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:require_osd_release squid 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:stretch_mode_enabled false 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T11:01:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T11:01:05.451 INFO:teuthology.orchestra.run.smithi059.stdout:max_osd 12 2024-09-10T11:01:05.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0 up in weight 1 up_from 8 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6802/1643826067,v1:172.21.15.59:6803/1643826067] [v2:172.21.15.59:6804/1643826067,v1:172.21.15.59:6805/1643826067] exists,up 17d70faa-a04c-428f-ae18-c14cdf3c0b59 2024-09-10T11:01:05.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1 up in weight 1 up_from 13 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6800/2214288825,v1:172.21.15.115:6801/2214288825] [v2:172.21.15.115:6802/2214288825,v1:172.21.15.115:6803/2214288825] exists,up 9c24fb3f-6b90-4376-8c91-898c13e55505 2024-09-10T11:01:05.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2 up in weight 1 up_from 18 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/1826637197,v1:172.21.15.181:6801/1826637197] [v2:172.21.15.181:6802/1826637197,v1:172.21.15.181:6803/1826637197] exists,up fedd246c-4643-4cd5-85be-47b00e3c5660 2024-09-10T11:01:05.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3 up in weight 1 up_from 24 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6810/1709553083,v1:172.21.15.59:6811/1709553083] [v2:172.21.15.59:6812/1709553083,v1:172.21.15.59:6813/1709553083] exists,up 22cc5420-33ee-4291-a301-5e6ff7511d91 2024-09-10T11:01:05.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4 up in weight 1 up_from 32 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6808/65991145,v1:172.21.15.115:6809/65991145] [v2:172.21.15.115:6810/65991145,v1:172.21.15.115:6811/65991145] exists,up c1a99b0b-8b83-41b7-b6f9-400eabf3ea39 2024-09-10T11:01:05.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5 up in weight 1 up_from 37 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6808/361358873,v1:172.21.15.181:6809/361358873] [v2:172.21.15.181:6810/361358873,v1:172.21.15.181:6811/361358873] exists,up 68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48 2024-09-10T11:01:05.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6 up in weight 1 up_from 44 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6818/1773461334,v1:172.21.15.59:6819/1773461334] [v2:172.21.15.59:6820/1773461334,v1:172.21.15.59:6821/1773461334] exists,up 39256edb-3181-4fa3-95c6-edecfc3b605c 2024-09-10T11:01:05.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7 up in weight 1 up_from 49 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6816/3436962956,v1:172.21.15.115:6817/3436962956] [v2:172.21.15.115:6818/3436962956,v1:172.21.15.115:6819/3436962956] exists,up 9149fe7e-5a85-4a89-b5f7-e8724e7a392b 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8 up in weight 1 up_from 56 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6816/2351101787,v1:172.21.15.181:6817/2351101787] [v2:172.21.15.181:6818/2351101787,v1:172.21.15.181:6819/2351101787] exists,up a4860b6b-96d8-4cae-9ee5-53b84fc6be7c 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6826/144353588,v1:172.21.15.59:6827/144353588] [v2:172.21.15.59:6828/144353588,v1:172.21.15.59:6829/144353588] exists,up a48ed7c2-30e4-479c-a001-2da89d462ccc 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10 up in weight 1 up_from 68 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6824/601478460,v1:172.21.15.115:6825/601478460] [v2:172.21.15.115:6826/601478460,v1:172.21.15.115:6827/601478460] exists,up 5553312e-2251-488e-b97a-1d203ecd2403 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11 up in weight 1 up_from 75 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6824/746086660,v1:172.21.15.181:6825/746086660] [v2:172.21.15.181:6826/746086660,v1:172.21.15.181:6827/746086660] exists,up c6a4c40e-8d21-4145-b284-efb8ba4e8fcc 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 2.b [8,11] 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 2.c [2,1] 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 2.16 [2,4] 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 2.1d [8,11] 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.1a [5,6] 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.21 [4,7] 2024-09-10T11:01:05.452 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.22 [3,9] 2024-09-10T11:01:05.453 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.28 [5,6] 2024-09-10T11:01:05.453 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.34 [4,9] 2024-09-10T11:01:05.453 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.3a [4,8] 2024-09-10T11:01:05.453 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.3c [4,9] 2024-09-10T11:01:05.453 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6801/3293737690 expires 2024-09-11T10:52:38.625589+0000 2024-09-10T11:01:05.453 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6800/3293737690 expires 2024-09-11T10:52:38.625589+0000 2024-09-10T11:01:05.453 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/4100202670 expires 2024-09-11T10:52:15.554183+0000 2024-09-10T11:01:05.454 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/2924034396 expires 2024-09-11T10:52:38.625589+0000 2024-09-10T11:01:05.454 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/3172621917 expires 2024-09-11T10:52:15.554183+0000 2024-09-10T11:01:05.454 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/3813830687 expires 2024-09-11T10:52:15.554183+0000 2024-09-10T11:01:05.454 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/3551787843 expires 2024-09-11T10:52:38.625589+0000 2024-09-10T11:01:05.454 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6801/3094540037 expires 2024-09-11T10:52:15.554183+0000 2024-09-10T11:01:05.454 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/1311671881 expires 2024-09-11T10:52:38.625589+0000 2024-09-10T11:01:05.454 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6800/3094540037 expires 2024-09-11T10:52:15.554183+0000 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f80dc0a2c40 msgr2=0x7f80dc0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f80dc0a2c40 0x7f80dc0a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009930 tx=0x7f80e4008040 comp rx=0 tx=0).stop 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4104fd0 msgr2=0x7f80f4198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4104fd0 0x7f80f4198580 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f80e800b450 tx=0x7f80e800b910 comp rx=0 tx=0).stop 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 shutdown_connections 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f80dc0a2c40 0x7f80dc0a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80f4107900 0x7f80f419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f4104fd0 0x7f80f4198580 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 --2- 172.21.15.59:0/3296094701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f41026a0 0x7f80f4198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:05.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.449+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 >> 172.21.15.59:0/3296094701 conn(0x7f80f40fc2a0 msgr2=0x7f80f4102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:05.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.450+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 shutdown_connections 2024-09-10T11:01:05.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:05.450+0000 7f80f90fe640 1 -- 172.21.15.59:0/3296094701 wait complete. 2024-09-10T11:01:06.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:05 smithi059 ceph-mon[30978]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:01:06.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:05 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3296094701' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T11:01:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:05 smithi115 ceph-mon[34719]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:01:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:05 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3296094701' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T11:01:06.262 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T11:01:06.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:01:06.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:05 smithi181 ceph-mon[35409]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:01:06.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:05 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3296094701' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T11:01:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:07.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.027+0000 7f3a54184640 1 -- 172.21.15.59:0/298980927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 msgr2=0x7f3a4c114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:07.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.027+0000 7f3a54184640 1 --2- 172.21.15.59:0/298980927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 0x7f3a4c114f80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3a44009ca0 tx=0x7f3a4402a950 comp rx=0 tx=0).stop 2024-09-10T11:01:07.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.027+0000 7f3a54184640 1 -- 172.21.15.59:0/298980927 shutdown_connections 2024-09-10T11:01:07.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.027+0000 7f3a54184640 1 --2- 172.21.15.59:0/298980927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 0x7f3a4c114f80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.027+0000 7f3a54184640 1 --2- 172.21.15.59:0/298980927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a4c074eb0 0x7f3a4c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.027+0000 7f3a54184640 1 --2- 172.21.15.59:0/298980927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a4c074590 0x7f3a4c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.027+0000 7f3a54184640 1 -- 172.21.15.59:0/298980927 >> 172.21.15.59:0/298980927 conn(0x7f3a4c0fd8c0 msgr2=0x7f3a4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.027+0000 7f3a54184640 1 -- 172.21.15.59:0/298980927 shutdown_connections 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.027+0000 7f3a54184640 1 -- 172.21.15.59:0/298980927 wait complete. 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a54184640 1 Processor -- start 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a54184640 1 -- start start 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a54184640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a4c074590 0x7f3a4c1a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a54184640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a4c074eb0 0x7f3a4c1a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a54184640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 0x7f3a4c19e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a54184640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c118550 con 0x7f3a4c112b90 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a54184640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c1183d0 con 0x7f3a4c074590 2024-09-10T11:01:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a54184640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c1186d0 con 0x7f3a4c074eb0 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a52721640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 0x7f3a4c19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a52721640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 0x7f3a4c19e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33102/0 (socket says 172.21.15.59:33102) 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.028+0000 7f3a52721640 1 -- 172.21.15.59:0/2405077510 learned_addr learned my addr 172.21.15.59:0/2405077510 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a51f20640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a4c074590 0x7f3a4c1a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a5171f640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a4c074eb0 0x7f3a4c1a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a52721640 1 -- 172.21.15.59:0/2405077510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a4c074eb0 msgr2=0x7f3a4c1a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a52721640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a4c074eb0 0x7f3a4c1a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a52721640 1 -- 172.21.15.59:0/2405077510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a4c074590 msgr2=0x7f3a4c1a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a52721640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a4c074590 0x7f3a4c1a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a52721640 1 -- 172.21.15.59:0/2405077510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4c19efa0 con 0x7f3a4c112b90 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a51f20640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a4c074590 0x7f3a4c1a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a5171f640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a4c074eb0 0x7f3a4c1a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:01:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a52721640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 0x7f3a4c19e800 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006010 tx=0x7f3a4402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a42ffd640 1 -- 172.21.15.59:0/2405077510 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44034040 con 0x7f3a4c112b90 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a42ffd640 1 -- 172.21.15.59:0/2405077510 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a44003e00 con 0x7f3a4c112b90 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4c19f230 con 0x7f3a4c112b90 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a42ffd640 1 -- 172.21.15.59:0/2405077510 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440456e0 con 0x7f3a4c112b90 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.029+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a4c1ab4e0 con 0x7f3a4c112b90 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.030+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a4c075cd0 con 0x7f3a4c112b90 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.031+0000 7f3a42ffd640 1 -- 172.21.15.59:0/2405077510 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3a44037020 con 0x7f3a4c112b90 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.032+0000 7f3a42ffd640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3a380a2c90 0x7f3a380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.032+0000 7f3a51f20640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3a380a2c90 0x7f3a380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.032+0000 7f3a42ffd640 1 -- 172.21.15.59:0/2405077510 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f3a440f02d0 con 0x7f3a4c112b90 2024-09-10T11:01:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.032+0000 7f3a51f20640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3a380a2c90 0x7f3a380a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800baa0 tx=0x7f3a48005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.036+0000 7f3a42ffd640 1 -- 172.21.15.59:0/2405077510 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a440bd1d0 con 0x7f3a4c112b90 2024-09-10T11:01:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.251+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a4c1ab6b0 con 0x7f3a4c112b90 2024-09-10T11:01:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.252+0000 7f3a42ffd640 1 -- 172.21.15.59:0/2405077510 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7f3a440bcad0 con 0x7f3a4c112b90 2024-09-10T11:01:07.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:01:07.254 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"btime":"2024-09-10T10:59:43:166834+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:59:31.833573+0000","modified":"2024-09-10T10:59:42.866432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24470,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/411505011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":411505011},{"type":"v1","addr":"172.21.15.115:6839","nonce":411505011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24466,24470,24497]},"id":1}]} 2024-09-10T11:01:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 24 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3a380a2c90 msgr2=0x7f3a380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3a380a2c90 0x7f3a380a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800baa0 tx=0x7f3a48005d90 comp rx=0 tx=0).stop 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 msgr2=0x7f3a4c19e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 0x7f3a4c19e800 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006010 tx=0x7f3a4402f710 comp rx=0 tx=0).stop 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 shutdown_connections 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3a380a2c90 0x7f3a380a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c112b90 0x7f3a4c19e800 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a4c074eb0 0x7f3a4c1a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 --2- 172.21.15.59:0/2405077510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a4c074590 0x7f3a4c1a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 >> 172.21.15.59:0/2405077510 conn(0x7f3a4c0fd8c0 msgr2=0x7f3a4c0fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:07.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 shutdown_connections 2024-09-10T11:01:07.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:07.255+0000 7f3a54184640 1 -- 172.21.15.59:0/2405077510 wait complete. 2024-09-10T11:01:07.972 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:01:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:07 smithi115 ceph-mon[34719]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:07 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2405077510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:01:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:08.357 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:07 smithi059 ceph-mon[30978]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:08.358 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:07 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2405077510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:01:08.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:07 smithi181 ceph-mon[35409]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:08.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:07 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2405077510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 -- 172.21.15.59:0/3144673760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4102790 msgr2=0x7fc6d41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/3144673760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4102790 0x7fc6d41067e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009900 tx=0x7fc6c802a410 comp rx=0 tx=0).stop 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 -- 172.21.15.59:0/3144673760 shutdown_connections 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/3144673760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6d4106f10 0x7fc6d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/3144673760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4102790 0x7fc6d41067e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/3144673760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6d4101de0 0x7fc6d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 -- 172.21.15.59:0/3144673760 >> 172.21.15.59:0/3144673760 conn(0x7fc6d40fd8e0 msgr2=0x7fc6d40ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 -- 172.21.15.59:0/3144673760 shutdown_connections 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 -- 172.21.15.59:0/3144673760 wait complete. 2024-09-10T11:01:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.789+0000 7fc6dbf18640 1 Processor -- start 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6dbf18640 1 -- start start 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6dbf18640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6d4101de0 0x7fc6d41986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6dbf18640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6d4102790 0x7fc6d4198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6dbf18640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4106f10 0x7fc6d419cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6dbf18640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4112010 con 0x7fc6d4106f10 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6dbf18640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4111e90 con 0x7fc6d4102790 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6dbf18640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4112190 con 0x7fc6d4101de0 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6da4b5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4106f10 0x7fc6d419cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6da4b5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4106f10 0x7fc6d419cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33112/0 (socket says 172.21.15.59:33112) 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6da4b5640 1 -- 172.21.15.59:0/2864376692 learned_addr learned my addr 172.21.15.59:0/2864376692 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6d9cb4640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6d4101de0 0x7fc6d41986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6d94b3640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6d4102790 0x7fc6d4198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6da4b5640 1 -- 172.21.15.59:0/2864376692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6d4101de0 msgr2=0x7fc6d41986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6da4b5640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6d4101de0 0x7fc6d41986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6da4b5640 1 -- 172.21.15.59:0/2864376692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6d4102790 msgr2=0x7fc6d4198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6da4b5640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6d4102790 0x7fc6d4198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6da4b5640 1 -- 172.21.15.59:0/2864376692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d419d6a0 con 0x7fc6d4106f10 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.790+0000 7fc6da4b5640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4106f10 0x7fc6d419cfc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00b970 tx=0x7fc6cc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.791+0000 7fc6c6ffd640 1 -- 172.21.15.59:0/2864376692 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc019070 con 0x7fc6d4106f10 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.791+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d419d990 con 0x7fc6d4106f10 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.791+0000 7fc6c6ffd640 1 -- 172.21.15.59:0/2864376692 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6cc014440 con 0x7fc6d4106f10 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.791+0000 7fc6c6ffd640 1 -- 172.21.15.59:0/2864376692 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc0075d0 con 0x7fc6d4106f10 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.791+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d41a5270 con 0x7fc6d4106f10 2024-09-10T11:01:08.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.792+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d4102240 con 0x7fc6d4106f10 2024-09-10T11:01:08.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.793+0000 7fc6c6ffd640 1 -- 172.21.15.59:0/2864376692 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc6cc01c070 con 0x7fc6d4106f10 2024-09-10T11:01:08.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.793+0000 7fc6c6ffd640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc6c00a2c10 0x7fc6c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:08.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.794+0000 7fc6d9cb4640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc6c00a2c10 0x7fc6c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:08.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.794+0000 7fc6c6ffd640 1 -- 172.21.15.59:0/2864376692 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7fc6cc0ceaa0 con 0x7fc6d4106f10 2024-09-10T11:01:08.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.794+0000 7fc6d9cb4640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc6c00a2c10 0x7fc6c00a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009990 tx=0x7fc6d0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:08.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.797+0000 7fc6c6ffd640 1 -- 172.21.15.59:0/2864376692 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6cc09b320 con 0x7fc6d4106f10 2024-09-10T11:01:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:08.966+0000 7fc6c6ffd640 1 -- 172.21.15.59:0/2864376692 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc6cc097990 con 0x7fc6d4106f10 2024-09-10T11:01:09.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.017+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6d410a0f0 con 0x7fc6d4106f10 2024-09-10T11:01:09.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.018+0000 7fc6c6ffd640 1 -- 172.21.15.59:0/2864376692 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7fc6cc0c8d80 con 0x7fc6d4106f10 2024-09-10T11:01:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:01:09.020 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"btime":"2024-09-10T10:59:43:166834+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:59:31.833573+0000","modified":"2024-09-10T10:59:42.866432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24470,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/4124427529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":4124427529},{"type":"v1","addr":"172.21.15.181:6837","nonce":4124427529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/411505011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":411505011},{"type":"v1","addr":"172.21.15.115:6839","nonce":411505011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24466,24470,24497]},"id":1}]} 2024-09-10T11:01:09.020 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 24 2024-09-10T11:01:09.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc6c00a2c10 msgr2=0x7fc6c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:09.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc6c00a2c10 0x7fc6c00a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009990 tx=0x7fc6d0009110 comp rx=0 tx=0).stop 2024-09-10T11:01:09.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4106f10 msgr2=0x7fc6d419cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:09.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4106f10 0x7fc6d419cfc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00b970 tx=0x7fc6cc00bd70 comp rx=0 tx=0).stop 2024-09-10T11:01:09.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 shutdown_connections 2024-09-10T11:01:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7fc6c00a2c10 0x7fc6c00a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4106f10 0x7fc6d419cfc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6d4102790 0x7fc6d4198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 --2- 172.21.15.59:0/2864376692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6d4101de0 0x7fc6d41986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 >> 172.21.15.59:0/2864376692 conn(0x7fc6d40fd8e0 msgr2=0x7fc6d40fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 shutdown_connections 2024-09-10T11:01:09.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:09.020+0000 7fc6dbf18640 1 -- 172.21.15.59:0/2864376692 wait complete. 2024-09-10T11:01:09.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:01:10.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:09 smithi059 ceph-mon[30978]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:01:10.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:09 smithi059 ceph-mon[30978]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T11:01:10.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:09 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2864376692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:01:10.145 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:10.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:09 smithi181 ceph-mon[35409]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:01:10.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:09 smithi181 ceph-mon[35409]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T11:01:10.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:09 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2864376692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:01:10.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:09 smithi115 ceph-mon[34719]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T11:01:10.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:09 smithi115 ceph-mon[34719]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T11:01:10.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:09 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2864376692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:01:10.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.638+0000 7f8477164640 1 -- 172.21.15.59:0/3136741833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470100a80 msgr2=0x7f8470100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:10.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.638+0000 7f8477164640 1 --2- 172.21.15.59:0/3136741833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470100a80 0x7f8470100ee0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8458009930 tx=0x7f845802a420 comp rx=0 tx=0).stop 2024-09-10T11:01:10.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.638+0000 7f8477164640 1 -- 172.21.15.59:0/3136741833 shutdown_connections 2024-09-10T11:01:10.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.638+0000 7f8477164640 1 --2- 172.21.15.59:0/3136741833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8470101420 0x7f847010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.638+0000 7f8477164640 1 --2- 172.21.15.59:0/3136741833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470100a80 0x7f8470100ee0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.638+0000 7f8477164640 1 --2- 172.21.15.59:0/3136741833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8470106a80 0x7f8470106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.638+0000 7f8477164640 1 -- 172.21.15.59:0/3136741833 >> 172.21.15.59:0/3136741833 conn(0x7f84700fc7a0 msgr2=0x7f84700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.638+0000 7f8477164640 1 -- 172.21.15.59:0/3136741833 shutdown_connections 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.638+0000 7f8477164640 1 -- 172.21.15.59:0/3136741833 wait complete. 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8477164640 1 Processor -- start 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8477164640 1 -- start start 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8477164640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8470100a80 0x7f8470198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8477164640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470101420 0x7f84701988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8477164640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8470106a80 0x7f847019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8477164640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8470111fa0 con 0x7f8470101420 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8477164640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8470111e20 con 0x7f8470100a80 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8477164640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8470112120 con 0x7f8470106a80 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f846ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470101420 0x7f84701988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f846ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470101420 0x7f84701988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33122/0 (socket says 172.21.15.59:33122) 2024-09-10T11:01:10.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f846ffff640 1 -- 172.21.15.59:0/69845352 learned_addr learned my addr 172.21.15.59:0/69845352 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8474f00640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8470100a80 0x7f8470198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f8475701640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8470106a80 0x7f847019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f846ffff640 1 -- 172.21.15.59:0/69845352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8470106a80 msgr2=0x7f847019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.639+0000 7f846ffff640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8470106a80 0x7f847019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f846ffff640 1 -- 172.21.15.59:0/69845352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8470100a80 msgr2=0x7f8470198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f846ffff640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8470100a80 0x7f8470198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f846ffff640 1 -- 172.21.15.59:0/69845352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847019d330 con 0x7f8470101420 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f8475701640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8470106a80 0x7f847019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f8474f00640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8470100a80 0x7f8470198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f846ffff640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470101420 0x7f84701988c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8458009a50 tx=0x7f8458004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f846dffb640 1 -- 172.21.15.59:0/69845352 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845803f030 con 0x7f8470101420 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f846dffb640 1 -- 172.21.15.59:0/69845352 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8458003ce0 con 0x7f8470101420 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847019d5c0 con 0x7f8470101420 2024-09-10T11:01:10.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f846dffb640 1 -- 172.21.15.59:0/69845352 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458035070 con 0x7f8470101420 2024-09-10T11:01:10.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.640+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84701a4f00 con 0x7f8470101420 2024-09-10T11:01:10.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.641+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84701021c0 con 0x7f8470101420 2024-09-10T11:01:10.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.642+0000 7f846dffb640 1 -- 172.21.15.59:0/69845352 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8458042030 con 0x7f8470101420 2024-09-10T11:01:10.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.643+0000 7f846dffb640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f845c0a2c00 0x7f845c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:10.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.643+0000 7f8474f00640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f845c0a2c00 0x7f845c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:10.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.643+0000 7f846dffb640 1 -- 172.21.15.59:0/69845352 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f84580ef6b0 con 0x7f8470101420 2024-09-10T11:01:10.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.644+0000 7f8474f00640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f845c0a2c00 0x7f845c0a50c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8460005e10 tx=0x7f8460005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:10.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.647+0000 7f846dffb640 1 -- 172.21.15.59:0/69845352 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84580bc570 con 0x7f8470101420 2024-09-10T11:01:10.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.825+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84701a5160 con 0x7f8470101420 2024-09-10T11:01:10.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.826+0000 7f846dffb640 1 -- 172.21.15.59:0/69845352 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22832 (secure 0 0 0) 0x7f84580bbe70 con 0x7f8470101420 2024-09-10T11:01:10.828 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:01:10.828 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":85,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T11:00:40.888492+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:59:27.480743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:59:30.088912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:01:10.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.828+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f845c0a2c00 msgr2=0x7f845c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:10.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.828+0000 7f8477164640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f845c0a2c00 0x7f845c0a50c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8460005e10 tx=0x7f8460005da0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.828+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470101420 msgr2=0x7f84701988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.828+0000 7f8477164640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470101420 0x7f84701988c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8458009a50 tx=0x7f8458004270 comp rx=0 tx=0).stop 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.829+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 shutdown_connections 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.829+0000 7f8477164640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f845c0a2c00 0x7f845c0a50c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.829+0000 7f8477164640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8470106a80 0x7f847019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.829+0000 7f8477164640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470101420 0x7f84701988c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.829+0000 7f8477164640 1 --2- 172.21.15.59:0/69845352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8470100a80 0x7f8470198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.829+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 >> 172.21.15.59:0/69845352 conn(0x7f84700fc7a0 msgr2=0x7f84700fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.829+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 shutdown_connections 2024-09-10T11:01:10.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:10.829+0000 7f8477164640 1 -- 172.21.15.59:0/69845352 wait complete. 2024-09-10T11:01:11.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:10 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/69845352' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:01:11.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:10 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/69845352' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:01:11.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:10 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/69845352' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:01:11.542 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T10:59:31.833573+0000', 'modified': '2024-09-10T10:59:42.866432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24497, 'mds_1': 24470, 'mds_2': 24466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/3551536786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 3551536786}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 3551536786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.115:6835/3263764144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3263764144}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3263764144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6837/4124427529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 4124427529}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 4124427529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.181:6839/262209213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 262209213}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 262209213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.115:6837/417494518', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 417494518}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 417494518}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.115:6839/411505011', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 411505011}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 411505011}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24466, 24470, 24497]} 2024-09-10T11:01:11.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T11:01:11.543 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T11:01:11.804 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:12.231 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:11 smithi059 ceph-mon[30978]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:12.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 -- 172.21.15.59:0/3361718580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 msgr2=0x7f427010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:12.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 --2- 172.21.15.59:0/3361718580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 0x7f427010e610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4268009ca0 tx=0x7f426802a950 comp rx=0 tx=0).stop 2024-09-10T11:01:12.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 -- 172.21.15.59:0/3361718580 shutdown_connections 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 --2- 172.21.15.59:0/3361718580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 0x7f427010e610 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 --2- 172.21.15.59:0/3361718580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270103660 0x7f427010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 --2- 172.21.15.59:0/3361718580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4270102d40 0x7f4270103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 -- 172.21.15.59:0/3361718580 >> 172.21.15.59:0/3361718580 conn(0x7f42700fc7a0 msgr2=0x7f42700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 -- 172.21.15.59:0/3361718580 shutdown_connections 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 -- 172.21.15.59:0/3361718580 wait complete. 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 Processor -- start 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.312+0000 7f427709a640 1 -- start start 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f427709a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270102d40 0x7f42701983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f427709a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4270103660 0x7f4270198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f427709a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 0x7f427019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f427709a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4270111fb0 con 0x7f427010c170 2024-09-10T11:01:12.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f427709a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4270111e30 con 0x7f4270102d40 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f427709a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4270112130 con 0x7f4270103660 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4275637640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 0x7f427019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4275637640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 0x7f427019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33140/0 (socket says 172.21.15.59:33140) 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4275637640 1 -- 172.21.15.59:0/507445353 learned_addr learned my addr 172.21.15.59:0/507445353 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4274e36640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270102d40 0x7f42701983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4275637640 1 -- 172.21.15.59:0/507445353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4270103660 msgr2=0x7f4270198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4275637640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4270103660 0x7f4270198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4275637640 1 -- 172.21.15.59:0/507445353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270102d40 msgr2=0x7f42701983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4275637640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270102d40 0x7f42701983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4275637640 1 -- 172.21.15.59:0/507445353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427019d3a0 con 0x7f427010c170 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4274e36640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270102d40 0x7f42701983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f4275637640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 0x7f427019ccc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4268006010 tx=0x7f426802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f426dffb640 1 -- 172.21.15.59:0/507445353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268034040 con 0x7f427010c170 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f426dffb640 1 -- 172.21.15.59:0/507445353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4268003e00 con 0x7f427010c170 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f427709a640 1 -- 172.21.15.59:0/507445353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427019d630 con 0x7f427010c170 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.313+0000 7f426dffb640 1 -- 172.21.15.59:0/507445353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42680456e0 con 0x7f427010c170 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.314+0000 7f427709a640 1 -- 172.21.15.59:0/507445353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42701a4f70 con 0x7f427010c170 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.316+0000 7f426dffb640 1 -- 172.21.15.59:0/507445353 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4268037020 con 0x7f427010c170 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.316+0000 7f4279473740 1 Processor -- start 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.316+0000 7f4279473740 1 -- start start 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4279473740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 0x55f18879fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4279473740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887aa670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4279473740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4279473740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f188706090 con 0x55f1887aabb0 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4279473740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f1886ada70 con 0x55f1887a02f0 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4279473740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f188702050 con 0x55f18879f9d0 2024-09-10T11:01:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426dffb640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f42580a2b80 0x7f42580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33148/0 (socket says 172.21.15.59:33148) 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 -- 172.21.15.59:0/1310342977 learned_addr learned my addr 172.21.15.59:0/1310342977 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4275637640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f42580a2b80 0x7f42580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 0x55f18879fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4274e36640 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426dffb640 1 -- 172.21.15.59:0/507445353 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f42680f0250 con 0x7f427010c170 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 -- 172.21.15.59:0/1310342977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 msgr2=0x55f18879fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 0x55f18879fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 -- 172.21.15.59:0/1310342977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 msgr2=0x55f1887aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 -- 172.21.15.59:0/1310342977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1886ba130 con 0x55f1887aabb0 2024-09-10T11:01:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4274e36640 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f4275637640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f42580a2b80 0x7f42580a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f42680b93e0 tx=0x7f426808fad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.317+0000 7f426ffff640 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887acfa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f42640137a0 tx=0x7f426400c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6842d9c0d8c22655 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4256ffd640 1 -- 172.21.15.59:0/1310342977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264013220 con 0x55f1887aabb0 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4256ffd640 1 -- 172.21.15.59:0/1310342977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4264009b20 con 0x55f1887aabb0 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4256ffd640 1 -- 172.21.15.59:0/1310342977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264010bd0 con 0x55f1887aabb0 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4279473740 1 -- 172.21.15.59:0/1310342977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 msgr2=0x55f1887acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4279473740 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887acfa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f42640137a0 tx=0x7f426400c350 comp rx=0 tx=0).stop 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4279473740 1 -- 172.21.15.59:0/1310342977 shutdown_connections 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4279473740 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887acfa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4279473740 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4279473740 1 --2- 172.21.15.59:0/1310342977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 0x55f18879fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4279473740 1 -- 172.21.15.59:0/1310342977 >> 172.21.15.59:0/1310342977 conn(0x55f18879bf60 msgr2=0x55f18879c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4279473740 1 -- 172.21.15.59:0/1310342977 shutdown_connections 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.318+0000 7f4279473740 1 -- 172.21.15.59:0/1310342977 wait complete. 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f4279473740 1 -- start start 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f4279473740 1 Processor -- start 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f4279473740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 0x55f1887aa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f4279473740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f4279473740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f4279473740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f1887ad780 con 0x55f1887aabb0 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f4279473740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f1886c0f20 con 0x55f1887a02f0 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f4279473740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f1887ad900 con 0x55f18879f9d0 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f4279473740 10 client.0 _ll_register_callbacks cb 0x55f18868a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f426ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f426ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887a7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33164/0 (socket says 172.21.15.59:33164) 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.319+0000 7f426ffff640 1 -- 172.21.15.59:0/2121722831 learned_addr learned my addr 172.21.15.59:0/2121722831 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f4274e36640 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f426ffff640 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 0x55f1887aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f426ffff640 1 -- 172.21.15.59:0/2121722831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 msgr2=0x55f1887aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f426ffff640 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 0x55f1887aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f426ffff640 1 -- 172.21.15.59:0/2121722831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 msgr2=0x55f1887a77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f426ffff640 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887a77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f426ffff640 1 -- 172.21.15.59:0/2121722831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1884772b0 con 0x55f1887aabb0 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f426ffff640 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887a7ce0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4264001eb0 tx=0x7f4264010870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e710634aad8f922f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f424ffff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f424ffff640 1 -- 172.21.15.59:0/2121722831 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264004020 con 0x55f1887aabb0 2024-09-10T11:01:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f424ffff640 1 -- 172.21.15.59:0/2121722831 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f42640041c0 con 0x55f1887aabb0 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f4279473740 1 -- 172.21.15.59:0/2121722831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4264009b20 con 0x55f1887aabb0 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f424ffff640 1 -- 172.21.15.59:0/2121722831 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f42640043c0 con 0x55f1887aabb0 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f4279473740 10 client.15066 fetch_fsmap learned FSMap version 24 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f4279473740 1 -- 172.21.15.59:0/2121722831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f1887b90a0 con 0x55f1887aabb0 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.320+0000 7f424ffff640 1 -- 172.21.15.59:0/2121722831 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4264009b20 con 0x55f1887aabb0 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f424ffff640 1 -- 172.21.15.59:0/2121722831 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f426400c030 con 0x55f1887aabb0 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f4279473740 10 client.15066 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f4279473740 10 client.15066 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f4279473740 20 client.15066 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f4279473740 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1887bb250 0x55f1887bc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f4279473740 4 client.15066 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:01:12.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f4279473740 1 -- 172.21.15.59:0/2121722831 --> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f188713600 con 0x55f1887bb250 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f4274e36640 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1887bb250 0x55f1887bc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f424ffff640 10 client.15066 ms_handle_connect on v2:172.21.15.181:6838/262209213 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.321+0000 7f4274e36640 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1887bb250 0x55f1887bc6c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=980bf4229164a0fa server_cookie=2863032dd73fe060 in_seq=0 out_seq=0 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f424ffff640 1 -- 172.21.15.59:0/2121722831 <== mds.2 v2:172.21.15.181:6838/262209213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f188713600 con 0x55f1887bb250 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f424ffff640 10 client.15066 handle_command_reply: tid=0 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f4279473740 1 client.15066 shutdown 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f4279473740 1 -- 172.21.15.59:0/2121722831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 msgr2=0x55f1887a7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f4279473740 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887a7ce0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4264001eb0 tx=0x7f4264010870 comp rx=0 tx=0).stop 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f4279473740 1 -- 172.21.15.59:0/2121722831 shutdown_connections 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f4279473740 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f1887bb250 0x55f1887bc6c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f4279473740 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887aabb0 0x55f1887a7ce0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f4279473740 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887a77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f424ffff640 0 client.15066 ms_handle_reset on v2:172.21.15.181:6838/262209213 2024-09-10T11:01:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f4279473740 1 --2- 172.21.15.59:0/2121722831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f18879f9d0 0x55f1887aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.322+0000 7f4279473740 1 -- 172.21.15.59:0/2121722831 >> 172.21.15.59:0/2121722831 conn(0x55f18879bf60 msgr2=0x55f1887a1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.323+0000 7f4279473740 1 -- 172.21.15.59:0/2121722831 shutdown_connections 2024-09-10T11:01:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.323+0000 7f4279473740 1 -- 172.21.15.59:0/2121722831 wait complete. 2024-09-10T11:01:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.323+0000 7f4279473740 20 client.15066 trim_cache size 0 max 16384 2024-09-10T11:01:12.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.340+0000 7f4279473740 1 Processor -- start 2024-09-10T11:01:12.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4279473740 1 -- start start 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4279473740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f18879f9d0 0x55f1887bab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4279473740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887a02f0 0x55f1887a7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4279473740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 0x55f1887c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4279473740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f1887baa00 con 0x55f1887a02f0 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4279473740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f1887bb0d0 con 0x55f18879f9d0 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4279473740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f1887bb7a0 con 0x55f1887aabb0 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4274e36640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887a02f0 0x55f1887a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4274e36640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887a02f0 0x55f1887a7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33172/0 (socket says 172.21.15.59:33172) 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4274e36640 1 -- 172.21.15.59:0/3801604007 learned_addr learned my addr 172.21.15.59:0/3801604007 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f426ffff640 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 0x55f1887c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f426ffff640 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f18879f9d0 0x55f1887bab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4274e36640 1 -- 172.21.15.59:0/3801604007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 msgr2=0x55f1887c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4274e36640 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 0x55f1887c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4274e36640 1 -- 172.21.15.59:0/3801604007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f18879f9d0 msgr2=0x55f1887bab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4274e36640 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f18879f9d0 0x55f1887bab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4274e36640 1 -- 172.21.15.59:0/3801604007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1887a0120 con 0x55f1887a02f0 2024-09-10T11:01:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f426ffff640 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f18879f9d0 0x55f1887bab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:01:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.341+0000 7f4274e36640 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887a02f0 0x55f1887a7060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f426000c9e0 tx=0x7f4260008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96ddb8451190d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f42567fc640 1 -- 172.21.15.59:0/3801604007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600158d0 con 0x55f1887a02f0 2024-09-10T11:01:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f42567fc640 1 -- 172.21.15.59:0/3801604007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4260024430 con 0x55f1887a02f0 2024-09-10T11:01:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f42567fc640 1 -- 172.21.15.59:0/3801604007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426001b250 con 0x55f1887a02f0 2024-09-10T11:01:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f4279473740 1 -- 172.21.15.59:0/3801604007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887a02f0 msgr2=0x55f1887a7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f4279473740 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887a02f0 0x55f1887a7060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f426000c9e0 tx=0x7f4260008040 comp rx=0 tx=0).stop 2024-09-10T11:01:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f4279473740 1 -- 172.21.15.59:0/3801604007 shutdown_connections 2024-09-10T11:01:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f4279473740 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 0x55f1887c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f4279473740 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1887a02f0 0x55f1887a7060 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f4279473740 1 --2- 172.21.15.59:0/3801604007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f18879f9d0 0x55f1887bab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f4279473740 1 -- 172.21.15.59:0/3801604007 >> 172.21.15.59:0/3801604007 conn(0x55f18879bf60 msgr2=0x55f18879c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.342+0000 7f4279473740 1 -- 172.21.15.59:0/3801604007 shutdown_connections 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 1 -- 172.21.15.59:0/3801604007 wait complete. 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 1 -- start start 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 1 Processor -- start 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f18879f9d0 0x55f1887bea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887befa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 0x55f188821020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f1887bc540 con 0x55f18879f9d0 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f1887bbe70 con 0x55f1887a02f0 2024-09-10T11:01:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f1887bcc10 con 0x55f1887aabb0 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f4279473740 10 client.0 _ll_register_callbacks cb 0x7f426400cd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f426ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f18879f9d0 0x55f1887bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f426ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f18879f9d0 0x55f1887bea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33180/0 (socket says 172.21.15.59:33180) 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.343+0000 7f426ffff640 1 -- 172.21.15.59:0/1073528121 learned_addr learned my addr 172.21.15.59:0/1073528121 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f4274e36640 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f426ffff640 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 0x55f188821020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f426ffff640 1 -- 172.21.15.59:0/1073528121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 msgr2=0x55f188821020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f426ffff640 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 0x55f188821020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f426ffff640 1 -- 172.21.15.59:0/1073528121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 msgr2=0x55f1887befa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f426ffff640 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887befa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f426ffff640 1 -- 172.21.15.59:0/1073528121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1888216c0 con 0x55f18879f9d0 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f426ffff640 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f18879f9d0 0x55f1887bea60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4264004700 tx=0x7f42640107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd7abedd1534195 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f424ffff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f424ffff640 1 -- 172.21.15.59:0/1073528121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426402f040 con 0x55f18879f9d0 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f424ffff640 1 -- 172.21.15.59:0/1073528121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f4264009820 con 0x55f18879f9d0 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f4279473740 1 -- 172.21.15.59:0/1073528121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4260024430 con 0x55f18879f9d0 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f424ffff640 1 -- 172.21.15.59:0/1073528121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4264010600 con 0x55f18879f9d0 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f4279473740 10 client.15072 fetch_fsmap learned FSMap version 24 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.344+0000 7f4279473740 1 -- 172.21.15.59:0/1073528121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f188829bc0 con 0x55f18879f9d0 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.345+0000 7f424ffff640 1 -- 172.21.15.59:0/1073528121 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4260024430 con 0x55f18879f9d0 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.345+0000 7f424ffff640 1 -- 172.21.15.59:0/1073528121 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f426400c040 con 0x55f18879f9d0 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.345+0000 7f4279473740 10 client.15072 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.345+0000 7f4279473740 10 client.15072 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.345+0000 7f4279473740 20 client.15072 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.345+0000 7f4279473740 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f18882e790 0x55f18882d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.345+0000 7f4279473740 4 client.15072 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.345+0000 7f4279473740 1 -- 172.21.15.59:0/1073528121 --> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] -- command(tid 0: {"prefix": "status"}) -- 0x55f18870db10 con 0x55f18882e790 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.345+0000 7f4274e36640 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f18882e790 0x55f18882d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4274e36640 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f18882e790 0x55f18882d4a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a692b5bc396a7465 server_cookie=16d2a6e4e44bc642 in_seq=0 out_seq=0 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f424ffff640 10 client.15072 ms_handle_connect on v2:172.21.15.181:6838/262209213 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f424ffff640 1 -- 172.21.15.59:0/1073528121 <== mds.2 v2:172.21.15.181:6838/262209213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f18870db10 con 0x55f18882e790 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f424ffff640 10 client.15072 handle_command_reply: tid=0 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 client.15072 shutdown 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 -- 172.21.15.59:0/1073528121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f18879f9d0 msgr2=0x55f1887bea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f18879f9d0 0x55f1887bea60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4264004700 tx=0x7f42640107d0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 -- 172.21.15.59:0/1073528121 shutdown_connections 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.181:6838/262209213,v1:172.21.15.181:6839/262209213] conn(0x55f18882e790 0x55f18882d4a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f1887aabb0 0x55f188821020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1887a02f0 0x55f1887befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 --2- 172.21.15.59:0/1073528121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f18879f9d0 0x55f1887bea60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 -- 172.21.15.59:0/1073528121 >> 172.21.15.59:0/1073528121 conn(0x55f18879bf60 msgr2=0x55f18879a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f424ffff640 0 client.15072 ms_handle_reset on v2:172.21.15.181:6838/262209213 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 -- 172.21.15.59:0/1073528121 shutdown_connections 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 1 -- 172.21.15.59:0/1073528121 wait complete. 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.346+0000 7f4279473740 20 client.15072 trim_cache size 0 max 16384 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "86a09b02-6f62-11ef-bcea-c7b262605968", 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 2, 2024-09-10T11:01:12.354 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24466, 2024-09-10T11:01:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T11:01:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T11:01:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T11:01:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 91.187311785999995, 2024-09-10T11:01:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 24, 2024-09-10T11:01:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 85, 2024-09-10T11:01:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T11:01:12.355 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 120.423780982 2024-09-10T11:01:12.355 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 -- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f42580a2b80 msgr2=0x7f42580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f42580a2b80 0x7f42580a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f42680b93e0 tx=0x7f426808fad0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 -- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 msgr2=0x7f427019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 0x7f427019ccc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4268006010 tx=0x7f426802f710 comp rx=0 tx=0).stop 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 -- 172.21.15.59:0/507445353 shutdown_connections 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f42580a2b80 0x7f42580a5040 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f427010c170 0x7f427019ccc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4270103660 0x7f4270198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 --2- 172.21.15.59:0/507445353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270102d40 0x7f42701983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:12.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 -- 172.21.15.59:0/507445353 >> 172.21.15.59:0/507445353 conn(0x7f42700fc7a0 msgr2=0x7f42700fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:12.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 -- 172.21.15.59:0/507445353 shutdown_connections 2024-09-10T11:01:12.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:12.347+0000 7f427709a640 1 -- 172.21.15.59:0/507445353 wait complete. 2024-09-10T11:01:12.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:11 smithi181 ceph-mon[35409]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:12.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:11 smithi115 ceph-mon[34719]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:13.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T11:01:13.416 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.905+0000 7f3bc50bc640 1 -- 172.21.15.59:0/2464286291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 msgr2=0x7f3bc010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.905+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/2464286291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 0x7f3bc010e610 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009ca0 tx=0x7f3bb802a950 comp rx=0 tx=0).stop 2024-09-10T11:01:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.905+0000 7f3bc50bc640 1 -- 172.21.15.59:0/2464286291 shutdown_connections 2024-09-10T11:01:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.905+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/2464286291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 0x7f3bc010e610 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.905+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/2464286291 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bc0103700 0x7f3bc010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.905+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/2464286291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bc0102de0 0x7f3bc01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.905+0000 7f3bc50bc640 1 -- 172.21.15.59:0/2464286291 >> 172.21.15.59:0/2464286291 conn(0x7f3bc00fc7a0 msgr2=0x7f3bc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.905+0000 7f3bc50bc640 1 -- 172.21.15.59:0/2464286291 shutdown_connections 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.905+0000 7f3bc50bc640 1 -- 172.21.15.59:0/2464286291 wait complete. 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.906+0000 7f3bc50bc640 1 Processor -- start 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.906+0000 7f3bc50bc640 1 -- start start 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.906+0000 7f3bc50bc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bc0102de0 0x7f3bc0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.906+0000 7f3bc50bc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bc0103700 0x7f3bc0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.906+0000 7f3bc50bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 0x7f3bc019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.906+0000 7f3bc50bc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0111f70 con 0x7f3bc010c180 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.906+0000 7f3bc50bc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0111df0 con 0x7f3bc0103700 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.906+0000 7f3bc50bc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01120f0 con 0x7f3bc0102de0 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 0x7f3bc019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 0x7f3bc019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33208/0 (socket says 172.21.15.59:33208) 2024-09-10T11:01:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbf59e640 1 -- 172.21.15.59:0/721136156 learned_addr learned my addr 172.21.15.59:0/721136156 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbed9d640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bc0102de0 0x7f3bc0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bc0103700 0x7f3bc0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbf59e640 1 -- 172.21.15.59:0/721136156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bc0102de0 msgr2=0x7f3bc0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbf59e640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bc0102de0 0x7f3bc0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbf59e640 1 -- 172.21.15.59:0/721136156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bc0103700 msgr2=0x7f3bc0198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbf59e640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bc0103700 0x7f3bc0198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbf59e640 1 -- 172.21.15.59:0/721136156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc019d3c0 con 0x7f3bc010c180 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bc0103700 0x7f3bc0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bbf59e640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 0x7f3bc019cce0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8004af0 tx=0x7f3bb802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3ba7fff640 1 -- 172.21.15.59:0/721136156 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8034040 con 0x7f3bc010c180 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bc50bc640 1 -- 172.21.15.59:0/721136156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc019d650 con 0x7f3bc010c180 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3ba7fff640 1 -- 172.21.15.59:0/721136156 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bb8030920 con 0x7f3bc010c180 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3ba7fff640 1 -- 172.21.15.59:0/721136156 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80047b0 con 0x7f3bc010c180 2024-09-10T11:01:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.907+0000 7f3bc50bc640 1 -- 172.21.15.59:0/721136156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc01a4f90 con 0x7f3bc010c180 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.909+0000 7f3ba7fff640 1 -- 172.21.15.59:0/721136156 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3bb8037020 con 0x7f3bc010c180 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bc7495740 1 Processor -- start 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bc7495740 1 -- start start 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff4adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4b2f0 0x5579cff55670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3ba7fff640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ba80a2b80 0x7f3ba80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff55bb0 0x5579cff57fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bc7495740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5579cfeb1090 con 0x5579cff4a9d0 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bc7495740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5579cfe58a70 con 0x5579cff55bb0 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bc7495740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5579cfead050 con 0x5579cff4b2f0 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bbe59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff4adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bbe59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff4adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33220/0 (socket says 172.21.15.59:33220) 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bbe59c640 1 -- 172.21.15.59:0/428378992 learned_addr learned my addr 172.21.15.59:0/428378992 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3ba7fff640 1 -- 172.21.15.59:0/721136156 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f3bb80eff00 con 0x7f3bc010c180 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ba80a2b80 0x7f3ba80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.910+0000 7f3bbed9d640 1 --2- 172.21.15.59:0/428378992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4b2f0 0x5579cff55670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3bbf59e640 1 --2- 172.21.15.59:0/428378992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff55bb0 0x5579cff57fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3bbe59c640 1 -- 172.21.15.59:0/428378992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4b2f0 msgr2=0x5579cff55670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/428378992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4b2f0 0x5579cff55670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3bbe59c640 1 -- 172.21.15.59:0/428378992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff55bb0 msgr2=0x5579cff57fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/428378992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff55bb0 0x5579cff57fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3bbe59c640 1 -- 172.21.15.59:0/428378992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579cfe65130 con 0x5579cff4a9d0 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/428378992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff4adb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40137f0 tx=0x7f3bb4013cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef7218e899f65f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3ba57fa640 1 -- 172.21.15.59:0/428378992 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4009d00 con 0x5579cff4a9d0 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3ba57fa640 1 -- 172.21.15.59:0/428378992 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bb4011d90 con 0x5579cff4a9d0 2024-09-10T11:01:13.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3ba57fa640 1 -- 172.21.15.59:0/428378992 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb401d440 con 0x5579cff4a9d0 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.911+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ba80a2b80 0x7f3ba80a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4020000 tx=0x7f3bb401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 -- 172.21.15.59:0/428378992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 msgr2=0x5579cff4adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 --2- 172.21.15.59:0/428378992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff4adb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40137f0 tx=0x7f3bb4013cb0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 -- 172.21.15.59:0/428378992 shutdown_connections 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 --2- 172.21.15.59:0/428378992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff55bb0 0x5579cff57fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 --2- 172.21.15.59:0/428378992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4b2f0 0x5579cff55670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 --2- 172.21.15.59:0/428378992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff4adb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 -- 172.21.15.59:0/428378992 >> 172.21.15.59:0/428378992 conn(0x5579cff46f60 msgr2=0x5579cff47340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 -- 172.21.15.59:0/428378992 shutdown_connections 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 -- 172.21.15.59:0/428378992 wait complete. 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 -- start start 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.912+0000 7f3bc7495740 1 Processor -- start 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4a9d0 0x5579cff55460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4b2f0 0x5579cff527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 0x5579cff52cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bc7495740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5579cff58780 con 0x5579cff4b2f0 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bc7495740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5579cfe6bf20 con 0x5579cff4a9d0 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bc7495740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5579cff58900 con 0x5579cff55bb0 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bc7495740 10 client.0 _ll_register_callbacks cb 0x5579cfe35030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbe59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4b2f0 0x5579cff527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbe59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4b2f0 0x5579cff527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33236/0 (socket says 172.21.15.59:33236) 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbe59c640 1 -- 172.21.15.59:0/1536933303 learned_addr learned my addr 172.21.15.59:0/1536933303 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbed9d640 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4a9d0 0x5579cff55460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbf59e640 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 0x5579cff52cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbe59c640 1 -- 172.21.15.59:0/1536933303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 msgr2=0x5579cff52cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:13.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 0x5579cff52cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbe59c640 1 -- 172.21.15.59:0/1536933303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4a9d0 msgr2=0x5579cff55460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4a9d0 0x5579cff55460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbe59c640 1 -- 172.21.15.59:0/1536933303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579cfc222b0 con 0x5579cff4b2f0 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4b2f0 0x5579cff527b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4011f80 tx=0x7f3bb4004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acff282d135362a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3ba2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/1536933303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb401d440 con 0x5579cff4b2f0 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/1536933303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f3bb4013250 con 0x5579cff4b2f0 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.913+0000 7f3bc7495740 1 -- 172.21.15.59:0/1536933303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb4011d90 con 0x5579cff4b2f0 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/1536933303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3bb4009d00 con 0x5579cff4b2f0 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3bc7495740 10 client.15084 fetch_fsmap learned FSMap version 24 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3bc7495740 1 -- 172.21.15.59:0/1536933303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5579cff640a0 con 0x5579cff4b2f0 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/1536933303 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bb4011d90 con 0x5579cff4b2f0 2024-09-10T11:01:13.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/1536933303 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3bb4004f80 con 0x5579cff4b2f0 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3bc7495740 10 client.15084 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3bc7495740 10 client.15084 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3bc7495740 20 client.15084 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3bc7495740 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x5579cff66360 0x5579cff677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3bc7495740 4 client.15084 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3bc7495740 1 -- 172.21.15.59:0/1536933303 --> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579cfebe600 con 0x5579cff66360 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.914+0000 7f3bbed9d640 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x5579cff66360 0x5579cff677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.915+0000 7f3ba2ff5640 10 client.15084 ms_handle_connect on v2:172.21.15.115:6836/417494518 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.915+0000 7f3bbed9d640 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x5579cff66360 0x5579cff677d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a15a9af7017fe319 server_cookie=6c20dee913936182 in_seq=0 out_seq=0 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.915+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/1536933303 <== mds.1 v2:172.21.15.115:6836/417494518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5579cfebe600 con 0x5579cff66360 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.915+0000 7f3ba2ff5640 10 client.15084 handle_command_reply: tid=0 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 client.15084 shutdown 2024-09-10T11:01:13.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 -- 172.21.15.59:0/1536933303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4b2f0 msgr2=0x5579cff527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4b2f0 0x5579cff527b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4011f80 tx=0x7f3bb4004a30 comp rx=0 tx=0).stop 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 -- 172.21.15.59:0/1536933303 shutdown_connections 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x5579cff66360 0x5579cff677d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 0x5579cff52cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4b2f0 0x5579cff527b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 --2- 172.21.15.59:0/1536933303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4a9d0 0x5579cff55460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 -- 172.21.15.59:0/1536933303 >> 172.21.15.59:0/1536933303 conn(0x5579cff46f60 msgr2=0x5579cff4cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3ba2ff5640 0 client.15084 ms_handle_reset on v2:172.21.15.115:6836/417494518 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 -- 172.21.15.59:0/1536933303 shutdown_connections 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 1 -- 172.21.15.59:0/1536933303 wait complete. 2024-09-10T11:01:13.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.916+0000 7f3bc7495740 20 client.15084 trim_cache size 0 max 16384 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.934+0000 7f3bc7495740 1 Processor -- start 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.934+0000 7f3bc7495740 1 -- start start 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.934+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4a9d0 0x5579cff66a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.934+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 0x5579cff6fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.934+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff55bb0 0x5579cff6fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.934+0000 7f3bc7495740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5579cff65b10 con 0x5579cff55bb0 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.934+0000 7f3bc7495740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5579cff661e0 con 0x5579cff4b2f0 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.934+0000 7f3bc7495740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5579cff668b0 con 0x5579cff4a9d0 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.934+0000 7f3bbf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff55bb0 0x5579cff6fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff55bb0 0x5579cff6fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33240/0 (socket says 172.21.15.59:33240) 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbf59e640 1 -- 172.21.15.59:0/727515204 learned_addr learned my addr 172.21.15.59:0/727515204 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/727515204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 0x5579cff6fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbed9d640 1 --2- 172.21.15.59:0/727515204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4a9d0 0x5579cff66a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbf59e640 1 -- 172.21.15.59:0/727515204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4a9d0 msgr2=0x5579cff66a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:13.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbf59e640 1 --2- 172.21.15.59:0/727515204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4a9d0 0x5579cff66a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbf59e640 1 -- 172.21.15.59:0/727515204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 msgr2=0x5579cff6fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:13.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbf59e640 1 --2- 172.21.15.59:0/727515204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 0x5579cff6fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbf59e640 1 -- 172.21.15.59:0/727515204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579cff4a800 con 0x5579cff55bb0 2024-09-10T11:01:13.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3bbf59e640 1 --2- 172.21.15.59:0/727515204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff55bb0 0x5579cff6fff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80bc6b0 tx=0x7f3bb80bc260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d06d05000ce1c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:13.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3ba4ff9640 1 -- 172.21.15.59:0/727515204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb802c040 con 0x5579cff55bb0 2024-09-10T11:01:13.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3ba4ff9640 1 -- 172.21.15.59:0/727515204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bb80098d0 con 0x5579cff55bb0 2024-09-10T11:01:13.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.935+0000 7f3ba4ff9640 1 -- 172.21.15.59:0/727515204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80baa20 con 0x5579cff55bb0 2024-09-10T11:01:13.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 -- 172.21.15.59:0/727515204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff55bb0 msgr2=0x5579cff6fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 --2- 172.21.15.59:0/727515204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff55bb0 0x5579cff6fff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80bc6b0 tx=0x7f3bb80bc260 comp rx=0 tx=0).stop 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 -- 172.21.15.59:0/727515204 shutdown_connections 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 --2- 172.21.15.59:0/727515204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff55bb0 0x5579cff6fff0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 --2- 172.21.15.59:0/727515204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 0x5579cff6fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 --2- 172.21.15.59:0/727515204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff4a9d0 0x5579cff66a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 -- 172.21.15.59:0/727515204 >> 172.21.15.59:0/727515204 conn(0x5579cff46f60 msgr2=0x5579cff51920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 -- 172.21.15.59:0/727515204 shutdown_connections 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 -- 172.21.15.59:0/727515204 wait complete. 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 -- start start 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 Processor -- start 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff6ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 0x5579cff6b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.936+0000 7f3bc7495740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 0x5579cffcea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bc7495740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5579cff67650 con 0x5579cff4a9d0 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bc7495740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5579cff66f80 con 0x5579cff4b2f0 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bc7495740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5579cff67d20 con 0x5579cff55bb0 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff6ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bc7495740 10 client.0 _ll_register_callbacks cb 0x7f3bb8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff6ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33254/0 (socket says 172.21.15.59:33254) 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbed9d640 1 -- 172.21.15.59:0/3328580567 learned_addr learned my addr 172.21.15.59:0/3328580567 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 0x5579cff6b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbf59e640 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 0x5579cffcea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbed9d640 1 -- 172.21.15.59:0/3328580567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 msgr2=0x5579cffcea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbed9d640 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 0x5579cffcea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbed9d640 1 -- 172.21.15.59:0/3328580567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 msgr2=0x5579cff6b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbed9d640 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 0x5579cff6b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbed9d640 1 -- 172.21.15.59:0/3328580567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579cff6b930 con 0x5579cff4a9d0 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bbed9d640 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff6ab40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000b900 tx=0x7f3bb0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff948036deb5d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3ba2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/3328580567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb001d670 con 0x5579cff4a9d0 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/3328580567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f3bb001d810 con 0x5579cff4a9d0 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bc7495740 1 -- 172.21.15.59:0/3328580567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5579cfeb8b10 con 0x5579cff4a9d0 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/3328580567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3bb002d050 con 0x5579cff4a9d0 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bc7495740 10 client.15090 fetch_fsmap learned FSMap version 24 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.937+0000 7f3bc7495740 1 -- 172.21.15.59:0/3328580567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5579cffd0080 con 0x5579cff4a9d0 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.938+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/3328580567 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5579cfeb8b10 con 0x5579cff4a9d0 2024-09-10T11:01:13.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.938+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/3328580567 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3bb00103d0 con 0x5579cff4a9d0 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.938+0000 7f3bc7495740 10 client.15090 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.938+0000 7f3bc7495740 10 client.15090 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.938+0000 7f3bc7495740 20 client.15090 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.938+0000 7f3bc7495740 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x5579cffd4c60 0x5579cffd3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.938+0000 7f3bc7495740 4 client.15090 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.938+0000 7f3bc7495740 1 -- 172.21.15.59:0/3328580567 --> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] -- command(tid 0: {"prefix": "status"}) -- 0x5579cfe350e0 con 0x5579cffd4c60 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.938+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x5579cffd4c60 0x5579cffd3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bbe59c640 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x5579cffd4c60 0x5579cffd3970 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=629834b6e2fa4da1 server_cookie=b9af7fcd7b23e58f in_seq=0 out_seq=0 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3ba2ff5640 10 client.15090 ms_handle_connect on v2:172.21.15.115:6836/417494518 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3ba2ff5640 1 -- 172.21.15.59:0/3328580567 <== mds.1 v2:172.21.15.115:6836/417494518 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5579cfe350e0 con 0x5579cffd4c60 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3ba2ff5640 10 client.15090 handle_command_reply: tid=0 2024-09-10T11:01:13.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 client.15090 shutdown 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 -- 172.21.15.59:0/3328580567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 msgr2=0x5579cff6ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff6ab40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000b900 tx=0x7f3bb0011810 comp rx=0 tx=0).stop 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 -- 172.21.15.59:0/3328580567 shutdown_connections 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.115:6836/417494518,v1:172.21.15.115:6837/417494518] conn(0x5579cffd4c60 0x5579cffd3970 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579cff55bb0 0x5579cffcea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5579cff4b2f0 0x5579cff6b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 --2- 172.21.15.59:0/3328580567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579cff4a9d0 0x5579cff6ab40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 -- 172.21.15.59:0/3328580567 >> 172.21.15.59:0/3328580567 conn(0x5579cff46f60 msgr2=0x5579cff457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3ba2ff5640 0 client.15090 ms_handle_reset on v2:172.21.15.115:6836/417494518 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 -- 172.21.15.59:0/3328580567 shutdown_connections 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 1 -- 172.21.15.59:0/3328580567 wait complete. 2024-09-10T11:01:13.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.939+0000 7f3bc7495740 20 client.15090 trim_cache size 0 max 16384 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "86a09b02-6f62-11ef-bcea-c7b262605968", 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 1, 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24470, 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 94.791977798999994, 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 24, 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 85, 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 124.758477829 2024-09-10T11:01:13.947 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:01:13.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 -- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ba80a2b80 msgr2=0x7f3ba80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:13.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ba80a2b80 0x7f3ba80a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4020000 tx=0x7f3bb401f000 comp rx=0 tx=0).stop 2024-09-10T11:01:13.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 -- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 msgr2=0x7f3bc019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:13.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 0x7f3bc019cce0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8004af0 tx=0x7f3bb802f5b0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 -- 172.21.15.59:0/721136156 shutdown_connections 2024-09-10T11:01:13.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3ba80a2b80 0x7f3ba80a5040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc010c180 0x7f3bc019cce0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bc0103700 0x7f3bc0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 --2- 172.21.15.59:0/721136156 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3bc0102de0 0x7f3bc0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:13.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 -- 172.21.15.59:0/721136156 >> 172.21.15.59:0/721136156 conn(0x7f3bc00fc7a0 msgr2=0x7f3bc00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:13.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 -- 172.21.15.59:0/721136156 shutdown_connections 2024-09-10T11:01:13.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:13.940+0000 7f3bc50bc640 1 -- 172.21.15.59:0/721136156 wait complete. 2024-09-10T11:01:14.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:13 smithi059 ceph-mon[30978]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:14.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:13 smithi181 ceph-mon[35409]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:14.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:13 smithi115 ceph-mon[34719]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:14.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 -- 172.21.15.59:0/3973516803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8101420 msgr2=0x7f2eb810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/3973516803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8101420 0x7f2eb810d950 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009cd0 tx=0x7f2eb002a8e0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 -- 172.21.15.59:0/3973516803 shutdown_connections 2024-09-10T11:01:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/3973516803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8101420 0x7f2eb810d950 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/3973516803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2eb8100a80 0x7f2eb8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/3973516803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2eb8106a80 0x7f2eb8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 -- 172.21.15.59:0/3973516803 >> 172.21.15.59:0/3973516803 conn(0x7f2eb80fc7a0 msgr2=0x7f2eb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 -- 172.21.15.59:0/3973516803 shutdown_connections 2024-09-10T11:01:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 -- 172.21.15.59:0/3973516803 wait complete. 2024-09-10T11:01:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 Processor -- start 2024-09-10T11:01:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.466+0000 7f2ebf12b640 1 -- start start 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebf12b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2eb8100a80 0x7f2eb8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebf12b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2eb8101420 0x7f2eb8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebf12b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8106a80 0x7f2eb819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebf12b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8110f20 con 0x7f2eb8106a80 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebf12b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8110da0 con 0x7f2eb8101420 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebf12b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81110a0 con 0x7f2eb8100a80 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebd6c8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8106a80 0x7f2eb819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebd6c8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8106a80 0x7f2eb819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33260/0 (socket says 172.21.15.59:33260) 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebd6c8640 1 -- 172.21.15.59:0/286368659 learned_addr learned my addr 172.21.15.59:0/286368659 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2eb8101420 0x7f2eb8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2eb8100a80 0x7f2eb8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebd6c8640 1 -- 172.21.15.59:0/286368659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2eb8100a80 msgr2=0x7f2eb8198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:15.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebd6c8640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2eb8100a80 0x7f2eb8198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebd6c8640 1 -- 172.21.15.59:0/286368659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2eb8101420 msgr2=0x7f2eb8198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:15.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebd6c8640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2eb8101420 0x7f2eb8198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebd6c8640 1 -- 172.21.15.59:0/286368659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb819d510 con 0x7f2eb8106a80 2024-09-10T11:01:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2ebd6c8640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8106a80 0x7f2eb819ce30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0006010 tx=0x7f2eb0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.467+0000 7f2eb5ffb640 1 -- 172.21.15.59:0/286368659 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0004450 con 0x7f2eb8106a80 2024-09-10T11:01:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.468+0000 7f2eb5ffb640 1 -- 172.21.15.59:0/286368659 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2eb0003e10 con 0x7f2eb8106a80 2024-09-10T11:01:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.468+0000 7f2ebf12b640 1 -- 172.21.15.59:0/286368659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb819d7a0 con 0x7f2eb8106a80 2024-09-10T11:01:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.468+0000 7f2eb5ffb640 1 -- 172.21.15.59:0/286368659 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00466e0 con 0x7f2eb8106a80 2024-09-10T11:01:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.468+0000 7f2ebf12b640 1 -- 172.21.15.59:0/286368659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb80fcd10 con 0x7f2eb8106a80 2024-09-10T11:01:15.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.470+0000 7f2eb5ffb640 1 -- 172.21.15.59:0/286368659 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2eb00305a0 con 0x7f2eb8106a80 2024-09-10T11:01:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.470+0000 7f2ec1504740 1 Processor -- start 2024-09-10T11:01:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.470+0000 7f2ec1504740 1 -- start start 2024-09-10T11:01:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.470+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee919d0 0x55c4cee91db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee922f0 0x55c4cee9c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 0x55c4cee9efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ec1504740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c4cedf8090 con 0x55c4cee922f0 2024-09-10T11:01:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ec1504740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c4ced9fa70 con 0x55c4cee919d0 2024-09-10T11:01:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ec1504740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c4cedf4050 con 0x55c4cee9cbb0 2024-09-10T11:01:15.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebcec7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee922f0 0x55c4cee9c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2eb5ffb640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2ea80a2b80 0x7f2ea80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebcec7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee922f0 0x55c4cee9c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33276/0 (socket says 172.21.15.59:33276) 2024-09-10T11:01:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebcec7640 1 -- 172.21.15.59:0/170698919 learned_addr learned my addr 172.21.15.59:0/170698919 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebd6c8640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2ea80a2b80 0x7f2ea80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/170698919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 0x55c4cee9efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebcec7640 1 -- 172.21.15.59:0/170698919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 msgr2=0x55c4cee9efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/170698919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 0x55c4cee9efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebcec7640 1 -- 172.21.15.59:0/170698919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee919d0 msgr2=0x55c4cee91db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:15.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/170698919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee919d0 0x55c4cee91db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebcec7640 1 -- 172.21.15.59:0/170698919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4cedac130 con 0x55c4cee922f0 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/170698919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 0x55c4cee9efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2eb5ffb640 1 -- 172.21.15.59:0/286368659 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f2eb002e030 con 0x7f2eb8106a80 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/170698919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee922f0 0x55c4cee9c670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00b820 tx=0x7f2eac00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98347de8db9d0805 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ebd6c8640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2ea80a2b80 0x7f2ea80a5040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00bd290 tx=0x7f2eb00903c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ea2ffd640 1 -- 172.21.15.59:0/170698919 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac00d950 con 0x55c4cee922f0 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ea2ffd640 1 -- 172.21.15.59:0/170698919 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2eac019070 con 0x55c4cee922f0 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.471+0000 7f2ea2ffd640 1 -- 172.21.15.59:0/170698919 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0123e0 con 0x55c4cee922f0 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.472+0000 7f2ec1504740 1 -- 172.21.15.59:0/170698919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee922f0 msgr2=0x55c4cee9c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.472+0000 7f2ec1504740 1 --2- 172.21.15.59:0/170698919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee922f0 0x55c4cee9c670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00b820 tx=0x7f2eac00bce0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.472+0000 7f2ec1504740 1 -- 172.21.15.59:0/170698919 shutdown_connections 2024-09-10T11:01:15.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.472+0000 7f2ec1504740 1 --2- 172.21.15.59:0/170698919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 0x55c4cee9efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.472+0000 7f2ec1504740 1 --2- 172.21.15.59:0/170698919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee922f0 0x55c4cee9c670 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.472+0000 7f2ec1504740 1 --2- 172.21.15.59:0/170698919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee919d0 0x55c4cee91db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.472+0000 7f2ec1504740 1 -- 172.21.15.59:0/170698919 >> 172.21.15.59:0/170698919 conn(0x55c4cee8df60 msgr2=0x55c4cee8e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:15.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.472+0000 7f2ec1504740 1 -- 172.21.15.59:0/170698919 shutdown_connections 2024-09-10T11:01:15.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.472+0000 7f2ec1504740 1 -- 172.21.15.59:0/170698919 wait complete. 2024-09-10T11:01:15.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2ec1504740 1 -- start start 2024-09-10T11:01:15.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2ec1504740 1 Processor -- start 2024-09-10T11:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4cee9c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee922f0 0x55c4cee997b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 0x55c4cee99cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2ec1504740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c4cee9f780 con 0x55c4cee919d0 2024-09-10T11:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2ec1504740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c4cedb2f20 con 0x55c4cee922f0 2024-09-10T11:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2ec1504740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c4cee9f900 con 0x55c4cee9cbb0 2024-09-10T11:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2ec1504740 10 client.0 _ll_register_callbacks cb 0x55c4ced7c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:15.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4cee9c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4cee9c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33290/0 (socket says 172.21.15.59:33290) 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.473+0000 7f2eb7fff640 1 -- 172.21.15.59:0/1908878856 learned_addr learned my addr 172.21.15.59:0/1908878856 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 0x55c4cee99cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2eb7fff640 1 -- 172.21.15.59:0/1908878856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 msgr2=0x55c4cee99cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 0x55c4cee99cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2eb7fff640 1 -- 172.21.15.59:0/1908878856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee922f0 msgr2=0x55c4cee997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee922f0 0x55c4cee997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2eb7fff640 1 -- 172.21.15.59:0/1908878856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4ceb692b0 con 0x55c4cee919d0 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4cee9c460 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4015990 tx=0x7f2ea400c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57200ee8971bbdf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2e97fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2e97fff640 1 -- 172.21.15.59:0/1908878856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4010b80 con 0x55c4cee919d0 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2e97fff640 1 -- 172.21.15.59:0/1908878856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f2ea4010d20 con 0x55c4cee919d0 2024-09-10T11:01:15.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2ec1504740 1 -- 172.21.15.59:0/1908878856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eac019070 con 0x55c4cee919d0 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2e97fff640 1 -- 172.21.15.59:0/1908878856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2ea4022430 con 0x55c4cee919d0 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2ec1504740 10 client.15102 fetch_fsmap learned FSMap version 24 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2ec1504740 1 -- 172.21.15.59:0/1908878856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c4ceeab0c0 con 0x55c4cee919d0 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.474+0000 7f2e97fff640 1 -- 172.21.15.59:0/1908878856 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2eac019070 con 0x55c4cee919d0 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2e97fff640 1 -- 172.21.15.59:0/1908878856 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2ea4020400 con 0x55c4cee919d0 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2ec1504740 10 client.15102 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2ec1504740 10 client.15102 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2ec1504740 20 client.15102 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2ec1504740 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c4ceead7d0 0x55c4ceeaec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2ec1504740 4 client.15102 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2ec1504740 1 -- 172.21.15.59:0/1908878856 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4cee05600 con 0x55c4ceead7d0 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c4ceead7d0 0x55c4ceeaec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c4ceead7d0 0x55c4ceeaec40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702aea7be266f725 server_cookie=bca9944fcfec9dd6 in_seq=0 out_seq=0 2024-09-10T11:01:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.475+0000 7f2e97fff640 10 client.15102 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2e97fff640 1 -- 172.21.15.59:0/1908878856 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4cee05600 con 0x55c4ceead7d0 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2e97fff640 10 client.15102 handle_command_reply: tid=0 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2ec1504740 1 client.15102 shutdown 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2ec1504740 1 -- 172.21.15.59:0/1908878856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 msgr2=0x55c4cee9c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2ec1504740 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4cee9c460 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4015990 tx=0x7f2ea400c3b0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2ec1504740 1 -- 172.21.15.59:0/1908878856 shutdown_connections 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2ec1504740 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c4ceead7d0 0x55c4ceeaec40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2e97fff640 0 client.15102 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2ec1504740 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee9cbb0 0x55c4cee99cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2ec1504740 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee922f0 0x55c4cee997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2ec1504740 1 --2- 172.21.15.59:0/1908878856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4cee9c460 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.476+0000 7f2ec1504740 1 -- 172.21.15.59:0/1908878856 >> 172.21.15.59:0/1908878856 conn(0x55c4cee8df60 msgr2=0x55c4cee93c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.477+0000 7f2ec1504740 1 -- 172.21.15.59:0/1908878856 shutdown_connections 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.477+0000 7f2ec1504740 1 -- 172.21.15.59:0/1908878856 wait complete. 2024-09-10T11:01:15.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.477+0000 7f2ec1504740 20 client.15102 trim_cache size 0 max 16384 2024-09-10T11:01:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2ec1504740 1 Processor -- start 2024-09-10T11:01:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2ec1504740 1 -- start start 2024-09-10T11:01:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee919d0 0x55c4ceeaec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee922f0 0x55c4cee99070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee9cbb0 0x55c4cee98080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2ec1504740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c4ceeacf80 con 0x55c4cee9cbb0 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2ec1504740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c4ceead650 con 0x55c4cee922f0 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2ec1504740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c4ceeadd20 con 0x55c4cee919d0 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee9cbb0 0x55c4cee98080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee9cbb0 0x55c4cee98080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33292/0 (socket says 172.21.15.59:33292) 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2eb7fff640 1 -- 172.21.15.59:0/946378703 learned_addr learned my addr 172.21.15.59:0/946378703 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/946378703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee919d0 0x55c4ceeaec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/946378703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee922f0 0x55c4cee99070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2eb7fff640 1 -- 172.21.15.59:0/946378703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee919d0 msgr2=0x55c4ceeaec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/946378703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee919d0 0x55c4ceeaec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2eb7fff640 1 -- 172.21.15.59:0/946378703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee922f0 msgr2=0x55c4cee99070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/946378703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee922f0 0x55c4cee99070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.495+0000 7f2eb7fff640 1 -- 172.21.15.59:0/946378703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ceeacda0 con 0x55c4cee9cbb0 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.496+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/946378703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee9cbb0 0x55c4cee98080 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4020820 tx=0x7f2ea400c1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1023921bde0ce24d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.496+0000 7f2ea27fc640 1 -- 172.21.15.59:0/946378703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4020600 con 0x55c4cee9cbb0 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.496+0000 7f2ea27fc640 1 -- 172.21.15.59:0/946378703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ea401c070 con 0x55c4cee9cbb0 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.496+0000 7f2ea27fc640 1 -- 172.21.15.59:0/946378703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4017640 con 0x55c4cee9cbb0 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.496+0000 7f2ec1504740 1 -- 172.21.15.59:0/946378703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee9cbb0 msgr2=0x55c4cee98080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.496+0000 7f2ec1504740 1 --2- 172.21.15.59:0/946378703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee9cbb0 0x55c4cee98080 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4020820 tx=0x7f2ea400c1c0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.496+0000 7f2ec1504740 1 -- 172.21.15.59:0/946378703 shutdown_connections 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.496+0000 7f2ec1504740 1 --2- 172.21.15.59:0/946378703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee9cbb0 0x55c4cee98080 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.496+0000 7f2ec1504740 1 --2- 172.21.15.59:0/946378703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee922f0 0x55c4cee99070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 --2- 172.21.15.59:0/946378703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee919d0 0x55c4ceeaec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 -- 172.21.15.59:0/946378703 >> 172.21.15.59:0/946378703 conn(0x55c4cee8df60 msgr2=0x55c4cee99770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 -- 172.21.15.59:0/946378703 shutdown_connections 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 -- 172.21.15.59:0/946378703 wait complete. 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 -- start start 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 Processor -- start 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4ceeb1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee922f0 0x55c4ceeb2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee9cbb0 0x55c4ceeb2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c4ceeaeac0 con 0x55c4cee919d0 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c4ceeae3f0 con 0x55c4cee9cbb0 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.497+0000 7f2ec1504740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c4ceeaf190 con 0x55c4cee922f0 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2ec1504740 10 client.0 _ll_register_callbacks cb 0x7f2ea400c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4ceeb1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4ceeb1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33298/0 (socket says 172.21.15.59:33298) 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 -- 172.21.15.59:0/3927572059 learned_addr learned my addr 172.21.15.59:0/3927572059 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee922f0 0x55c4ceeb2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee9cbb0 0x55c4ceeb2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 -- 172.21.15.59:0/3927572059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee922f0 msgr2=0x55c4ceeb2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee922f0 0x55c4ceeb2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 -- 172.21.15.59:0/3927572059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee9cbb0 msgr2=0x55c4ceeb2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee9cbb0 0x55c4ceeb2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 -- 172.21.15.59:0/3927572059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4cef16080 con 0x55c4cee919d0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2eb7fff640 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4ceeb1dd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c3f0 tx=0x7f2ea400c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46a10736d17a8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2e97fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2e97fff640 1 -- 172.21.15.59:0/3927572059 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea403d060 con 0x55c4cee919d0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2e97fff640 1 -- 172.21.15.59:0/3927572059 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f2ea4010980 con 0x55c4cee919d0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2ec1504740 1 -- 172.21.15.59:0/3927572059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ea401c070 con 0x55c4cee919d0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2e97fff640 1 -- 172.21.15.59:0/3927572059 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2ea4010b80 con 0x55c4cee919d0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2ec1504740 10 client.15108 fetch_fsmap learned FSMap version 24 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.498+0000 7f2ec1504740 1 -- 172.21.15.59:0/3927572059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c4cef17340 con 0x55c4cee919d0 2024-09-10T11:01:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.499+0000 7f2e97fff640 1 -- 172.21.15.59:0/3927572059 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ea401c070 con 0x55c4cee919d0 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.499+0000 7f2e97fff640 1 -- 172.21.15.59:0/3927572059 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2ea40225d0 con 0x55c4cee919d0 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.499+0000 7f2ec1504740 10 client.15108 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.499+0000 7f2ec1504740 10 client.15108 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.499+0000 7f2ec1504740 20 client.15108 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.499+0000 7f2ec1504740 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c4ceead7d0 0x55c4cef1a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.499+0000 7f2ec1504740 4 client.15108 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.499+0000 7f2ec1504740 1 -- 172.21.15.59:0/3927572059 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "status"}) -- 0x55c4cedffb10 con 0x55c4ceead7d0 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.499+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c4ceead7d0 0x55c4cef1a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ebcec7640 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c4ceead7d0 0x55c4cef1a890 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d8e0907b9b02178 server_cookie=b20113a4815f9ed4 in_seq=0 out_seq=0 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2e97fff640 10 client.15108 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2e97fff640 1 -- 172.21.15.59:0/3927572059 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c4cedffb10 con 0x55c4ceead7d0 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2e97fff640 10 client.15108 handle_command_reply: tid=0 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 client.15108 shutdown 2024-09-10T11:01:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 -- 172.21.15.59:0/3927572059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 msgr2=0x55c4ceeb1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4ceeb1dd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c3f0 tx=0x7f2ea400c460 comp rx=0 tx=0).stop 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 -- 172.21.15.59:0/3927572059 shutdown_connections 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c4ceead7d0 0x55c4cef1a890 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c4cee9cbb0 0x55c4ceeb2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c4cee922f0 0x55c4ceeb2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 --2- 172.21.15.59:0/3927572059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c4cee919d0 0x55c4ceeb1dd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2e97fff640 0 client.15108 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 -- 172.21.15.59:0/3927572059 >> 172.21.15.59:0/3927572059 conn(0x55c4cee8df60 msgr2=0x55c4cee8c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 -- 172.21.15.59:0/3927572059 shutdown_connections 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 1 -- 172.21.15.59:0/3927572059 wait complete. 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.500+0000 7f2ec1504740 20 client.15108 trim_cache size 0 max 16384 2024-09-10T11:01:15.514 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "86a09b02-6f62-11ef-bcea-c7b262605968", 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24497, 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 103.39090162799999, 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 24, 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 85, 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 114.538954252 2024-09-10T11:01:15.515 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:01:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 -- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2ea80a2b80 msgr2=0x7f2ea80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2ea80a2b80 0x7f2ea80a5040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00bd290 tx=0x7f2eb00903c0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 -- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8106a80 msgr2=0x7f2eb819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8106a80 0x7f2eb819ce30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0006010 tx=0x7f2eb0003c20 comp rx=0 tx=0).stop 2024-09-10T11:01:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 -- 172.21.15.59:0/286368659 shutdown_connections 2024-09-10T11:01:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f2ea80a2b80 0x7f2ea80a5040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb8106a80 0x7f2eb819ce30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2eb8101420 0x7f2eb8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 --2- 172.21.15.59:0/286368659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2eb8100a80 0x7f2eb8198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:15.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 -- 172.21.15.59:0/286368659 >> 172.21.15.59:0/286368659 conn(0x7f2eb80fc7a0 msgr2=0x7f2eb806aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:15.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 -- 172.21.15.59:0/286368659 shutdown_connections 2024-09-10T11:01:15.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:15.501+0000 7f2ebf12b640 1 -- 172.21.15.59:0/286368659 wait complete. 2024-09-10T11:01:16.380 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:15 smithi059 ceph-mon[30978]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T11:01:16.412 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T11:01:16.420 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T11:01:16.421 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T11:01:16.421 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T11:01:16.421 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-10T11:01:16.422 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T11:01:16.422 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:01:16.422 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-10T11:01:16.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:15 smithi181 ceph-mon[35409]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T11:01:16.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:15 smithi115 ceph-mon[34719]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T11:01:16.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.528+0000 7f3e072e4640 1 -- 172.21.15.59:0/2039753617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e00102640 msgr2=0x7f3e00104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:16.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.528+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2039753617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e00102640 0x7f3e00104a30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009900 tx=0x7f3dfc02a410 comp rx=0 tx=0).stop 2024-09-10T11:01:16.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.528+0000 7f3e072e4640 1 -- 172.21.15.59:0/2039753617 shutdown_connections 2024-09-10T11:01:16.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.528+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2039753617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e001078a0 0x7f3e00109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.528+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2039753617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e00104f70 0x7f3e00107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.528+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2039753617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e00102640 0x7f3e00104a30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.528+0000 7f3e072e4640 1 -- 172.21.15.59:0/2039753617 >> 172.21.15.59:0/2039753617 conn(0x7f3e000fc1e0 msgr2=0x7f3e000fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:16.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 -- 172.21.15.59:0/2039753617 shutdown_connections 2024-09-10T11:01:16.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 -- 172.21.15.59:0/2039753617 wait complete. 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 Processor -- start 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 -- start start 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e00102640 0x7f3e00197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e00104f70 0x7f3e001983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e001078a0 0x7f3e0019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0010d850 con 0x7f3e001078a0 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0010d6d0 con 0x7f3e00102640 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e072e4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0010d9d0 con 0x7f3e00104f70 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e05881640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e001078a0 0x7f3e0019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e05881640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e001078a0 0x7f3e0019f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39470/0 (socket says 172.21.15.59:39470) 2024-09-10T11:01:16.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.529+0000 7f3e05881640 1 -- 172.21.15.59:0/2142764884 learned_addr learned my addr 172.21.15.59:0/2142764884 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e05080640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e00102640 0x7f3e00197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e0487f640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e00104f70 0x7f3e001983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e05881640 1 -- 172.21.15.59:0/2142764884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e00104f70 msgr2=0x7f3e001983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e05881640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e00104f70 0x7f3e001983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e05881640 1 -- 172.21.15.59:0/2142764884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e00102640 msgr2=0x7f3e00197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e05881640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e00102640 0x7f3e00197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e05881640 1 -- 172.21.15.59:0/2142764884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0019faa0 con 0x7f3e001078a0 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e0487f640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e00104f70 0x7f3e001983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e05080640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e00102640 0x7f3e00197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e05881640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e001078a0 0x7f3e0019f430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3df800dac0 tx=0x7f3df800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3df67fc640 1 -- 172.21.15.59:0/2142764884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8017070 con 0x7f3e001078a0 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3df67fc640 1 -- 172.21.15.59:0/2142764884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df8003e50 con 0x7f3e001078a0 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3df67fc640 1 -- 172.21.15.59:0/2142764884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80106c0 con 0x7f3e001078a0 2024-09-10T11:01:16.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0019fd90 con 0x7f3e001078a0 2024-09-10T11:01:16.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.530+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e001a0230 con 0x7f3e001078a0 2024-09-10T11:01:16.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.531+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e000fdcd0 con 0x7f3e001078a0 2024-09-10T11:01:16.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.532+0000 7f3df67fc640 1 -- 172.21.15.59:0/2142764884 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3df8003970 con 0x7f3e001078a0 2024-09-10T11:01:16.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.533+0000 7f3df67fc640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3dec0a2c30 0x7f3dec0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:16.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.533+0000 7f3e05080640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3dec0a2c30 0x7f3dec0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:16.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.533+0000 7f3df67fc640 1 -- 172.21.15.59:0/2142764884 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f3df80ceaa0 con 0x7f3e001078a0 2024-09-10T11:01:16.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.533+0000 7f3e05080640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3dec0a2c30 0x7f3dec0a50f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc000c00 tx=0x7f3dfc0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:16.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.537+0000 7f3df67fc640 1 -- 172.21.15.59:0/2142764884 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3df809b9c0 con 0x7f3e001078a0 2024-09-10T11:01:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.765+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f3e00062e90 con 0x7f3e001078a0 2024-09-10T11:01:16.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.980+0000 7f3df67fc640 1 -- 172.21.15.59:0/2142764884 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f3df809b2c0 con 0x7f3e001078a0 2024-09-10T11:01:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3dec0a2c30 msgr2=0x7f3dec0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3dec0a2c30 0x7f3dec0a50f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc000c00 tx=0x7f3dfc0095f0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e001078a0 msgr2=0x7f3e0019f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e001078a0 0x7f3e0019f430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3df800dac0 tx=0x7f3df800df80 comp rx=0 tx=0).stop 2024-09-10T11:01:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 shutdown_connections 2024-09-10T11:01:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f3dec0a2c30 0x7f3dec0a50f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e001078a0 0x7f3e0019f430 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e00104f70 0x7f3e001983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 --2- 172.21.15.59:0/2142764884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e00102640 0x7f3e00197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.983+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 >> 172.21.15.59:0/2142764884 conn(0x7f3e000fc1e0 msgr2=0x7f3e00102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.985+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 shutdown_connections 2024-09-10T11:01:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:16.985+0000 7f3e072e4640 1 -- 172.21.15.59:0/2142764884 wait complete. 2024-09-10T11:01:17.002 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T11:01:17.025 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T11:01:17.026 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T11:01:17.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:01:17.026 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-09-10T11:01:17.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:01:17.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-09-10T11:01:17.112 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2024-09-10T11:01:17.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:01:17.114 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-10T11:01:17.114 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T11:01:17.114 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T11:01:17.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T11:01:17.338 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:16 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2142764884' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T11:01:17.339 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: ignoring --setuser ceph since I am not root 2024-09-10T11:01:17.339 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: ignoring --setgroup ceph since I am not root 2024-09-10T11:01:17.339 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-mgr[36088]: -- 172.21.15.115:0/4013164142 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559e3437b0e0 con 0x559e34359000 2024-09-10T11:01:17.339 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:17.132+0000 7f3f6244a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T11:01:17.339 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:17.189+0000 7f3f6244a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T11:01:17.339 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:17.337+0000 7f3f6244a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T11:01:17.343 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:16 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2142764884' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T11:01:17.343 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: ignoring --setuser ceph since I am not root 2024-09-10T11:01:17.343 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: ignoring --setgroup ceph since I am not root 2024-09-10T11:01:17.343 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-mgr[37211]: -- 172.21.15.181:0/257720308 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557a1f13b0e0 con 0x557a1f119000 2024-09-10T11:01:17.343 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:17.134+0000 7f4d20baa040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T11:01:17.343 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:17.192+0000 7f4d20baa040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T11:01:17.343 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:17.341+0000 7f4d20baa040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T11:01:17.364 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:16 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2142764884' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T11:01:17.364 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: ignoring --setuser ceph since I am not root 2024-09-10T11:01:17.364 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: ignoring --setgroup ceph since I am not root 2024-09-10T11:01:17.365 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:17.140+0000 7f74eae24040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T11:01:17.365 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:17.202+0000 7f74eae24040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T11:01:17.365 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:17.362+0000 7f74eae24040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T11:01:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:01:17.637 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:17.445+0000 7f74eae24040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T11:01:17.638 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:17.600+0000 7f74eae24040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:01:17.686 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:17.408+0000 7f4d20baa040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T11:01:17.686 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:17.556+0000 7f4d20baa040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:01:17.689 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:17.403+0000 7f3f6244a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T11:01:17.689 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:17.548+0000 7f3f6244a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:01:17.689 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:17.688+0000 7f3f6244a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T11:01:17.987 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:17.752+0000 7f74eae24040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T11:01:17.988 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:17.698+0000 7f4d20baa040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.976+0000 7f61178df640 1 -- 172.21.15.59:0/2802318137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110100e20 msgr2=0x7f6110101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.976+0000 7f61178df640 1 --2- 172.21.15.59:0/2802318137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110100e20 0x7f6110101200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f610c009900 tx=0x7f610c02a480 comp rx=0 tx=0).stop 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.976+0000 7f61178df640 1 -- 172.21.15.59:0/2802318137 shutdown_connections 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.976+0000 7f61178df640 1 --2- 172.21.15.59:0/2802318137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6110102ef0 0x7f611010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.976+0000 7f61178df640 1 --2- 172.21.15.59:0/2802318137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6110102570 0x7f61101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.976+0000 7f61178df640 1 --2- 172.21.15.59:0/2802318137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110100e20 0x7f6110101200 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.976+0000 7f61178df640 1 -- 172.21.15.59:0/2802318137 >> 172.21.15.59:0/2802318137 conn(0x7f61100fc7d0 msgr2=0x7f61100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.976+0000 7f61178df640 1 -- 172.21.15.59:0/2802318137 shutdown_connections 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.976+0000 7f61178df640 1 -- 172.21.15.59:0/2802318137 wait complete. 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f61178df640 1 Processor -- start 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f61178df640 1 -- start start 2024-09-10T11:01:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f61178df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6110100e20 0x7f6110199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f61178df640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6110102570 0x7f6110199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f61178df640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110102ef0 0x7f61101a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f61178df640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6110110f80 con 0x7f6110102ef0 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f61178df640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6110110e00 con 0x7f6110102570 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f61178df640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6110111100 con 0x7f6110100e20 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6115e7c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110102ef0 0x7f61101a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6115e7c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110102ef0 0x7f61101a43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39496/0 (socket says 172.21.15.59:39496) 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f611567b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6110100e20 0x7f6110199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6115e7c640 1 -- 172.21.15.59:0/1002424824 learned_addr learned my addr 172.21.15.59:0/1002424824 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6114e7a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6110102570 0x7f6110199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6115e7c640 1 -- 172.21.15.59:0/1002424824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6110100e20 msgr2=0x7f6110199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6115e7c640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6110100e20 0x7f6110199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6115e7c640 1 -- 172.21.15.59:0/1002424824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6110102570 msgr2=0x7f6110199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6115e7c640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6110102570 0x7f6110199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6115e7c640 1 -- 172.21.15.59:0/1002424824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61101a4900 con 0x7f6110102ef0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.977+0000 7f6114e7a640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6110102570 0x7f6110199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.978+0000 7f6115e7c640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110102ef0 0x7f61101a43c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f610800eb10 tx=0x7f610800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.978+0000 7f61067fc640 1 -- 172.21.15.59:0/1002424824 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108004b20 con 0x7f6110102ef0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.978+0000 7f61067fc640 1 -- 172.21.15.59:0/1002424824 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6108004cc0 con 0x7f6110102ef0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.978+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6110197130 con 0x7f6110102ef0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.978+0000 7f61067fc640 1 -- 172.21.15.59:0/1002424824 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108010760 con 0x7f6110102ef0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.978+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6110197620 con 0x7f6110102ef0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.979+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6110101200 con 0x7f6110102ef0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.980+0000 7f61067fc640 1 -- 172.21.15.59:0/1002424824 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f6108005020 con 0x7f6110102ef0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.981+0000 7f61067fc640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60fc0a2bd0 0x7f60fc0a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.981+0000 7f611567b640 1 -- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60fc0a2bd0 msgr2=0x7f60fc0a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3145930564 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.981+0000 7f61067fc640 1 -- 172.21.15.59:0/1002424824 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f61080cf5d0 con 0x7f6110102ef0 2024-09-10T11:01:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.981+0000 7f611567b640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60fc0a2bd0 0x7f60fc0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:01:18.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:17.985+0000 7f61067fc640 1 -- 172.21.15.59:0/1002424824 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f610809c4f0 con 0x7f6110102ef0 2024-09-10T11:01:18.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.182+0000 7f611567b640 1 -- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60fc0a2bd0 msgr2=0x7f60fc0a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3145930564 2024-09-10T11:01:18.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.182+0000 7f611567b640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60fc0a2bd0 0x7f60fc0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T11:01:18.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.231+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6110109090 con 0x7f6110102ef0 2024-09-10T11:01:18.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.232+0000 7f61067fc640 1 -- 172.21.15.59:0/1002424824 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f610809bdf0 con 0x7f6110102ef0 2024-09-10T11:01:18.233 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T11:01:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60fc0a2bd0 msgr2=0x7f60fc0a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:01:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60fc0a2bd0 0x7f60fc0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110102ef0 msgr2=0x7f61101a43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110102ef0 0x7f61101a43c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f610800eb10 tx=0x7f610800c2d0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 shutdown_connections 2024-09-10T11:01:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f60fc0a2bd0 0x7f60fc0a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6110102ef0 0x7f61101a43c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6110102570 0x7f6110199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 --2- 172.21.15.59:0/1002424824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6110100e20 0x7f6110199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 >> 172.21.15.59:0/1002424824 conn(0x7f61100fc7d0 msgr2=0x7f61100fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 shutdown_connections 2024-09-10T11:01:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:18.234+0000 7f61178df640 1 -- 172.21.15.59:0/1002424824 wait complete. 2024-09-10T11:01:18.244 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2142764884' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T11:01:18.244 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:17 smithi115 ceph-mon[34719]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T11:01:18.244 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:17.999+0000 7f3f6244a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T11:01:18.244 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:18.059+0000 7f3f6244a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T11:01:18.244 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:18.243+0000 7f3f6244a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T11:01:18.245 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2142764884' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T11:01:18.245 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:17 smithi059 ceph-mon[30978]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T11:01:18.246 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:18.112+0000 7f74eae24040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T11:01:18.246 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:18.176+0000 7f74eae24040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T11:01:18.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2142764884' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T11:01:18.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:17 smithi181 ceph-mon[35409]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T11:01:18.259 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:18 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:18.011+0000 7f4d20baa040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T11:01:18.259 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:18 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:18.071+0000 7f4d20baa040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T11:01:18.259 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:18 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:18.257+0000 7f4d20baa040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T11:01:18.609 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:18.375+0000 7f74eae24040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T11:01:18.986 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T11:01:18.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T11:01:18.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-09-10T11:01:18.986 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T11:01:18.986 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T11:01:18.986 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T11:01:18.986 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T11:01:18.986 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T11:01:18.986 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T11:01:18.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:01:18.987 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-09-10T11:01:19.004 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T11:01:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T11:01:19.004 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-09-10T11:01:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T11:01:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42184sec preferred_lft 42184sec 2024-09-10T11:01:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-09-10T11:01:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-09-10T11:01:19.006 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T11:01:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-09-10T11:01:19.006 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-09-10T11:01:19.006 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T11:01:19.006 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:01:19.007 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T11:01:19.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2024-09-10T11:01:19.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2024-09-10T11:01:19.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2024-09-10T11:01:19.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T11:01:19.007 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T11:01:19.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:01:19.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:01:19.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:01:19.209 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T11:01:19.215 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:18 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1002424824' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T11:01:19.236 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-09-10T11:01:19.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:01:19.238 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-09-10T11:01:19.240 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:18 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1002424824' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T11:01:19.240 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:19.169+0000 7f3f6244a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T11:01:19.316 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-09-10T11:01:19.316 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T11:01:19.316 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T11:01:19.316 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T11:01:19.316 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T11:01:19.316 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:01:19.317 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T11:01:19.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T11:01:19.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T11:01:19.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T11:01:19.317 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T11:01:19.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:01:19.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:18 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1002424824' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T11:01:19.436 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:19 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:19.142+0000 7f4d20baa040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T11:01:19.436 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:19 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:19.210+0000 7f4d20baa040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T11:01:19.503 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:19.238+0000 7f3f6244a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T11:01:19.546 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:19 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:19.323+0000 7f74eae24040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T11:01:19.547 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:19 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:19.397+0000 7f74eae24040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T11:01:19.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:01:19.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:01:19.663 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-09-10T11:01:19.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:01:19.679 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2024-09-10T11:01:19.735 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:01:19.735 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T11:01:19.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T11:01:19.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T11:01:19.735 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T11:01:19.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:01:19.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:01:19.859 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T11:01:19.859 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:01:19.859 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T11:01:19.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T11:01:19.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T11:01:19.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T11:01:19.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T11:01:19.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T11:01:19.860 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T11:01:19.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:01:19.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:01:20.004 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:01:20.004 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T11:01:20.004 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-09-10T11:01:20.004 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T11:01:20.004 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T11:01:20.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:01:20.073 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:19 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:19.950+0000 7f4d20baa040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T11:01:20.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:01:20.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T11:01:20.086 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T11:01:20.102 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T11:01:20.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T11:01:20.102 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T11:01:20.161 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T11:01:20.161 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T11:01:20.161 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/1635a070-6a40-4e0b-9e85-2e9c2735d50c 2024-09-10T11:01:20.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:01:20.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/1635a070-6a40-4e0b-9e85-2e9c2735d50c /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-09-10T11:01:20.208 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:19.955+0000 7f3f6244a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T11:01:20.208 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.072+0000 7f3f6244a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T11:01:20.256 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-09-10T11:01:20.256 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-09-10T11:01:20.256 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-09-10T11:01:20.400 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-09-10T11:01:20.400 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-09-10T11:01:20.401 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-09-10T11:01:20.401 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.115:3300,172.21.15.181:3300" 2024-09-10T11:01:20.401 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:3300,172.21.15.115:3300,172.21.15.181:3300:/volumes/qa/sv_1/1635a070-6a40-4e0b-9e85-2e9c2735d50c 2024-09-10T11:01:20.401 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=86a09b02-6f62-11ef-bcea-c7b262605968" will pass to kernel 2024-09-10T11:01:20.401 INFO:teuthology.orchestra.run.smithi059.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T11:01:20.402 INFO:teuthology.orchestra.run.smithi059.stdout: You just mounted a file system that supports labels which does not 2024-09-10T11:01:20.402 INFO:teuthology.orchestra.run.smithi059.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T11:01:20.402 INFO:teuthology.orchestra.run.smithi059.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T11:01:20.402 INFO:teuthology.orchestra.run.smithi059.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T11:01:20.403 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T11:01:20.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:01:20.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T11:01:20.434 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T11:01:20.436 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.072+0000 7f4d20baa040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T11:01:20.436 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.222+0000 7f4d20baa040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:01:20.436 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.286+0000 7f4d20baa040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T11:01:20.488 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:20.189+0000 7f74eae24040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T11:01:20.488 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:20.315+0000 7f74eae24040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T11:01:20.499 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.216+0000 7f3f6244a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:01:20.499 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.278+0000 7f3f6244a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T11:01:20.499 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.429+0000 7f3f6244a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T11:01:20.499 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.498+0000 7f3f6244a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T11:01:20.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T11:01:20.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:01:20.534 INFO:teuthology.orchestra.run.smithi059.stdout:client24823 2024-09-10T11:01:20.534 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T11:01:20.535 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T11:01:20.592 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T11:01:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T11:01:20.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:01:20.693 INFO:teuthology.orchestra.run.smithi059.stdout:client24823 2024-09-10T11:01:20.693 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T11:01:20.702 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.442+0000 7f4d20baa040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T11:01:20.702 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.513+0000 7f4d20baa040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T11:01:20.702 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.575+0000 7f4d20baa040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T11:01:20.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T11:01:20.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:01:20.752 INFO:teuthology.orchestra.run.smithi059.stdout:client24823 2024-09-10T11:01:20.753 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/86a09b02-6f62-11ef-bcea-c7b262605968.client24823/status') 2024-09-10T11:01:20.782 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.558+0000 7f3f6244a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T11:01:20.782 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.716+0000 7f3f6244a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T11:01:20.782 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.781+0000 7f3f6244a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T11:01:20.787 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:20.486+0000 7f74eae24040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:01:20.787 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:20.552+0000 7f74eae24040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T11:01:20.788 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:20.712+0000 7f74eae24040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T11:01:20.788 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:20.786+0000 7f74eae24040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T11:01:20.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:01:20.813 INFO:teuthology.orchestra.run.smithi059.stdout:instance: client.24823 (3)172.21.15.59:0/3237924386 2024-09-10T11:01:20.814 INFO:teuthology.orchestra.run.smithi059.stdout:blocklisted: false 2024-09-10T11:01:20.814 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2024-09-10T11:01:20.814 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2024-09-10T11:01:20.814 INFO:teuthology.orchestra.run.smithi059.stderr:71 bytes copied, 2.5129e-05 s, 2.8 MB/s 2024-09-10T11:01:20.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:01:20.821 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T11:01:20.830 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T11:01:20.830 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:01:20.831 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-10T11:01:20.954 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.740+0000 7f4d20baa040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T11:01:20.954 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.805+0000 7f4d20baa040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T11:01:20.955 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.870+0000 7f4d20baa040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T11:01:20.955 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:20.953+0000 7f4d20baa040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T11:01:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 -- 172.21.15.59:0/1498906243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 msgr2=0x7f8fe4100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 --2- 172.21.15.59:0/1498906243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 0x7f8fe4100e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009900 tx=0x7f8fe002a410 comp rx=0 tx=0).stop 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 -- 172.21.15.59:0/1498906243 shutdown_connections 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 --2- 172.21.15.59:0/1498906243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe41025f0 0x7f8fe4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 --2- 172.21.15.59:0/1498906243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe4101c30 0x7f8fe41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 --2- 172.21.15.59:0/1498906243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 0x7f8fe4100e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 -- 172.21.15.59:0/1498906243 >> 172.21.15.59:0/1498906243 conn(0x7f8fe40fc1e0 msgr2=0x7f8fe40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 -- 172.21.15.59:0/1498906243 shutdown_connections 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 -- 172.21.15.59:0/1498906243 wait complete. 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.966+0000 7f8feba9b640 1 Processor -- start 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8feba9b640 1 -- start start 2024-09-10T11:01:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8feba9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 0x7f8fe4197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8feba9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe4101c30 0x7f8fe4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8feba9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe41025f0 0x7f8fe419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8feba9b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe410c6a0 con 0x7f8fe4100a40 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8feba9b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe410c520 con 0x7f8fe41025f0 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8feba9b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe410c820 con 0x7f8fe4101c30 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9837640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 0x7f8fe4197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9837640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 0x7f8fe4197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39514/0 (socket says 172.21.15.59:39514) 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9837640 1 -- 172.21.15.59:0/795649619 learned_addr learned my addr 172.21.15.59:0/795649619 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9036640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe4101c30 0x7f8fe4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fea038640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe41025f0 0x7f8fe419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9837640 1 -- 172.21.15.59:0/795649619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe4101c30 msgr2=0x7f8fe4198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9837640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe4101c30 0x7f8fe4198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9837640 1 -- 172.21.15.59:0/795649619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe41025f0 msgr2=0x7f8fe419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9837640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe41025f0 0x7f8fe419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9837640 1 -- 172.21.15.59:0/795649619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe419fa60 con 0x7f8fe4100a40 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fea038640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe41025f0 0x7f8fe419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.967+0000 7f8fe9036640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe4101c30 0x7f8fe4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.968+0000 7f8fe9837640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 0x7f8fe4197e40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0031610 tx=0x7f8fe0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.968+0000 7f8fdaffd640 1 -- 172.21.15.59:0/795649619 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe003f030 con 0x7f8fe4100a40 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.968+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe419fcf0 con 0x7f8fe4100a40 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.968+0000 7f8fdaffd640 1 -- 172.21.15.59:0/795649619 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe0003ad0 con 0x7f8fe4100a40 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.968+0000 7f8fdaffd640 1 -- 172.21.15.59:0/795649619 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0035070 con 0x7f8fe4100a40 2024-09-10T11:01:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.968+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe41a0180 con 0x7f8fe4100a40 2024-09-10T11:01:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.969+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe41a03b0 con 0x7f8fe4100a40 2024-09-10T11:01:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.970+0000 7f8fdaffd640 1 -- 172.21.15.59:0/795649619 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f8fe0042030 con 0x7f8fe4100a40 2024-09-10T11:01:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.971+0000 7f8fdaffd640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8fd00a2c80 0x7f8fd00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.971+0000 7f8fe9036640 1 -- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8fd00a2c80 msgr2=0x7f8fd00a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3145930564 2024-09-10T11:01:20.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.971+0000 7f8fdaffd640 1 -- 172.21.15.59:0/795649619 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f8fe00ef960 con 0x7f8fe4100a40 2024-09-10T11:01:20.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.971+0000 7f8fe9036640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8fd00a2c80 0x7f8fd00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:01:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:20.974+0000 7f8fdaffd640 1 -- 172.21.15.59:0/795649619 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fe00bc820 con 0x7f8fe4100a40 2024-09-10T11:01:21.052 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.848+0000 7f3f6244a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T11:01:21.052 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.929+0000 7f3f6244a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T11:01:21.052 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:20.990+0000 7f3f6244a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T11:01:21.052 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:21 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:21.050+0000 7f3f6244a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T11:01:21.093 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:20.850+0000 7f74eae24040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T11:01:21.093 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:21.022+0000 7f74eae24040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T11:01:21.093 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:21.091+0000 7f74eae24040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T11:01:21.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.172+0000 7f8fe9036640 1 -- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8fd00a2c80 msgr2=0x7f8fd00a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3145930564 2024-09-10T11:01:21.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.172+0000 7f8fe9036640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8fd00a2c80 0x7f8fd00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T11:01:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.191+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f8fe41a0780 con 0x7f8fe4100a40 2024-09-10T11:01:21.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.243+0000 7f8fdaffd640 1 -- 172.21.15.59:0/795649619 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f8fe00bc120 con 0x7f8fe4100a40 2024-09-10T11:01:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8fd00a2c80 msgr2=0x7f8fd00a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:01:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8fd00a2c80 0x7f8fd00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 msgr2=0x7f8fe4197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 0x7f8fe4197e40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0031610 tx=0x7f8fe0004270 comp rx=0 tx=0).stop 2024-09-10T11:01:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 shutdown_connections 2024-09-10T11:01:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f8fd00a2c80 0x7f8fd00a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe41025f0 0x7f8fe419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe4101c30 0x7f8fe4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 --2- 172.21.15.59:0/795649619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fe4100a40 0x7f8fe4197e40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.245+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 >> 172.21.15.59:0/795649619 conn(0x7f8fe40fc1e0 msgr2=0x7f8fe40698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.246+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 shutdown_connections 2024-09-10T11:01:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.246+0000 7f8feba9b640 1 -- 172.21.15.59:0/795649619 wait complete. 2024-09-10T11:01:21.250 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:21.015+0000 7f4d20baa040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T11:01:21.250 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:21.074+0000 7f4d20baa040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T11:01:21.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-10T11:01:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 -- 172.21.15.59:0/3364587542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db8100a40 msgr2=0x7f0db8100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 --2- 172.21.15.59:0/3364587542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db8100a40 0x7f0db8100e40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009900 tx=0x7f0dac02a410 comp rx=0 tx=0).stop 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 -- 172.21.15.59:0/3364587542 shutdown_connections 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 --2- 172.21.15.59:0/3364587542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0db81025f0 0x7f0db8108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 --2- 172.21.15.59:0/3364587542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db8101c30 0x7f0db81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 --2- 172.21.15.59:0/3364587542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db8100a40 0x7f0db8100e40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 -- 172.21.15.59:0/3364587542 >> 172.21.15.59:0/3364587542 conn(0x7f0db80fc1e0 msgr2=0x7f0db80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 -- 172.21.15.59:0/3364587542 shutdown_connections 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 -- 172.21.15.59:0/3364587542 wait complete. 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 Processor -- start 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.366+0000 7f0dbec3c640 1 -- start start 2024-09-10T11:01:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbec3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db8100a40 0x7f0db806a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbec3c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0db8101c30 0x7f0db819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbec3c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db81025f0 0x7f0db819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbec3c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0db810c6a0 con 0x7f0db8100a40 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbec3c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0db810c520 con 0x7f0db8101c30 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbec3c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0db810c820 con 0x7f0db81025f0 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbc9d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db8100a40 0x7f0db806a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbc9d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db8100a40 0x7f0db806a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39542/0 (socket says 172.21.15.59:39542) 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbc9d8640 1 -- 172.21.15.59:0/1367130478 learned_addr learned my addr 172.21.15.59:0/1367130478 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbd1d9640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db81025f0 0x7f0db819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0db7fff640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0db8101c30 0x7f0db819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbc9d8640 1 -- 172.21.15.59:0/1367130478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db81025f0 msgr2=0x7f0db819f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbc9d8640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0db81025f0 0x7f0db819f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbc9d8640 1 -- 172.21.15.59:0/1367130478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0db8101c30 msgr2=0x7f0db819cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbc9d8640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0db8101c30 0x7f0db819cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbc9d8640 1 -- 172.21.15.59:0/1367130478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db819fa20 con 0x7f0db8100a40 2024-09-10T11:01:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0dbc9d8640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db8100a40 0x7f0db806a450 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0dac031610 tx=0x7f0dac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.367+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac03f030 con 0x7f0db8100a40 2024-09-10T11:01:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.368+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db819fcb0 con 0x7f0db8100a40 2024-09-10T11:01:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.368+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dac003ad0 con 0x7f0db8100a40 2024-09-10T11:01:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.368+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac035070 con 0x7f0db8100a40 2024-09-10T11:01:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.368+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db81a01a0 con 0x7f0db8100a40 2024-09-10T11:01:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.369+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db8107e30 con 0x7f0db8100a40 2024-09-10T11:01:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.370+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f0dac042030 con 0x7f0db8100a40 2024-09-10T11:01:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.370+0000 7f0db5ffb640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f0da80a2c80 0x7f0da80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.371+0000 7f0db7fff640 1 -- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f0da80a2c80 msgr2=0x7f0da80a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3145930564 2024-09-10T11:01:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.371+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8298+0+0 (secure 0 0 0) 0x7f0dac0ef950 con 0x7f0db8100a40 2024-09-10T11:01:21.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.371+0000 7f0db7fff640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f0da80a2c80 0x7f0da80a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:01:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.374+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0dac0bc810 con 0x7f0db8100a40 2024-09-10T11:01:21.383 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:21 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/795649619' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-10T11:01:21.384 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:21.162+0000 7f74eae24040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T11:01:21.384 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:21.251+0000 7f74eae24040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T11:01:21.384 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:21.316+0000 7f74eae24040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T11:01:21.384 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:21.382+0000 7f74eae24040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T11:01:21.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:21 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/795649619' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-10T11:01:21.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.572+0000 7f0db7fff640 1 -- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f0da80a2c80 msgr2=0x7f0da80a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3145930564 2024-09-10T11:01:21.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.572+0000 7f0db7fff640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f0da80a2c80 0x7f0da80a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T11:01:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.577+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 --> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f0db8062790 con 0x7f0da80a2c80 2024-09-10T11:01:21.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:21 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/795649619' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-10T11:01:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.973+0000 7f0db7fff640 1 -- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f0da80a2c80 msgr2=0x7f0da80a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.59:6800/3145930564 2024-09-10T11:01:21.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:21.973+0000 7f0db7fff640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f0da80a2c80 0x7f0da80a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T11:01:22.186 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:01:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z[37207]: 2024-09-10T11:01:21.868+0000 7f4d20baa040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T11:01:22.208 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:01:21 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y[36084]: 2024-09-10T11:01:21.847+0000 7f3f6244a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T11:01:22.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:22.227+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7f0dac0035f0 con 0x7f0db8100a40 2024-09-10T11:01:22.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:22.227+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f0da80a2c80 msgr2=0x7f0da80a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:01:22.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:22.227+0000 7f0db5ffb640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3145930564,v1:172.21.15.59:6801/3145930564] conn(0x7f0da80a2c80 0x7f0da80a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:22.553 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/795649619' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: Standby manager daemon y restarted 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: Standby manager daemon y started 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: Standby manager daemon z restarted 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: Standby manager daemon z started 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T11:01:22.554 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: Active manager daemon x restarted 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: Activating manager daemon x 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: mgrmap e20: x(active, starting, since 0.0124569s), standbys: y, z 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T11:01:22.555 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:01:22.556 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T11:01:22.557 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:22 smithi115 ceph-mon[34719]: Manager daemon x is now available 2024-09-10T11:01:22.575 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.215+0000 7f74eae24040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T11:01:22.575 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.452+0000 7f74527b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.452+0000 7f74527b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.452+0000 7f74527b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.452+0000 7f74527b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.452+0000 7f74527b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.453+0000 7f74557bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.453+0000 7f74557bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.453+0000 7f74557bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.453+0000 7f74557bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:22.453+0000 7f74557bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:22.576 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/795649619' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T11:01:22.577 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T11:01:22.577 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: Standby manager daemon y restarted 2024-09-10T11:01:22.577 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: Standby manager daemon y started 2024-09-10T11:01:22.577 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T11:01:22.577 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:01:22.577 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T11:01:22.577 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:01:22.577 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: Standby manager daemon z restarted 2024-09-10T11:01:22.579 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: Standby manager daemon z started 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: Active manager daemon x restarted 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: Activating manager daemon x 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: mgrmap e20: x(active, starting, since 0.0124569s), standbys: y, z 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:01:22.580 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:01:22.581 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:01:22.582 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:01:22.583 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:01:22.583 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T11:01:22.583 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T11:01:22.583 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T11:01:22.583 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:22 smithi059 ceph-mon[30978]: Manager daemon x is now available 2024-09-10T11:01:22.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/795649619' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T11:01:22.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T11:01:22.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: Standby manager daemon y restarted 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: Standby manager daemon y started 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.115:0/1106045969' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: Standby manager daemon z restarted 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: Standby manager daemon z started 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.? 172.21.15.181:0/1158941118' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: Active manager daemon x restarted 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: Activating manager daemon x 2024-09-10T11:01:22.621 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: mgrmap e20: x(active, starting, since 0.0124569s), standbys: y, z 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:01:22.622 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:01:22.623 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T11:01:22.624 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:22 smithi181 ceph-mon[35409]: Manager daemon x is now available 2024-09-10T11:01:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.236+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f0dac0ed430 con 0x7f0db8100a40 2024-09-10T11:01:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.237+0000 7f0db5ffb640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0da80518f0 0x7f0da8051cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.237+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 --> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f0dac04aec0 con 0x7f0da80518f0 2024-09-10T11:01:23.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.239+0000 7f0db7fff640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0da80518f0 0x7f0da8051cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:23.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.241+0000 7f0db7fff640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0da80518f0 0x7f0da8051cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0db806a1c0 tx=0x7f0da4005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.262+0000 7f0db5ffb640 1 -- 172.21.15.59:0/1367130478 <== mgr.15132 v2:172.21.15.59:6800/3897711076 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f0dac04aec0 con 0x7f0da80518f0 2024-09-10T11:01:23.264 INFO:teuthology.orchestra.run.smithi059.stdout:{} 2024-09-10T11:01:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.265+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0da80518f0 msgr2=0x7f0da8051cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.265+0000 7f0dbec3c640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0da80518f0 0x7f0da8051cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0db806a1c0 tx=0x7f0da4005f90 comp rx=0 tx=0).stop 2024-09-10T11:01:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.265+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db8100a40 msgr2=0x7f0db806a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.265+0000 7f0dbec3c640 1 --2- 172.21.15.59:0/1367130478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0db8100a40 0x7f0db806a450 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0dac031610 tx=0x7f0dac004270 comp rx=0 tx=0).stop 2024-09-10T11:01:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.265+0000 7f0dbd1d9640 1 -- 172.21.15.59:0/1367130478 reap_dead start 2024-09-10T11:01:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.265+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 shutdown_connections 2024-09-10T11:01:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.265+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 >> 172.21.15.59:0/1367130478 conn(0x7f0db80fc1e0 msgr2=0x7f0db8105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.265+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 shutdown_connections 2024-09-10T11:01:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.265+0000 7f0dbec3c640 1 -- 172.21.15.59:0/1367130478 wait complete. 2024-09-10T11:01:23.281 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T11:01:23.292 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T11:01:23.307 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T11:01:23.307 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:01:23.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.410+0000 7fd86e4dd640 1 -- 172.21.15.59:0/2620722938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8681025f0 msgr2=0x7fd868108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.410+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/2620722938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8681025f0 0x7fd868108e80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd860009ca0 tx=0x7fd86002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.411+0000 7fd86e4dd640 1 -- 172.21.15.59:0/2620722938 shutdown_connections 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.411+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/2620722938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8681025f0 0x7fd868108e80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.411+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/2620722938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd868101c30 0x7fd8681020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.411+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/2620722938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd868100a40 0x7fd868100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.411+0000 7fd86e4dd640 1 -- 172.21.15.59:0/2620722938 >> 172.21.15.59:0/2620722938 conn(0x7fd8680fc1e0 msgr2=0x7fd8680fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.411+0000 7fd86e4dd640 1 -- 172.21.15.59:0/2620722938 shutdown_connections 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.411+0000 7fd86e4dd640 1 -- 172.21.15.59:0/2620722938 wait complete. 2024-09-10T11:01:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.411+0000 7fd86e4dd640 1 Processor -- start 2024-09-10T11:01:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.411+0000 7fd86e4dd640 1 -- start start 2024-09-10T11:01:23.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd86e4dd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd868100a40 0x7fd868197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd86e4dd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd868101c30 0x7fd868198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd86e4dd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8681025f0 0x7fd86819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd86e4dd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd86810d810 con 0x7fd868101c30 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd86e4dd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd86810d690 con 0x7fd8681025f0 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd86e4dd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd86810d990 con 0x7fd868100a40 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd868101c30 0x7fd868198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd868101c30 0x7fd868198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39700/0 (socket says 172.21.15.59:39700) 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8677fe640 1 -- 172.21.15.59:0/3617625459 learned_addr learned my addr 172.21.15.59:0/3617625459 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd86ca7a640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8681025f0 0x7fd86819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd867fff640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd868100a40 0x7fd868197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8677fe640 1 -- 172.21.15.59:0/3617625459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd868100a40 msgr2=0x7fd868197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8677fe640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd868100a40 0x7fd868197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8677fe640 1 -- 172.21.15.59:0/3617625459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8681025f0 msgr2=0x7fd86819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8677fe640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8681025f0 0x7fd86819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8677fe640 1 -- 172.21.15.59:0/3617625459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86819f970 con 0x7fd868101c30 2024-09-10T11:01:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8677fe640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd868101c30 0x7fd868198290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00e9f0 tx=0x7fd85c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8657fa640 1 -- 172.21.15.59:0/3617625459 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00cd80 con 0x7fd868101c30 2024-09-10T11:01:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86819fc60 con 0x7fd868101c30 2024-09-10T11:01:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8657fa640 1 -- 172.21.15.59:0/3617625459 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd85c010910 con 0x7fd868101c30 2024-09-10T11:01:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd8657fa640 1 -- 172.21.15.59:0/3617625459 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0188f0 con 0x7fd868101c30 2024-09-10T11:01:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.412+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8681a01b0 con 0x7fd868101c30 2024-09-10T11:01:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.413+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd868107d00 con 0x7fd868101c30 2024-09-10T11:01:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.415+0000 7fd8657fa640 1 -- 172.21.15.59:0/3617625459 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fd85c010ac0 con 0x7fd868101c30 2024-09-10T11:01:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.415+0000 7fd8657fa640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd8500a2a40 0x7fd8500a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.415+0000 7fd867fff640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd8500a2a40 0x7fd8500a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.415+0000 7fd8657fa640 1 -- 172.21.15.59:0/3617625459 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fd85c0cf130 con 0x7fd868101c30 2024-09-10T11:01:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.416+0000 7fd867fff640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd8500a2a40 0x7fd8500a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd868101a90 tx=0x7fd858005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:23.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.419+0000 7fd8657fa640 1 -- 172.21.15.59:0/3617625459 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd85c09bbf0 con 0x7fd868101c30 2024-09-10T11:01:23.518 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:23 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:01:23.518 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:23 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T11:01:23.518 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:23 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T11:01:23.518 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:23 smithi115 ceph-mon[34719]: mgrmap e21: x(active, since 1.02111s), standbys: y, z 2024-09-10T11:01:23.586 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:23.249+0000 7f744f7b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:23.586 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:23.249+0000 7f744f7b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:23.586 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:23.249+0000 7f744f7b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:23.586 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:23.249+0000 7f744f7b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:23.587 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:23.249+0000 7f744f7b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:01:23.587 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:23 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:01:23.587 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:23 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T11:01:23.587 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:23 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T11:01:23.587 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:23 smithi059 ceph-mon[30978]: mgrmap e21: x(active, since 1.02111s), standbys: y, z 2024-09-10T11:01:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.610+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fd868062e60 con 0x7fd868101c30 2024-09-10T11:01:23.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.614+0000 7fd8657fa640 1 -- 172.21.15.59:0/3617625459 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v30)=0 v30) ==== 129+0+0 (secure 0 0 0) 0x7fd85c09fef0 con 0x7fd868101c30 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd8500a2a40 msgr2=0x7fd8500a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd8500a2a40 0x7fd8500a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd868101a90 tx=0x7fd858005f90 comp rx=0 tx=0).stop 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd868101c30 msgr2=0x7fd868198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd868101c30 0x7fd868198290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00e9f0 tx=0x7fd85c00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 shutdown_connections 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8681025f0 0x7fd86819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd868101c30 0x7fd868198290 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd8500a2a40 0x7fd8500a4f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 --2- 172.21.15.59:0/3617625459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd868100a40 0x7fd868197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 >> 172.21.15.59:0/3617625459 conn(0x7fd8680fc1e0 msgr2=0x7fd868104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 shutdown_connections 2024-09-10T11:01:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.616+0000 7fd86e4dd640 1 -- 172.21.15.59:0/3617625459 wait complete. 2024-09-10T11:01:23.619 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:23 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:01:23.619 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:23 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T11:01:23.619 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:23 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T11:01:23.619 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:23 smithi181 ceph-mon[35409]: mgrmap e21: x(active, since 1.02111s), standbys: y, z 2024-09-10T11:01:23.630 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-10T11:01:23.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 -- 172.21.15.59:0/3759899095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 msgr2=0x7fe02c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 --2- 172.21.15.59:0/3759899095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 0x7fe02c1031d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe014009900 tx=0x7fe01402a410 comp rx=0 tx=0).stop 2024-09-10T11:01:23.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 -- 172.21.15.59:0/3759899095 shutdown_connections 2024-09-10T11:01:23.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 --2- 172.21.15.59:0/3759899095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c103710 0x7fe02c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 --2- 172.21.15.59:0/3759899095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 0x7fe02c1031d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 --2- 172.21.15.59:0/3759899095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c101b60 0x7fe02c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 -- 172.21.15.59:0/3759899095 >> 172.21.15.59:0/3759899095 conn(0x7fe02c0fd2e0 msgr2=0x7fe02c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:23.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 -- 172.21.15.59:0/3759899095 shutdown_connections 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 -- 172.21.15.59:0/3759899095 wait complete. 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.734+0000 7fe031713640 1 Processor -- start 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe031713640 1 -- start start 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe031713640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c101b60 0x7fe02c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe031713640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 0x7fe02c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe031713640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c103710 0x7fe02c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe031713640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10d810 con 0x7fe02c102d50 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe031713640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10d690 con 0x7fe02c103710 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe031713640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10d990 con 0x7fe02c101b60 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 0x7fe02c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 0x7fe02c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39724/0 (socket says 172.21.15.59:39724) 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02a7fc640 1 -- 172.21.15.59:0/114774999 learned_addr learned my addr 172.21.15.59:0/114774999 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:23.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02affd640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c101b60 0x7fe02c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02b7fe640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c103710 0x7fe02c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02a7fc640 1 -- 172.21.15.59:0/114774999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c101b60 msgr2=0x7fe02c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02a7fc640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c101b60 0x7fe02c075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02a7fc640 1 -- 172.21.15.59:0/114774999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c103710 msgr2=0x7fe02c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02a7fc640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c103710 0x7fe02c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02a7fc640 1 -- 172.21.15.59:0/114774999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c0753b0 con 0x7fe02c102d50 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02b7fe640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c103710 0x7fe02c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.735+0000 7fe02a7fc640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 0x7fe02c0745e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe014031440 tx=0x7fe014032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.736+0000 7fe023fff640 1 -- 172.21.15.59:0/114774999 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01403f030 con 0x7fe02c102d50 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.736+0000 7fe023fff640 1 -- 172.21.15.59:0/114774999 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe014003ce0 con 0x7fe02c102d50 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.736+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c1a1ec0 con 0x7fe02c102d50 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.736+0000 7fe023fff640 1 -- 172.21.15.59:0/114774999 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014035070 con 0x7fe02c102d50 2024-09-10T11:01:23.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.736+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c1a2330 con 0x7fe02c102d50 2024-09-10T11:01:23.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.737+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02c108e80 con 0x7fe02c102d50 2024-09-10T11:01:23.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.738+0000 7fe023fff640 1 -- 172.21.15.59:0/114774999 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fe014042030 con 0x7fe02c102d50 2024-09-10T11:01:23.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.738+0000 7fe023fff640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe0180a2ac0 0x7fe0180a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:23.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.739+0000 7fe023fff640 1 -- 172.21.15.59:0/114774999 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fe0140ef230 con 0x7fe02c102d50 2024-09-10T11:01:23.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.739+0000 7fe02affd640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe0180a2ac0 0x7fe0180a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:23.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.739+0000 7fe02affd640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe0180a2ac0 0x7fe0180a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe02c102bb0 tx=0x7fe01c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:23.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.743+0000 7fe023fff640 1 -- 172.21.15.59:0/114774999 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0140bc340 con 0x7fe02c102d50 2024-09-10T11:01:23.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.925+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fe02c062ef0 con 0x7fe02c102d50 2024-09-10T11:01:23.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.929+0000 7fe023fff640 1 -- 172.21.15.59:0/114774999 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7fe0140bbc40 con 0x7fe02c102d50 2024-09-10T11:01:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe0180a2ac0 msgr2=0x7fe0180a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe0180a2ac0 0x7fe0180a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe02c102bb0 tx=0x7fe01c005f90 comp rx=0 tx=0).stop 2024-09-10T11:01:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 msgr2=0x7fe02c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 0x7fe02c0745e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe014031440 tx=0x7fe014032ce0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 shutdown_connections 2024-09-10T11:01:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe02c103710 0x7fe02c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c102d50 0x7fe02c0745e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe0180a2ac0 0x7fe0180a4f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 --2- 172.21.15.59:0/114774999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe02c101b60 0x7fe02c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 >> 172.21.15.59:0/114774999 conn(0x7fe02c0fd2e0 msgr2=0x7fe02c106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 shutdown_connections 2024-09-10T11:01:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:23.932+0000 7fe031713640 1 -- 172.21.15.59:0/114774999 wait complete. 2024-09-10T11:01:23.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 -- 172.21.15.59:0/2128313183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 msgr2=0x7f315c108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 --2- 172.21.15.59:0/2128313183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 0x7f315c108e90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3154009ca0 tx=0x7f315402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 -- 172.21.15.59:0/2128313183 shutdown_connections 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 --2- 172.21.15.59:0/2128313183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 0x7f315c108e90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 --2- 172.21.15.59:0/2128313183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315c101c40 0x7f315c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 --2- 172.21.15.59:0/2128313183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c100a50 0x7f315c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 -- 172.21.15.59:0/2128313183 >> 172.21.15.59:0/2128313183 conn(0x7f315c0fc1b0 msgr2=0x7f315c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 -- 172.21.15.59:0/2128313183 shutdown_connections 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 -- 172.21.15.59:0/2128313183 wait complete. 2024-09-10T11:01:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.057+0000 7f3161349640 1 Processor -- start 2024-09-10T11:01:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f3161349640 1 -- start start 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f3161349640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315c100a50 0x7f315c199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f3161349640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c101c40 0x7f315c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f3161349640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 0x7f315c1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f3161349640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f315c10c6b0 con 0x7f315c102600 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f3161349640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f315c10c530 con 0x7f315c100a50 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f3161349640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f315c10c830 con 0x7f315c101c40 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 0x7f315c1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 0x7f315c1a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39734/0 (socket says 172.21.15.59:39734) 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315b7fe640 1 -- 172.21.15.59:0/3279504277 learned_addr learned my addr 172.21.15.59:0/3279504277 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315a7fc640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c101c40 0x7f315c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315affd640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315c100a50 0x7f315c199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315b7fe640 1 -- 172.21.15.59:0/3279504277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c101c40 msgr2=0x7f315c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315b7fe640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c101c40 0x7f315c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315b7fe640 1 -- 172.21.15.59:0/3279504277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315c100a50 msgr2=0x7f315c199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315b7fe640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315c100a50 0x7f315c199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315b7fe640 1 -- 172.21.15.59:0/3279504277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c1a1b90 con 0x7f315c102600 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315a7fc640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c101c40 0x7f315c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315affd640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315c100a50 0x7f315c199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.058+0000 7f315b7fe640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 0x7f315c1a1520 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3154031ae0 tx=0x7f3154031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.059+0000 7f3143fff640 1 -- 172.21.15.59:0/3279504277 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154003b70 con 0x7f315c102600 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.059+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c1a1e20 con 0x7f315c102600 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.059+0000 7f3143fff640 1 -- 172.21.15.59:0/3279504277 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3154003d10 con 0x7f315c102600 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.059+0000 7f3143fff640 1 -- 172.21.15.59:0/3279504277 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315402fc40 con 0x7f315c102600 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.059+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c1a2330 con 0x7f315c102600 2024-09-10T11:01:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.060+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c1a2590 con 0x7f315c102600 2024-09-10T11:01:24.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.061+0000 7f3143fff640 1 -- 172.21.15.59:0/3279504277 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f3154004050 con 0x7f315c102600 2024-09-10T11:01:24.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.062+0000 7f3143fff640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f31440a2a40 0x7f31440a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.062+0000 7f3143fff640 1 -- 172.21.15.59:0/3279504277 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f31540efe40 con 0x7f315c102600 2024-09-10T11:01:24.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.062+0000 7f315affd640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f31440a2a40 0x7f31440a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.062+0000 7f315affd640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f31440a2a40 0x7f31440a4f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f315c101aa0 tx=0x7f314c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:24.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.068+0000 7f3143fff640 1 -- 172.21.15.59:0/3279504277 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31540bd030 con 0x7f315c102600 2024-09-10T11:01:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.257+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f315c1a2760 con 0x7f315c102600 2024-09-10T11:01:24.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.262+0000 7f3143fff640 1 -- 172.21.15.59:0/3279504277 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v32)=0 v32) ==== 133+0+0 (secure 0 0 0) 0x7f31540bc930 con 0x7f315c102600 2024-09-10T11:01:24.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f31440a2a40 msgr2=0x7f31440a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f31440a2a40 0x7f31440a4f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f315c101aa0 tx=0x7f314c005f90 comp rx=0 tx=0).stop 2024-09-10T11:01:24.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 msgr2=0x7f315c1a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 0x7f315c1a1520 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3154031ae0 tx=0x7f3154031ee0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 shutdown_connections 2024-09-10T11:01:24.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315c102600 0x7f315c1a1520 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f31440a2a40 0x7f31440a4f00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f315c101c40 0x7f315c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 --2- 172.21.15.59:0/3279504277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315c100a50 0x7f315c199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 >> 172.21.15.59:0/3279504277 conn(0x7f315c0fc1b0 msgr2=0x7f315c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 shutdown_connections 2024-09-10T11:01:24.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.264+0000 7f3161349640 1 -- 172.21.15.59:0/3279504277 wait complete. 2024-09-10T11:01:24.279 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:24.136+0000 7f7439e46640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:11:01:24] ENGINE Error in HTTPServer.serve 2024-09-10T11:01:24.279 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: Traceback (most recent call last): 2024-09-10T11:01:24.279 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T11:01:24.279 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self._connections.run(self.expiration_interval) 2024-09-10T11:01:24.279 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T11:01:24.279 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self._run(expiration_interval) 2024-09-10T11:01:24.279 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T11:01:24.279 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: s = self.context.wrap_socket( 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: return self.sslsocket_class._create( 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self.do_handshake() 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: self._sslobj.do_handshake() 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T11:01:24.280 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:01:24.281 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-10T11:01:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.395+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1776409331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 msgr2=0x7fd6ec108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.395+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1776409331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 0x7fd6ec108e80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009ca0 tx=0x7fd6e402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.395+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1776409331 shutdown_connections 2024-09-10T11:01:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.395+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1776409331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 0x7fd6ec108e80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.395+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1776409331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6ec101c30 0x7fd6ec1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.395+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1776409331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6ec100a40 0x7fd6ec100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.395+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1776409331 >> 172.21.15.59:0/1776409331 conn(0x7fd6ec0fc1e0 msgr2=0x7fd6ec0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.395+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1776409331 shutdown_connections 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.395+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1776409331 wait complete. 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f41d8640 1 Processor -- start 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f41d8640 1 -- start start 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f41d8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6ec100a40 0x7fd6ec197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f41d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6ec101c30 0x7fd6ec1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f41d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 0x7fd6ec19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f41d8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec10c6f0 con 0x7fd6ec1025f0 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f41d8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec10c570 con 0x7fd6ec100a40 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f41d8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec10c870 con 0x7fd6ec101c30 2024-09-10T11:01:24.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f2775640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 0x7fd6ec19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f2775640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 0x7fd6ec19f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39780/0 (socket says 172.21.15.59:39780) 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f2775640 1 -- 172.21.15.59:0/1264566969 learned_addr learned my addr 172.21.15.59:0/1264566969 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f1f74640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6ec100a40 0x7fd6ec197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f1773640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6ec101c30 0x7fd6ec1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f2775640 1 -- 172.21.15.59:0/1264566969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6ec101c30 msgr2=0x7fd6ec1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f2775640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6ec101c30 0x7fd6ec1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f2775640 1 -- 172.21.15.59:0/1264566969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6ec100a40 msgr2=0x7fd6ec197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f2775640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6ec100a40 0x7fd6ec197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f2775640 1 -- 172.21.15.59:0/1264566969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec19f980 con 0x7fd6ec1025f0 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.396+0000 7fd6f1f74640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6ec100a40 0x7fd6ec197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.397+0000 7fd6f2775640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 0x7fd6ec19f310 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd6e402f540 tx=0x7fd6e4031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.397+0000 7fd6e2ffd640 1 -- 172.21.15.59:0/1264566969 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4003b70 con 0x7fd6ec1025f0 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.397+0000 7fd6e2ffd640 1 -- 172.21.15.59:0/1264566969 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6e4003d10 con 0x7fd6ec1025f0 2024-09-10T11:01:24.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.397+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ec19fc10 con 0x7fd6ec1025f0 2024-09-10T11:01:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.397+0000 7fd6e2ffd640 1 -- 172.21.15.59:0/1264566969 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e402fb50 con 0x7fd6ec1025f0 2024-09-10T11:01:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.397+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ec1a01b0 con 0x7fd6ec1025f0 2024-09-10T11:01:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.398+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6ec1a0380 con 0x7fd6ec1025f0 2024-09-10T11:01:24.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.399+0000 7fd6e2ffd640 1 -- 172.21.15.59:0/1264566969 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fd6e402fcf0 con 0x7fd6ec1025f0 2024-09-10T11:01:24.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.401+0000 7fd6e2ffd640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd6d80a2ac0 0x7fd6d80a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.401+0000 7fd6f1f74640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd6d80a2ac0 0x7fd6d80a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.401+0000 7fd6e2ffd640 1 -- 172.21.15.59:0/1264566969 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fd6e40f00a0 con 0x7fd6ec1025f0 2024-09-10T11:01:24.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.401+0000 7fd6f1f74640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd6d80a2ac0 0x7fd6d80a4f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec101a90 tx=0x7fd6e8005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:24.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.406+0000 7fd6e2ffd640 1 -- 172.21.15.59:0/1264566969 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6e40bd1b0 con 0x7fd6ec1025f0 2024-09-10T11:01:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.606+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 --> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fd6ec1a0550 con 0x7fd6d80a2ac0 2024-09-10T11:01:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.669+0000 7fd6e2ffd640 1 -- 172.21.15.59:0/1264566969 <== mgr.15132 v2:172.21.15.59:6800/3897711076 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd6ec1a0550 con 0x7fd6d80a2ac0 2024-09-10T11:01:24.670 INFO:teuthology.orchestra.run.smithi059.stdout:Schedule set for path / 2024-09-10T11:01:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd6d80a2ac0 msgr2=0x7fd6d80a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd6d80a2ac0 0x7fd6d80a4f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec101a90 tx=0x7fd6e8005f90 comp rx=0 tx=0).stop 2024-09-10T11:01:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 msgr2=0x7fd6ec19f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 0x7fd6ec19f310 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd6e402f540 tx=0x7fd6e4031750 comp rx=0 tx=0).stop 2024-09-10T11:01:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 shutdown_connections 2024-09-10T11:01:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6ec1025f0 0x7fd6ec19f310 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fd6d80a2ac0 0x7fd6d80a4f80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6ec101c30 0x7fd6ec1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 --2- 172.21.15.59:0/1264566969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6ec100a40 0x7fd6ec197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 >> 172.21.15.59:0/1264566969 conn(0x7fd6ec0fc1e0 msgr2=0x7fd6ec0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 shutdown_connections 2024-09-10T11:01:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.671+0000 7fd6f41d8640 1 -- 172.21.15.59:0/1264566969 wait complete. 2024-09-10T11:01:24.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-10T11:01:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 -- 172.21.15.59:0/1263853744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 msgr2=0x7fadf01072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 --2- 172.21.15.59:0/1263853744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 0x7fadf01072f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fade4009900 tx=0x7fade402a410 comp rx=0 tx=0).stop 2024-09-10T11:01:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 -- 172.21.15.59:0/1263853744 shutdown_connections 2024-09-10T11:01:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 --2- 172.21.15.59:0/1263853744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf0107830 0x7fadf0109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 --2- 172.21.15.59:0/1263853744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 0x7fadf01072f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 --2- 172.21.15.59:0/1263853744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadf01025d0 0x7fadf01049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 -- 172.21.15.59:0/1263853744 >> 172.21.15.59:0/1263853744 conn(0x7fadf00fc1b0 msgr2=0x7fadf00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 -- 172.21.15.59:0/1263853744 shutdown_connections 2024-09-10T11:01:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 -- 172.21.15.59:0/1263853744 wait complete. 2024-09-10T11:01:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.793+0000 7fadf6378640 1 Processor -- start 2024-09-10T11:01:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadf6378640 1 -- start start 2024-09-10T11:01:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadf6378640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadf01025d0 0x7fadf0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadf6378640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 0x7fadf01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadf6378640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf0107830 0x7fadf019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadf6378640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fadf010d810 con 0x7fadf0104f00 2024-09-10T11:01:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadf6378640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fadf010d690 con 0x7fadf01025d0 2024-09-10T11:01:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadf6378640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fadf010d990 con 0x7fadf0107830 2024-09-10T11:01:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadef7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 0x7fadf01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadef7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 0x7fadf01983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39808/0 (socket says 172.21.15.59:39808) 2024-09-10T11:01:24.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadef7fe640 1 -- 172.21.15.59:0/1909116838 learned_addr learned my addr 172.21.15.59:0/1909116838 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadeffff640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadf01025d0 0x7fadf0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadf4915640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf0107830 0x7fadf019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadef7fe640 1 -- 172.21.15.59:0/1909116838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf0107830 msgr2=0x7fadf019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadef7fe640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf0107830 0x7fadf019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadef7fe640 1 -- 172.21.15.59:0/1909116838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadf01025d0 msgr2=0x7fadf0197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadef7fe640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadf01025d0 0x7fadf0197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadef7fe640 1 -- 172.21.15.59:0/1909116838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf019faa0 con 0x7fadf0104f00 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.794+0000 7fadf4915640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf0107830 0x7fadf019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.795+0000 7fadef7fe640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 0x7fadf01983c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fade4031610 tx=0x7fade40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.795+0000 7faded7fa640 1 -- 172.21.15.59:0/1909116838 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade403f030 con 0x7fadf0104f00 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.795+0000 7faded7fa640 1 -- 172.21.15.59:0/1909116838 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fade4003ce0 con 0x7fadf0104f00 2024-09-10T11:01:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.795+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf019fd30 con 0x7fadf0104f00 2024-09-10T11:01:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.795+0000 7faded7fa640 1 -- 172.21.15.59:0/1909116838 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4035070 con 0x7fadf0104f00 2024-09-10T11:01:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.795+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf01a01d0 con 0x7fadf0104f00 2024-09-10T11:01:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.796+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf00fdca0 con 0x7fadf0104f00 2024-09-10T11:01:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.798+0000 7faded7fa640 1 -- 172.21.15.59:0/1909116838 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fade4042030 con 0x7fadf0104f00 2024-09-10T11:01:24.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.799+0000 7faded7fa640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fadd80a2a40 0x7fadd80a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:24.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.799+0000 7faded7fa640 1 -- 172.21.15.59:0/1909116838 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fade40ef5a0 con 0x7fadf0104f00 2024-09-10T11:01:24.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.799+0000 7fadeffff640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fadd80a2a40 0x7fadd80a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:24.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.799+0000 7fadeffff640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fadd80a2a40 0x7fadd80a4f00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fade0005d00 tx=0x7fade000b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:24.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.802+0000 7faded7fa640 1 -- 172.21.15.59:0/1909116838 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fade40bc670 con 0x7fadf0104f00 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3617625459' entity='client.admin' 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/114774999' entity='client.admin' 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: [10/Sep/2024:11:01:24] ENGINE Bus STARTING 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3279504277' entity='client.admin' 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:24 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3617625459' entity='client.admin' 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/114774999' entity='client.admin' 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: [10/Sep/2024:11:01:24] ENGINE Bus STARTING 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3279504277' entity='client.admin' 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:24 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:24.941+0000 7faded7fa640 1 -- 172.21.15.59:0/1909116838 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 22) ==== 138004+0+0 (secure 0 0 0) 0x7fade40b85e0 con 0x7fadf0104f00 2024-09-10T11:01:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3617625459' entity='client.admin' 2024-09-10T11:01:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/114774999' entity='client.admin' 2024-09-10T11:01:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: [10/Sep/2024:11:01:24] ENGINE Bus STARTING 2024-09-10T11:01:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3279504277' entity='client.admin' 2024-09-10T11:01:24.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:24.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:24 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:25.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.027+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 --> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fadf0062790 con 0x7fadd80a2a40 2024-09-10T11:01:25.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.091+0000 7faded7fa640 1 -- 172.21.15.59:0/1909116838 <== mgr.15132 v2:172.21.15.59:6800/3897711076 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fadf0062790 con 0x7fadd80a2a40 2024-09-10T11:01:25.091 INFO:teuthology.orchestra.run.smithi059.stdout:Retention added to path / 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fadd80a2a40 msgr2=0x7fadd80a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fadd80a2a40 0x7fadd80a4f00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fade0005d00 tx=0x7fade000b410 comp rx=0 tx=0).stop 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 msgr2=0x7fadf01983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 0x7fadf01983c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fade4031610 tx=0x7fade40043b0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 shutdown_connections 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fadd80a2a40 0x7fadd80a4f00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fadf0107830 0x7fadf019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadf0104f00 0x7fadf01983c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 --2- 172.21.15.59:0/1909116838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadf01025d0 0x7fadf0197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 >> 172.21.15.59:0/1909116838 conn(0x7fadf00fc1b0 msgr2=0x7fadf0102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:25.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 shutdown_connections 2024-09-10T11:01:25.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.093+0000 7fadf6378640 1 -- 172.21.15.59:0/1909116838 wait complete. 2024-09-10T11:01:25.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.214+0000 7fa699586640 1 -- 172.21.15.59:0/3758289244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6941016d0 msgr2=0x7fa694108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.214+0000 7fa699586640 1 --2- 172.21.15.59:0/3758289244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6941016d0 0x7fa694108f70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009ca0 tx=0x7fa68c02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.215+0000 7fa699586640 1 -- 172.21.15.59:0/3758289244 shutdown_connections 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.215+0000 7fa699586640 1 --2- 172.21.15.59:0/3758289244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6941016d0 0x7fa694108f70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.215+0000 7fa699586640 1 --2- 172.21.15.59:0/3758289244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa694100d10 0x7fa694101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.215+0000 7fa699586640 1 --2- 172.21.15.59:0/3758289244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa694101fe0 0x7fa6941023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.215+0000 7fa699586640 1 -- 172.21.15.59:0/3758289244 >> 172.21.15.59:0/3758289244 conn(0x7fa6940fb930 msgr2=0x7fa6940fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.215+0000 7fa699586640 1 -- 172.21.15.59:0/3758289244 shutdown_connections 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.215+0000 7fa699586640 1 -- 172.21.15.59:0/3758289244 wait complete. 2024-09-10T11:01:25.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.215+0000 7fa699586640 1 Processor -- start 2024-09-10T11:01:25.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.215+0000 7fa699586640 1 -- start start 2024-09-10T11:01:25.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa699586640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa694100d10 0x7fa69410b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa699586640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6941016d0 0x7fa694109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa699586640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa694101fe0 0x7fa694109f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa699586640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa69410d850 con 0x7fa694101fe0 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa699586640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa69410d6d0 con 0x7fa6941016d0 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa699586640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa69410d9d0 con 0x7fa694100d10 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6927fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6941016d0 0x7fa694109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6927fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6941016d0 0x7fa694109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.59:39466/0 (socket says 172.21.15.59:39466) 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa692ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa694100d10 0x7fa69410b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6927fc640 1 -- 172.21.15.59:0/3968403506 learned_addr learned my addr 172.21.15.59:0/3968403506 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6937fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa694101fe0 0x7fa694109f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6927fc640 1 -- 172.21.15.59:0/3968403506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa694100d10 msgr2=0x7fa69410b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6927fc640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa694100d10 0x7fa69410b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6927fc640 1 -- 172.21.15.59:0/3968403506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa694101fe0 msgr2=0x7fa694109f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6927fc640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa694101fe0 0x7fa694109f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6927fc640 1 -- 172.21.15.59:0/3968403506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69410a7f0 con 0x7fa6941016d0 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa692ffd640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa694100d10 0x7fa69410b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.216+0000 7fa6927fc640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6941016d0 0x7fa694109a20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa68800e9f0 tx=0x7fa68800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.217+0000 7fa67bfff640 1 -- 172.21.15.59:0/3968403506 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68800cd80 con 0x7fa6941016d0 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.217+0000 7fa67bfff640 1 -- 172.21.15.59:0/3968403506 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa688010910 con 0x7fa6941016d0 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.217+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6941a1f00 con 0x7fa6941016d0 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.217+0000 7fa67bfff640 1 -- 172.21.15.59:0/3968403506 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688018990 con 0x7fa6941016d0 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.217+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6941a2370 con 0x7fa6941016d0 2024-09-10T11:01:25.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.218+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa694107e50 con 0x7fa6941016d0 2024-09-10T11:01:25.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.219+0000 7fa67bfff640 1 -- 172.21.15.59:0/3968403506 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 22) ==== 138004+0+0 (secure 0 0 0) 0x7fa688010ac0 con 0x7fa6941016d0 2024-09-10T11:01:25.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.220+0000 7fa67bfff640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa67c0a2ec0 0x7fa67c0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:25.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.220+0000 7fa692ffd640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa67c0a2ec0 0x7fa67c0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:25.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.220+0000 7fa67bfff640 1 -- 172.21.15.59:0/3968403506 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fa6880cfcb0 con 0x7fa6941016d0 2024-09-10T11:01:25.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.220+0000 7fa692ffd640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa67c0a2ec0 0x7fa67c0a5380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa694069620 tx=0x7fa684005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:25.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.223+0000 7fa67bfff640 1 -- 172.21.15.59:0/3968403506 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa68809c0f0 con 0x7fa6941016d0 2024-09-10T11:01:25.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.427+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 --> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fa694062630 con 0x7fa67c0a2ec0 2024-09-10T11:01:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.434+0000 7fa67bfff640 1 -- 172.21.15.59:0/3968403506 <== mgr.15132 v2:172.21.15.59:6800/3897711076 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fa694062630 con 0x7fa67c0a2ec0 2024-09-10T11:01:25.436 INFO:teuthology.orchestra.run.smithi059.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T11:01:24", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa67c0a2ec0 msgr2=0x7fa67c0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa67c0a2ec0 0x7fa67c0a5380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa694069620 tx=0x7fa684005f90 comp rx=0 tx=0).stop 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6941016d0 msgr2=0x7fa694109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6941016d0 0x7fa694109a20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa68800e9f0 tx=0x7fa68800eeb0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 shutdown_connections 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa694101fe0 0x7fa694109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6941016d0 0x7fa694109a20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa67c0a2ec0 0x7fa67c0a5380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 --2- 172.21.15.59:0/3968403506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa694100d10 0x7fa69410b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 >> 172.21.15.59:0/3968403506 conn(0x7fa6940fb930 msgr2=0x7fa694105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:25.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 shutdown_connections 2024-09-10T11:01:25.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.437+0000 7fa699586640 1 -- 172.21.15.59:0/3968403506 wait complete. 2024-09-10T11:01:25.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T11:01:25.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.556+0000 7f5838131640 1 -- 172.21.15.59:0/667969685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5830102640 msgr2=0x7f5830104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.556+0000 7f5838131640 1 --2- 172.21.15.59:0/667969685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5830102640 0x7f5830104a30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f582c009900 tx=0x7f582c02a410 comp rx=0 tx=0).stop 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.556+0000 7f5838131640 1 -- 172.21.15.59:0/667969685 shutdown_connections 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.556+0000 7f5838131640 1 --2- 172.21.15.59:0/667969685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f58301078a0 0x7f5830109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.556+0000 7f5838131640 1 --2- 172.21.15.59:0/667969685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5830104f70 0x7f5830107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.556+0000 7f5838131640 1 --2- 172.21.15.59:0/667969685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5830102640 0x7f5830104a30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.556+0000 7f5838131640 1 -- 172.21.15.59:0/667969685 >> 172.21.15.59:0/667969685 conn(0x7f58300fc1e0 msgr2=0x7f58300fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.556+0000 7f5838131640 1 -- 172.21.15.59:0/667969685 shutdown_connections 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.556+0000 7f5838131640 1 -- 172.21.15.59:0/667969685 wait complete. 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5838131640 1 Processor -- start 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5838131640 1 -- start start 2024-09-10T11:01:25.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5838131640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5830102640 0x7f5830101fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5838131640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5830104f70 0x7f58301005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5838131640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58301078a0 0x7f5830100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5838131640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f583010d880 con 0x7f58301078a0 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5838131640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f583010d700 con 0x7f5830102640 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5838131640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f583010da00 con 0x7f5830104f70 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58366ce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58301078a0 0x7f5830100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5835ecd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5830102640 0x7f5830101fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58356cc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5830104f70 0x7f58301005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58366ce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58301078a0 0x7f5830100b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39848/0 (socket says 172.21.15.59:39848) 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f5835ecd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5830102640 0x7f5830101fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.59:39484/0 (socket says 172.21.15.59:39484) 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58356cc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5830104f70 0x7f58301005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.59:42140/0 (socket says 172.21.15.59:42140) 2024-09-10T11:01:25.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58366ce640 1 -- 172.21.15.59:0/3306543303 learned_addr learned my addr 172.21.15.59:0/3306543303 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58366ce640 1 -- 172.21.15.59:0/3306543303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5830104f70 msgr2=0x7f58301005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58366ce640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5830104f70 0x7f58301005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58366ce640 1 -- 172.21.15.59:0/3306543303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5830102640 msgr2=0x7f5830101fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58366ce640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5830102640 0x7f5830101fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.557+0000 7f58366ce640 1 -- 172.21.15.59:0/3306543303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58301013c0 con 0x7f58301078a0 2024-09-10T11:01:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.558+0000 7f58366ce640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58301078a0 0x7f5830100b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f582800eb40 tx=0x7f582800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.558+0000 7f5826ffd640 1 -- 172.21.15.59:0/3306543303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828004b20 con 0x7f58301078a0 2024-09-10T11:01:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.558+0000 7f5826ffd640 1 -- 172.21.15.59:0/3306543303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5828004cc0 con 0x7f58301078a0 2024-09-10T11:01:25.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.558+0000 7f5826ffd640 1 -- 172.21.15.59:0/3306543303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828010850 con 0x7f58301078a0 2024-09-10T11:01:25.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.559+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58301a1f70 con 0x7f58301078a0 2024-09-10T11:01:25.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.559+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58301a2320 con 0x7f58301078a0 2024-09-10T11:01:25.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.560+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58300fdcd0 con 0x7f58301078a0 2024-09-10T11:01:25.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.561+0000 7f5826ffd640 1 -- 172.21.15.59:0/3306543303 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) ==== 138004+0+0 (secure 0 0 0) 0x7f5828005000 con 0x7f58301078a0 2024-09-10T11:01:25.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.562+0000 7f5826ffd640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f581c0a2e40 0x7f581c0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:25.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.562+0000 7f5835ecd640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f581c0a2e40 0x7f581c0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:25.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.562+0000 7f5826ffd640 1 -- 172.21.15.59:0/3306543303 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f58280d0180 con 0x7f58301078a0 2024-09-10T11:01:25.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.563+0000 7f5835ecd640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f581c0a2e40 0x7f581c0a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f582c031440 tx=0x7f582c0315b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:25.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.567+0000 7f5826ffd640 1 -- 172.21.15.59:0/3306543303 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f582801d060 con 0x7f58301078a0 2024-09-10T11:01:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.783+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 --> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f5830062630 con 0x7f581c0a2e40 2024-09-10T11:01:25.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.790+0000 7f5826ffd640 1 -- 172.21.15.59:0/3306543303 <== mgr.15132 v2:172.21.15.59:6800/3897711076 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f5830062630 con 0x7f581c0a2e40 2024-09-10T11:01:25.791 INFO:teuthology.orchestra.run.smithi059.stdout:/ 1m 6m3h 2024-09-10T11:01:25.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f581c0a2e40 msgr2=0x7f581c0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f581c0a2e40 0x7f581c0a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f582c031440 tx=0x7f582c0315b0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58301078a0 msgr2=0x7f5830100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:25.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58301078a0 0x7f5830100b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f582800eb40 tx=0x7f582800c2d0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 shutdown_connections 2024-09-10T11:01:25.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58301078a0 0x7f5830100b30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f581c0a2e40 0x7f581c0a5300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5830104f70 0x7f58301005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 --2- 172.21.15.59:0/3306543303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5830102640 0x7f5830101fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:25.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 >> 172.21.15.59:0/3306543303 conn(0x7f58300fc1e0 msgr2=0x7f5830102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:25.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 shutdown_connections 2024-09-10T11:01:25.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:01:25.792+0000 7f5838131640 1 -- 172.21.15.59:0/3306543303 wait complete. 2024-09-10T11:01:25.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-10T11:01:25.832 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-10T11:01:25.846 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-10T11:01:25.870 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:01:25.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-10T11:01:25.874 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T11:01:25.889 INFO:tasks.workunit:Pulling workunits from ref 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:01:25.890 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T11:01:25.890 INFO:tasks.workunit:timeout=3h 2024-09-10T11:01:25.890 INFO:tasks.workunit:cleanup=True 2024-09-10T11:01:25.890 DEBUG:teuthology.orchestra.run.smithi059:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T11:01:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T11:01:25.907 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T11:01:25.907 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T11:01:25.907 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:01:25.908 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T11:01:25.908 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 10:59:50.128005142 +0000 2024-09-10T11:01:25.908 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 10:59:50.128005142 +0000 2024-09-10T11:01:25.908 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 11:01:20.428499696 +0000 2024-09-10T11:01:25.908 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 10:59:50.128005142 +0000 2024-09-10T11:01:25.908 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T11:01:25.908 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T11:01:25.982 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:01:26.038 INFO:tasks.workunit.client.0.smithi059.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T11:01:26.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: [10/Sep/2024:11:01:24] ENGINE Serving on https://172.21.15.59:7150 2024-09-10T11:01:26.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: [10/Sep/2024:11:01:24] ENGINE Error in HTTPServer.serve 2024-09-10T11:01:26.138 INFO:journalctl@ceph.mon.a.smithi059.stdout: Traceback (most recent call last): 2024-09-10T11:01:26.138 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T11:01:26.138 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._connections.run(self.expiration_interval) 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._run(expiration_interval) 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: s = self.context.wrap_socket( 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: return self.sslsocket_class._create( 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: self.do_handshake() 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T11:01:26.139 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._sslobj.do_handshake() 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: [10/Sep/2024:11:01:24] ENGINE Serving on http://172.21.15.59:8765 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: [10/Sep/2024:11:01:24] ENGINE Bus STARTED 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-10T11:01:26.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: Unable to set osd_memory_target on smithi115 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:01:26.142 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:25 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:01:26.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: [10/Sep/2024:11:01:24] ENGINE Serving on https://172.21.15.59:7150 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: [10/Sep/2024:11:01:24] ENGINE Error in HTTPServer.serve 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: Traceback (most recent call last): 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: self._connections.run(self.expiration_interval) 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: self._run(expiration_interval) 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: s = self.context.wrap_socket( 2024-09-10T11:01:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout: return self.sslsocket_class._create( 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout: self.do_handshake() 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout: self._sslobj.do_handshake() 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: [10/Sep/2024:11:01:24] ENGINE Serving on http://172.21.15.59:8765 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: [10/Sep/2024:11:01:24] ENGINE Bus STARTED 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: Unable to set osd_memory_target on smithi115 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.190 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.190 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.190 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.190 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.190 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.190 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:01:26.190 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:25 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:01:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: [10/Sep/2024:11:01:24] ENGINE Serving on https://172.21.15.59:7150 2024-09-10T11:01:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: [10/Sep/2024:11:01:24] ENGINE Error in HTTPServer.serve 2024-09-10T11:01:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout: Traceback (most recent call last): 2024-09-10T11:01:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T11:01:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: self._run(expiration_interval) 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: s = self.context.wrap_socket( 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: return self.sslsocket_class._create( 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: self.do_handshake() 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T11:01:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout: self._sslobj.do_handshake() 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: [10/Sep/2024:11:01:24] ENGINE Serving on http://172.21.15.59:8765 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: [10/Sep/2024:11:01:24] ENGINE Bus STARTED 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: Unable to set osd_memory_target on smithi115 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-10T11:01:26.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:01:26.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:25 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:01:27.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi181 to 176.0M 2024-09-10T11:01:27.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Unable to set osd_memory_target on smithi181 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-10T11:01:27.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-10T11:01:27.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Unable to set osd_memory_target on smithi059 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-10T11:01:27.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T11:01:27.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:01:27.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:01:27.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:01:27.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi181 to 176.0M 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Unable to set osd_memory_target on smithi181 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Unable to set osd_memory_target on smithi059 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:01:27.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:01:27.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:01:27.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:01:27.189 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi181 to 176.0M 2024-09-10T11:01:27.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Unable to set osd_memory_target on smithi181 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-10T11:01:27.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Unable to set osd_memory_target on smithi059 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='client.24902 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:01:27.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: Updating smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:01:27.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:01:28.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:27 smithi059 ceph-mon[30978]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:01:28.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:27 smithi059 ceph-mon[30978]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-10T11:01:28.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:27 smithi181 ceph-mon[35409]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:01:28.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:27 smithi181 ceph-mon[35409]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-10T11:01:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:27 smithi115 ceph-mon[34719]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:01:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:27 smithi115 ceph-mon[34719]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-10T11:01:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:29 smithi059 ceph-mon[30978]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:01:30.185 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:29 smithi181 ceph-mon[35409]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:01:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:29 smithi115 ceph-mon[34719]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:01:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:31 smithi059 ceph-mon[30978]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-09-10T11:01:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:31 smithi181 ceph-mon[35409]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-09-10T11:01:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:31 smithi115 ceph-mon[34719]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-09-10T11:01:34.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:33 smithi059 ceph-mon[30978]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 104 KiB/s wr, 61 op/s 2024-09-10T11:01:34.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:33 smithi181 ceph-mon[35409]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 104 KiB/s wr, 61 op/s 2024-09-10T11:01:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:33 smithi115 ceph-mon[34719]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 104 KiB/s wr, 61 op/s 2024-09-10T11:01:36.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:35 smithi059 ceph-mon[30978]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 52 op/s 2024-09-10T11:01:36.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:35 smithi181 ceph-mon[35409]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 52 op/s 2024-09-10T11:01:36.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:35 smithi115 ceph-mon[34719]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 52 op/s 2024-09-10T11:01:38.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:37 smithi059 ceph-mon[30978]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 48 op/s 2024-09-10T11:01:38.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:37 smithi181 ceph-mon[35409]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 48 op/s 2024-09-10T11:01:38.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:37 smithi115 ceph-mon[34719]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 48 op/s 2024-09-10T11:01:39.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.020+0000 7ff587ac9640 1 -- 172.21.15.59:0/3698432947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5801013d0 msgr2=0x7ff580105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:39.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.020+0000 7ff587ac9640 1 --2- 172.21.15.59:0/3698432947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5801013d0 0x7ff580105890 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff570009900 tx=0x7ff57002a480 comp rx=0 tx=0).stop 2024-09-10T11:01:39.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.020+0000 7ff587ac9640 1 -- 172.21.15.59:0/3698432947 shutdown_connections 2024-09-10T11:01:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.020+0000 7ff587ac9640 1 --2- 172.21.15.59:0/3698432947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff580105ee0 0x7ff580106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.020+0000 7ff587ac9640 1 --2- 172.21.15.59:0/3698432947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5801013d0 0x7ff580105890 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.020+0000 7ff587ac9640 1 --2- 172.21.15.59:0/3698432947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff580100ab0 0x7ff580100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.020+0000 7ff587ac9640 1 -- 172.21.15.59:0/3698432947 >> 172.21.15.59:0/3698432947 conn(0x7ff5800fc6b0 msgr2=0x7ff5800fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.020+0000 7ff587ac9640 1 -- 172.21.15.59:0/3698432947 shutdown_connections 2024-09-10T11:01:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.020+0000 7ff587ac9640 1 -- 172.21.15.59:0/3698432947 wait complete. 2024-09-10T11:01:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff587ac9640 1 Processor -- start 2024-09-10T11:01:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff587ac9640 1 -- start start 2024-09-10T11:01:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff587ac9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff580100ab0 0x7ff5801a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff587ac9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5801013d0 0x7ff5801a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff587ac9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff580105ee0 0x7ff58019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff587ac9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff580118510 con 0x7ff580100ab0 2024-09-10T11:01:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff587ac9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff580118390 con 0x7ff580105ee0 2024-09-10T11:01:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff587ac9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff580118690 con 0x7ff5801013d0 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff585865640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff580100ab0 0x7ff5801a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff585865640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff580100ab0 0x7ff5801a4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32892/0 (socket says 172.21.15.59:32892) 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff585865640 1 -- 172.21.15.59:0/527044011 learned_addr learned my addr 172.21.15.59:0/527044011 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff586066640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff580105ee0 0x7ff58019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.021+0000 7ff585064640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5801013d0 0x7ff5801a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff585865640 1 -- 172.21.15.59:0/527044011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5801013d0 msgr2=0x7ff5801a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff585865640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5801013d0 0x7ff5801a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff585865640 1 -- 172.21.15.59:0/527044011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff580105ee0 msgr2=0x7ff58019e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff585865640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff580105ee0 0x7ff58019e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff585865640 1 -- 172.21.15.59:0/527044011 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58019ef60 con 0x7ff580100ab0 2024-09-10T11:01:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff585865640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff580100ab0 0x7ff5801a4620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00e9f0 tx=0x7ff57c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff576ffd640 1 -- 172.21.15.59:0/527044011 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00cd80 con 0x7ff580100ab0 2024-09-10T11:01:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff587ac9640 1 -- 172.21.15.59:0/527044011 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58019f250 con 0x7ff580100ab0 2024-09-10T11:01:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff576ffd640 1 -- 172.21.15.59:0/527044011 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c010910 con 0x7ff580100ab0 2024-09-10T11:01:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff576ffd640 1 -- 172.21.15.59:0/527044011 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0188f0 con 0x7ff580100ab0 2024-09-10T11:01:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.022+0000 7ff587ac9640 1 -- 172.21.15.59:0/527044011 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5801ab470 con 0x7ff580100ab0 2024-09-10T11:01:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.025+0000 7ff576ffd640 1 -- 172.21.15.59:0/527044011 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 23) ==== 138060+0+0 (secure 0 0 0) 0x7ff57c010ac0 con 0x7ff580100ab0 2024-09-10T11:01:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.025+0000 7ff58a85f740 1 Processor -- start 2024-09-10T11:01:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.025+0000 7ff58a85f740 1 -- start start 2024-09-10T11:01:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 0x561186a58ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a63770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 0x561186a660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff58a85f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5611869bd2f0 con 0x561186a59410 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff58a85f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561186965270 con 0x561186a63cb0 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff58a85f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5611869b92b0 con 0x561186a58af0 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff576ffd640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ff56c0a2ec0 0x7ff56c0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff585865640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a63770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff585865640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a63770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32904/0 (socket says 172.21.15.59:32904) 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff585865640 1 -- 172.21.15.59:0/1048155131 learned_addr learned my addr 172.21.15.59:0/1048155131 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff586066640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ff56c0a2ec0 0x7ff56c0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff585064640 1 --2- 172.21.15.59:0/1048155131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 0x561186a660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff586066640 1 --2- 172.21.15.59:0/1048155131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 0x561186a58ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff576ffd640 1 -- 172.21.15.59:0/527044011 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7ff57c0cfab0 con 0x7ff580100ab0 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff585865640 1 -- 172.21.15.59:0/1048155131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 msgr2=0x561186a58ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff585865640 1 --2- 172.21.15.59:0/1048155131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 0x561186a58ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff585865640 1 -- 172.21.15.59:0/1048155131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 msgr2=0x561186a660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff585865640 1 --2- 172.21.15.59:0/1048155131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 0x561186a660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.026+0000 7ff585865640 1 -- 172.21.15.59:0/1048155131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561186964340 con 0x561186a59410 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.027+0000 7ff585865640 1 --2- 172.21.15.59:0/1048155131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a63770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff57c01e000 tx=0x7ff57c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b856b9a9ab5784 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.027+0000 7ff586066640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ff56c0a2ec0 0x7ff56c0a5380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff578005fd0 tx=0x7ff578009e70 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.027+0000 7ff56bfff640 1 -- 172.21.15.59:0/1048155131 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0a0110 con 0x561186a59410 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.027+0000 7ff56bfff640 1 -- 172.21.15.59:0/1048155131 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c0a49d0 con 0x561186a59410 2024-09-10T11:01:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.027+0000 7ff56bfff640 1 -- 172.21.15.59:0/1048155131 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0cd580 con 0x561186a59410 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 -- 172.21.15.59:0/1048155131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 msgr2=0x561186a63770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 --2- 172.21.15.59:0/1048155131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a63770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff57c01e000 tx=0x7ff57c01f000 comp rx=0 tx=0).stop 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 -- 172.21.15.59:0/1048155131 shutdown_connections 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 --2- 172.21.15.59:0/1048155131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 0x561186a660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 --2- 172.21.15.59:0/1048155131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a63770 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 --2- 172.21.15.59:0/1048155131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 0x561186a58ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 -- 172.21.15.59:0/1048155131 >> 172.21.15.59:0/1048155131 conn(0x561186a55060 msgr2=0x561186a55440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 -- 172.21.15.59:0/1048155131 shutdown_connections 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 -- 172.21.15.59:0/1048155131 wait complete. 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 -- start start 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.028+0000 7ff58a85f740 1 Processor -- start 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a58af0 0x561186a60c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a59410 0x561186a61180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a63cb0 0x561186a616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff58a85f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561186a66880 con 0x561186a63cb0 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff58a85f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561186946290 con 0x561186a58af0 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff58a85f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561186a66a00 con 0x561186a59410 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff58a85f740 10 client.0 _ll_register_callbacks cb 0x561186977140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff586066640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a63cb0 0x561186a616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff586066640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a63cb0 0x561186a616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32910/0 (socket says 172.21.15.59:32910) 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff586066640 1 -- 172.21.15.59:0/4157529050 learned_addr learned my addr 172.21.15.59:0/4157529050 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff585064640 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a59410 0x561186a61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff585865640 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a58af0 0x561186a60c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff586066640 1 -- 172.21.15.59:0/4157529050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a59410 msgr2=0x561186a61180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff586066640 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a59410 0x561186a61180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff586066640 1 -- 172.21.15.59:0/4157529050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a58af0 msgr2=0x561186a60c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff586066640 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a58af0 0x561186a60c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff586066640 1 -- 172.21.15.59:0/4157529050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611866d0210 con 0x561186a63cb0 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff585865640 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a58af0 0x561186a60c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff586066640 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a63cb0 0x561186a616c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff578009b40 tx=0x7ff578009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177e7ffe0610532c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.029+0000 7ff5697fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff5697fa640 1 -- 172.21.15.59:0/4157529050 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578004530 con 0x561186a63cb0 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff5697fa640 1 -- 172.21.15.59:0/4157529050 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7ff5780046d0 con 0x561186a63cb0 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff58a85f740 1 -- 172.21.15.59:0/4157529050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff57c0a49d0 con 0x561186a63cb0 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff5697fa640 1 -- 172.21.15.59:0/4157529050 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff578029430 con 0x561186a63cb0 2024-09-10T11:01:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff58a85f740 10 client.15249 fetch_fsmap learned FSMap version 25 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff58a85f740 1 -- 172.21.15.59:0/4157529050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56118679c620 con 0x561186a63cb0 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff5697fa640 1 -- 172.21.15.59:0/4157529050 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c0a49d0 con 0x561186a63cb0 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff5697fa640 1 -- 172.21.15.59:0/4157529050 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff5780314b0 con 0x561186a63cb0 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff58a85f740 10 client.15249 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff58a85f740 10 client.15249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff58a85f740 20 client.15249 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff58a85f740 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561186a73c90 0x561186a760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff58a85f740 4 client.15249 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.030+0000 7ff58a85f740 1 -- 172.21.15.59:0/4157529050 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611869caa20 con 0x561186a73c90 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.031+0000 7ff585865640 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561186a73c90 0x561186a760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.031+0000 7ff5697fa640 10 client.15249 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.031+0000 7ff585865640 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561186a73c90 0x561186a760a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=138e14885b941eab server_cookie=ccdd14a4597b87ae in_seq=0 out_seq=0 2024-09-10T11:01:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff5697fa640 1 -- 172.21.15.59:0/4157529050 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611869caa20 con 0x561186a73c90 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff5697fa640 10 client.15249 handle_command_reply: tid=0 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 client.15249 shutdown 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 -- 172.21.15.59:0/4157529050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a63cb0 msgr2=0x561186a616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a63cb0 0x561186a616c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff578009b40 tx=0x7ff578009500 comp rx=0 tx=0).stop 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 -- 172.21.15.59:0/4157529050 shutdown_connections 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561186a73c90 0x561186a760a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a63cb0 0x561186a616c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a59410 0x561186a61180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff5697fa640 0 client.15249 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 --2- 172.21.15.59:0/4157529050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a58af0 0x561186a60c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 -- 172.21.15.59:0/4157529050 >> 172.21.15.59:0/4157529050 conn(0x561186a55060 msgr2=0x561186a5ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 -- 172.21.15.59:0/4157529050 shutdown_connections 2024-09-10T11:01:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 1 -- 172.21.15.59:0/4157529050 wait complete. 2024-09-10T11:01:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.032+0000 7ff58a85f740 20 client.15249 trim_cache size 0 max 16384 2024-09-10T11:01:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff58a85f740 1 Processor -- start 2024-09-10T11:01:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff58a85f740 1 -- start start 2024-09-10T11:01:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a58af0 0x561186a614f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a59410 0x561186a7ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a63cb0 0x561186a7bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff58a85f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801b67d0 con 0x561186a58af0 2024-09-10T11:01:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff58a85f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801b40a0 con 0x561186a59410 2024-09-10T11:01:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff58a85f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801b1ef0 con 0x561186a63cb0 2024-09-10T11:01:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff585865640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a58af0 0x561186a614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff585865640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a58af0 0x561186a614f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32918/0 (socket says 172.21.15.59:32918) 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff585865640 1 -- 172.21.15.59:0/677784138 learned_addr learned my addr 172.21.15.59:0/677784138 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff585064640 1 --2- 172.21.15.59:0/677784138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a59410 0x561186a7ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.047+0000 7ff586066640 1 --2- 172.21.15.59:0/677784138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a63cb0 0x561186a7bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff585865640 1 -- 172.21.15.59:0/677784138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a63cb0 msgr2=0x561186a7bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff585865640 1 --2- 172.21.15.59:0/677784138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a63cb0 0x561186a7bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff585865640 1 -- 172.21.15.59:0/677784138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a59410 msgr2=0x561186a7ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff585865640 1 --2- 172.21.15.59:0/677784138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a59410 0x561186a7ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff585865640 1 -- 172.21.15.59:0/677784138 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561186a58870 con 0x561186a58af0 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff585865640 1 --2- 172.21.15.59:0/677784138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a58af0 0x561186a614f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00e9c0 tx=0x7ff57c0981e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffad595d9d05179 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff56b7fe640 1 -- 172.21.15.59:0/677784138 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0a4540 con 0x561186a58af0 2024-09-10T11:01:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff56b7fe640 1 -- 172.21.15.59:0/677784138 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c098480 con 0x561186a58af0 2024-09-10T11:01:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff56b7fe640 1 -- 172.21.15.59:0/677784138 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c09b260 con 0x561186a58af0 2024-09-10T11:01:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff58a85f740 1 -- 172.21.15.59:0/677784138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a58af0 msgr2=0x561186a614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff58a85f740 1 --2- 172.21.15.59:0/677784138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a58af0 0x561186a614f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00e9c0 tx=0x7ff57c0981e0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.048+0000 7ff58a85f740 1 -- 172.21.15.59:0/677784138 shutdown_connections 2024-09-10T11:01:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 --2- 172.21.15.59:0/677784138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a63cb0 0x561186a7bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 --2- 172.21.15.59:0/677784138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a59410 0x561186a7ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 --2- 172.21.15.59:0/677784138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a58af0 0x561186a614f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 -- 172.21.15.59:0/677784138 >> 172.21.15.59:0/677784138 conn(0x561186a55060 msgr2=0x561186a62cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 -- 172.21.15.59:0/677784138 shutdown_connections 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 -- 172.21.15.59:0/677784138 wait complete. 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 -- start start 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 Processor -- start 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 0x561186a5ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a5e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 0x561186a5e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801b2560 con 0x561186a59410 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801b39d0 con 0x561186a63cb0 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801b2c30 con 0x561186a58af0 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.049+0000 7ff58a85f740 10 client.0 _ll_register_callbacks cb 0x7ff578009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585064640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a5e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585064640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a5e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32922/0 (socket says 172.21.15.59:32922) 2024-09-10T11:01:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585064640 1 -- 172.21.15.59:0/368776561 learned_addr learned my addr 172.21.15.59:0/368776561 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585865640 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 0x561186a5ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff586066640 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 0x561186a5e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585064640 1 -- 172.21.15.59:0/368776561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 msgr2=0x561186a5ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585064640 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 0x561186a5ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585064640 1 -- 172.21.15.59:0/368776561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 msgr2=0x561186a5e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585064640 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 0x561186a5e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585064640 1 -- 172.21.15.59:0/368776561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561186addb00 con 0x561186a59410 2024-09-10T11:01:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff585064640 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a5e330 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff570009900 tx=0x7ff5700045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8966bb2ec97d3f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff5697fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff5697fa640 1 -- 172.21.15.59:0/368776561 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570035040 con 0x561186a59410 2024-09-10T11:01:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff5697fa640 1 -- 172.21.15.59:0/368776561 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7ff5700052d0 con 0x561186a59410 2024-09-10T11:01:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff58a85f740 1 -- 172.21.15.59:0/368776561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff57c098480 con 0x561186a59410 2024-09-10T11:01:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff5697fa640 1 -- 172.21.15.59:0/368776561 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff5700054d0 con 0x561186a59410 2024-09-10T11:01:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff58a85f740 10 client.15255 fetch_fsmap learned FSMap version 25 2024-09-10T11:01:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.050+0000 7ff58a85f740 1 -- 172.21.15.59:0/368776561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561186adee20 con 0x561186a59410 2024-09-10T11:01:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff5697fa640 1 -- 172.21.15.59:0/368776561 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c098480 con 0x561186a59410 2024-09-10T11:01:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff5697fa640 1 -- 172.21.15.59:0/368776561 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff570003990 con 0x561186a59410 2024-09-10T11:01:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff58a85f740 10 client.15255 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:01:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff58a85f740 10 client.15255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:01:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff58a85f740 20 client.15255 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff58a85f740 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561186adf650 0x561186ae1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff58a85f740 4 client.15255 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:01:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff58a85f740 1 -- 172.21.15.59:0/368776561 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5611869c4d70 con 0x561186adf650 2024-09-10T11:01:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff585865640 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561186adf650 0x561186ae1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff5697fa640 10 client.15255 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.051+0000 7ff585865640 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561186adf650 0x561186ae1a40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45482397f1125f9a server_cookie=e13eaddeaf1ad6ff in_seq=0 out_seq=0 2024-09-10T11:01:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff5697fa640 1 -- 172.21.15.59:0/368776561 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5611869c4d70 con 0x561186adf650 2024-09-10T11:01:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff5697fa640 10 client.15255 handle_command_reply: tid=0 2024-09-10T11:01:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 client.15255 shutdown 2024-09-10T11:01:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 -- 172.21.15.59:0/368776561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 msgr2=0x561186a5e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a5e330 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff570009900 tx=0x7ff5700045b0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 -- 172.21.15.59:0/368776561 shutdown_connections 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561186adf650 0x561186ae1a40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561186a63cb0 0x561186a5e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff5697fa640 0 client.15255 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561186a59410 0x561186a5e330 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 --2- 172.21.15.59:0/368776561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561186a58af0 0x561186a5ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 -- 172.21.15.59:0/368776561 >> 172.21.15.59:0/368776561 conn(0x561186a55060 msgr2=0x561186a62cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 -- 172.21.15.59:0/368776561 shutdown_connections 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 1 -- 172.21.15.59:0/368776561 wait complete. 2024-09-10T11:01:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.063+0000 7ff58a85f740 20 client.15255 trim_cache size 0 max 16384 2024-09-10T11:01:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:01:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:01:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:01:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 -- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ff56c0a2ec0 msgr2=0x7ff56c0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ff56c0a2ec0 0x7ff56c0a5380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff578005fd0 tx=0x7ff578009e70 comp rx=0 tx=0).stop 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 -- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff580100ab0 msgr2=0x7ff5801a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff580100ab0 0x7ff5801a4620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00e9f0 tx=0x7ff57c00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 -- 172.21.15.59:0/527044011 shutdown_connections 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff580105ee0 0x7ff58019e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ff56c0a2ec0 0x7ff56c0a5380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff5801013d0 0x7ff5801a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 --2- 172.21.15.59:0/527044011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff580100ab0 0x7ff5801a4620 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 -- 172.21.15.59:0/527044011 >> 172.21.15.59:0/527044011 conn(0x7ff5800fc6b0 msgr2=0x7ff580103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 -- 172.21.15.59:0/527044011 shutdown_connections 2024-09-10T11:01:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:39.064+0000 7ff587ac9640 1 -- 172.21.15.59:0/527044011 wait complete. 2024-09-10T11:01:40.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:39 smithi059 ceph-mon[30978]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 48 op/s 2024-09-10T11:01:40.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:39 smithi181 ceph-mon[35409]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 48 op/s 2024-09-10T11:01:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:39 smithi115 ceph-mon[34719]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 48 op/s 2024-09-10T11:01:42.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:41 smithi059 ceph-mon[30978]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 78 KiB/s wr, 50 op/s 2024-09-10T11:01:42.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:41 smithi181 ceph-mon[35409]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 78 KiB/s wr, 50 op/s 2024-09-10T11:01:42.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:41 smithi115 ceph-mon[34719]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 78 KiB/s wr, 50 op/s 2024-09-10T11:01:44.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:43 smithi059 ceph-mon[30978]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:44.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:43 smithi181 ceph-mon[35409]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:44.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:43 smithi115 ceph-mon[34719]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:01:46.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:45 smithi059 ceph-mon[30978]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-10T11:01:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:45 smithi181 ceph-mon[35409]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-10T11:01:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:45 smithi115 ceph-mon[34719]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-10T11:01:48.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:47 smithi059 ceph-mon[30978]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-10T11:01:48.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:47 smithi181 ceph-mon[35409]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-10T11:01:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:47 smithi115 ceph-mon[34719]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-10T11:01:50.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:49 smithi059 ceph-mon[30978]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-10T11:01:50.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:49 smithi181 ceph-mon[35409]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-10T11:01:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:49 smithi115 ceph-mon[34719]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-10T11:01:52.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:51 smithi059 ceph-mon[30978]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-10T11:01:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 -- 172.21.15.59:0/4228549712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f594010c110 msgr2=0x7f594010e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 --2- 172.21.15.59:0/4228549712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f594010c110 0x7f594010e560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5938009ca0 tx=0x7f593802a950 comp rx=0 tx=0).stop 2024-09-10T11:01:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 -- 172.21.15.59:0/4228549712 shutdown_connections 2024-09-10T11:01:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 --2- 172.21.15.59:0/4228549712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f594010c110 0x7f594010e560 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 --2- 172.21.15.59:0/4228549712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5940103660 0x7f594010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 --2- 172.21.15.59:0/4228549712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5940102d40 0x7f5940103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 -- 172.21.15.59:0/4228549712 >> 172.21.15.59:0/4228549712 conn(0x7f5940077990 msgr2=0x7f59400fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 -- 172.21.15.59:0/4228549712 shutdown_connections 2024-09-10T11:01:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 -- 172.21.15.59:0/4228549712 wait complete. 2024-09-10T11:01:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.156+0000 7f5945331640 1 Processor -- start 2024-09-10T11:01:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f5945331640 1 -- start start 2024-09-10T11:01:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f5945331640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5940102d40 0x7f5940198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f5945331640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5940103660 0x7f5940198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f5945331640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f594010c110 0x7f594019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f5945331640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5940111e90 con 0x7f5940103660 2024-09-10T11:01:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f5945331640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5940111d10 con 0x7f594010c110 2024-09-10T11:01:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f5945331640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5940112010 con 0x7f5940102d40 2024-09-10T11:01:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f593e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5940103660 0x7f5940198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f593e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5940103660 0x7f5940198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41856/0 (socket says 172.21.15.59:41856) 2024-09-10T11:01:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f593effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5940102d40 0x7f5940198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f593e7fc640 1 -- 172.21.15.59:0/4289430523 learned_addr learned my addr 172.21.15.59:0/4289430523 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:52.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f593f7fe640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f594010c110 0x7f594019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.157+0000 7f593e7fc640 1 -- 172.21.15.59:0/4289430523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5940102d40 msgr2=0x7f5940198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:52.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f593e7fc640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5940102d40 0x7f5940198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f593e7fc640 1 -- 172.21.15.59:0/4289430523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f594010c110 msgr2=0x7f594019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:52.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f593e7fc640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f594010c110 0x7f594019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f593e7fc640 1 -- 172.21.15.59:0/4289430523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594019d2f0 con 0x7f5940103660 2024-09-10T11:01:52.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f593effd640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5940102d40 0x7f5940198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:01:52.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f593e7fc640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5940103660 0x7f5940198840 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f593400d770 tx=0x7f593400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:52.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f5927fff640 1 -- 172.21.15.59:0/4289430523 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934017070 con 0x7f5940103660 2024-09-10T11:01:52.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f5945331640 1 -- 172.21.15.59:0/4289430523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594019d5e0 con 0x7f5940103660 2024-09-10T11:01:52.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f5927fff640 1 -- 172.21.15.59:0/4289430523 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5934005500 con 0x7f5940103660 2024-09-10T11:01:52.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f5927fff640 1 -- 172.21.15.59:0/4289430523 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934004e00 con 0x7f5940103660 2024-09-10T11:01:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.158+0000 7f5945331640 1 -- 172.21.15.59:0/4289430523 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59401a4e70 con 0x7f5940103660 2024-09-10T11:01:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.160+0000 7f5927fff640 1 -- 172.21.15.59:0/4289430523 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 23) ==== 138060+0+0 (secure 0 0 0) 0x7f5934004fa0 con 0x7f5940103660 2024-09-10T11:01:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.161+0000 7f5927fff640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f59280a2ec0 0x7f59280a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.161+0000 7f5927fff640 1 -- 172.21.15.59:0/4289430523 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f59340cf040 con 0x7f5940103660 2024-09-10T11:01:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.161+0000 7f593effd640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f59280a2ec0 0x7f59280a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f59480ce740 1 Processor -- start 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f59480ce740 1 -- start start 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593effd640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f59280a2ec0 0x7f59280a5380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5930005d00 tx=0x7f593000b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f59480ce740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce7af0 0x563df0ce7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f59480ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce8410 0x563df0cf2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f59480ce740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 0x563df0cf50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f59480ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563df0c4c2f0 con 0x563df0ce8410 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f59480ce740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563df0bf4270 con 0x563df0ce7af0 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f59480ce740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563df0c482b0 con 0x563df0cf2cb0 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce8410 0x563df0cf2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce8410 0x563df0cf2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41870/0 (socket says 172.21.15.59:41870) 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593e7fc640 1 -- 172.21.15.59:0/465127350 learned_addr learned my addr 172.21.15.59:0/465127350 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593effd640 1 --2- 172.21.15.59:0/465127350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce7af0 0x563df0ce7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593f7fe640 1 --2- 172.21.15.59:0/465127350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 0x563df0cf50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593e7fc640 1 -- 172.21.15.59:0/465127350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 msgr2=0x563df0cf50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593e7fc640 1 --2- 172.21.15.59:0/465127350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 0x563df0cf50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593e7fc640 1 -- 172.21.15.59:0/465127350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce7af0 msgr2=0x563df0ce7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593e7fc640 1 --2- 172.21.15.59:0/465127350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce7af0 0x563df0ce7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.162+0000 7f593e7fc640 1 -- 172.21.15.59:0/465127350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563df0bf3340 con 0x563df0ce8410 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.163+0000 7f593e7fc640 1 --2- 172.21.15.59:0/465127350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce8410 0x563df0cf2770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5934009610 tx=0x7f5934004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a0d44779205624 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.163+0000 7f59257fa640 1 -- 172.21.15.59:0/465127350 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934020050 con 0x563df0ce8410 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.163+0000 7f59257fa640 1 -- 172.21.15.59:0/465127350 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59340a3f60 con 0x563df0ce8410 2024-09-10T11:01:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.163+0000 7f59257fa640 1 -- 172.21.15.59:0/465127350 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340ccb30 con 0x563df0ce8410 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 -- 172.21.15.59:0/465127350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce8410 msgr2=0x563df0cf2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 --2- 172.21.15.59:0/465127350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce8410 0x563df0cf2770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5934009610 tx=0x7f5934004780 comp rx=0 tx=0).stop 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 -- 172.21.15.59:0/465127350 shutdown_connections 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 --2- 172.21.15.59:0/465127350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 0x563df0cf50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 --2- 172.21.15.59:0/465127350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce8410 0x563df0cf2770 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 --2- 172.21.15.59:0/465127350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce7af0 0x563df0ce7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 -- 172.21.15.59:0/465127350 >> 172.21.15.59:0/465127350 conn(0x563df0ce4060 msgr2=0x563df0ce4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 -- 172.21.15.59:0/465127350 shutdown_connections 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 -- 172.21.15.59:0/465127350 wait complete. 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 -- start start 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.164+0000 7f59480ce740 1 Processor -- start 2024-09-10T11:01:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f59480ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cefbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f59480ce740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce8410 0x563df0cf0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f59480ce740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 0x563df0cf0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f59480ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563df0cf5880 con 0x563df0ce7af0 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f59480ce740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563df0bd5290 con 0x563df0ce8410 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f59480ce740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563df0cf5a00 con 0x563df0cf2cb0 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f59480ce740 10 client.0 _ll_register_callbacks cb 0x563df0c06140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cefbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cefbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41886/0 (socket says 172.21.15.59:41886) 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593effd640 1 -- 172.21.15.59:0/3489317449 learned_addr learned my addr 172.21.15.59:0/3489317449 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593e7fc640 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce8410 0x563df0cf0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593f7fe640 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 0x563df0cf0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593effd640 1 -- 172.21.15.59:0/3489317449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 msgr2=0x563df0cf0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593effd640 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 0x563df0cf0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593effd640 1 -- 172.21.15.59:0/3489317449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce8410 msgr2=0x563df0cf0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593effd640 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce8410 0x563df0cf0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593effd640 1 -- 172.21.15.59:0/3489317449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563df095f210 con 0x563df0ce7af0 2024-09-10T11:01:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f593effd640 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cefbc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5930011a90 tx=0x7f5930004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395d3e644be234b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f5922ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f5922ff5640 1 -- 172.21.15.59:0/3489317449 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593001ec00 con 0x563df0ce7af0 2024-09-10T11:01:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f5922ff5640 1 -- 172.21.15.59:0/3489317449 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f593001eda0 con 0x563df0ce7af0 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.165+0000 7f59480ce740 1 -- 172.21.15.59:0/3489317449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59340a3f60 con 0x563df0ce7af0 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f5922ff5640 1 -- 172.21.15.59:0/3489317449 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5930028430 con 0x563df0ce7af0 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f59480ce740 10 client.15267 fetch_fsmap learned FSMap version 25 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f59480ce740 1 -- 172.21.15.59:0/3489317449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563df0a2b620 con 0x563df0ce7af0 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f5922ff5640 1 -- 172.21.15.59:0/3489317449 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59340a3f60 con 0x563df0ce7af0 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f5922ff5640 1 -- 172.21.15.59:0/3489317449 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f593001f730 con 0x563df0ce7af0 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f59480ce740 10 client.15267 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f59480ce740 10 client.15267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f59480ce740 20 client.15267 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f59480ce740 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x563df0d02c80 0x563df0d050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f59480ce740 4 client.15267 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f59480ce740 1 -- 172.21.15.59:0/3489317449 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563df0c59a20 con 0x563df0d02c80 2024-09-10T11:01:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.166+0000 7f593e7fc640 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x563df0d02c80 0x563df0d050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.167+0000 7f5922ff5640 10 client.15267 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.167+0000 7f593e7fc640 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x563df0d02c80 0x563df0d050d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1882cee685b01cec server_cookie=80c71310984f43e8 in_seq=0 out_seq=0 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.167+0000 7f5922ff5640 1 -- 172.21.15.59:0/3489317449 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563df0c59a20 con 0x563df0d02c80 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.167+0000 7f5922ff5640 10 client.15267 handle_command_reply: tid=0 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 client.15267 shutdown 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 -- 172.21.15.59:0/3489317449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 msgr2=0x563df0cefbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cefbc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5930011a90 tx=0x7f5930004730 comp rx=0 tx=0).stop 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 -- 172.21.15.59:0/3489317449 shutdown_connections 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x563df0d02c80 0x563df0d050d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0cf2cb0 0x563df0cf0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0ce8410 0x563df0cf0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 --2- 172.21.15.59:0/3489317449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cefbc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 -- 172.21.15.59:0/3489317449 >> 172.21.15.59:0/3489317449 conn(0x563df0ce4060 msgr2=0x563df0ce9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f5922ff5640 0 client.15267 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 -- 172.21.15.59:0/3489317449 shutdown_connections 2024-09-10T11:01:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 1 -- 172.21.15.59:0/3489317449 wait complete. 2024-09-10T11:01:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.168+0000 7f59480ce740 20 client.15267 trim_cache size 0 max 16384 2024-09-10T11:01:52.192 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:51 smithi181 ceph-mon[35409]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-10T11:01:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f59480ce740 1 Processor -- start 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f59480ce740 1 -- start start 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f59480ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cf0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f59480ce740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ce9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f59480ce740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 0x563df0d0aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f59480ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f59401b01b0 con 0x563df0ce7af0 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f59480ce740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f59401ada80 con 0x563df0cf2cb0 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f59480ce740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f59401ab8d0 con 0x563df0ce8410 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f593e7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ce9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f593effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cf0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f593e7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ce9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.59:40920/0 (socket says 172.21.15.59:40920) 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f593e7fc640 1 -- 172.21.15.59:0/3825067342 learned_addr learned my addr 172.21.15.59:0/3825067342 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f593f7fe640 1 --2- 172.21.15.59:0/3825067342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 0x563df0d0aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f593e7fc640 1 -- 172.21.15.59:0/3825067342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 msgr2=0x563df0d0aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.190+0000 7f593e7fc640 1 --2- 172.21.15.59:0/3825067342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 0x563df0d0aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.191+0000 7f593e7fc640 1 -- 172.21.15.59:0/3825067342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 msgr2=0x563df0cf0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.191+0000 7f593e7fc640 1 --2- 172.21.15.59:0/3825067342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cf0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.191+0000 7f593e7fc640 1 -- 172.21.15.59:0/3825067342 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563df0ce7920 con 0x563df0ce8410 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.191+0000 7f593effd640 1 --2- 172.21.15.59:0/3825067342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cf0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.191+0000 7f593e7fc640 1 --2- 172.21.15.59:0/3825067342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ce9c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f593400d740 tx=0x7f59340bb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea56271e52ef6b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.191+0000 7f5924ff9640 1 -- 172.21.15.59:0/3825067342 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934020040 con 0x563df0ce8410 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.191+0000 7f5924ff9640 1 -- 172.21.15.59:0/3825067342 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59340a3f60 con 0x563df0ce8410 2024-09-10T11:01:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.191+0000 7f5924ff9640 1 -- 172.21.15.59:0/3825067342 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340cc8d0 con 0x563df0ce8410 2024-09-10T11:01:52.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 -- 172.21.15.59:0/3825067342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 msgr2=0x563df0ce9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 --2- 172.21.15.59:0/3825067342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ce9c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f593400d740 tx=0x7f59340bb040 comp rx=0 tx=0).stop 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 -- 172.21.15.59:0/3825067342 shutdown_connections 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 --2- 172.21.15.59:0/3825067342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 0x563df0d0aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 --2- 172.21.15.59:0/3825067342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ce9c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 --2- 172.21.15.59:0/3825067342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cf0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 -- 172.21.15.59:0/3825067342 >> 172.21.15.59:0/3825067342 conn(0x563df0ce4060 msgr2=0x563df0ce9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 -- 172.21.15.59:0/3825067342 shutdown_connections 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 -- 172.21.15.59:0/3825067342 wait complete. 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 -- start start 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.192+0000 7f59480ce740 1 Processor -- start 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f59480ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f59480ce740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ced110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f59480ce740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 0x563df0ced650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f59480ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f59401abf40 con 0x563df0ce7af0 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f59480ce740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f59401ad3b0 con 0x563df0cf2cb0 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f59480ce740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f59401ac610 con 0x563df0ce8410 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f59480ce740 10 client.0 _ll_register_callbacks cb 0x7f593000bd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cecbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41900/0 (socket says 172.21.15.59:41900) 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593effd640 1 -- 172.21.15.59:0/1549066981 learned_addr learned my addr 172.21.15.59:0/1549066981 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593e7fc640 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ced110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593f7fe640 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 0x563df0ced650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593effd640 1 -- 172.21.15.59:0/1549066981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 msgr2=0x563df0ced110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593effd640 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ced110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593effd640 1 -- 172.21.15.59:0/1549066981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 msgr2=0x563df0ced650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593effd640 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 0x563df0ced650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593effd640 1 -- 172.21.15.59:0/1549066981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563df0cdf2d0 con 0x563df0ce7af0 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593e7fc640 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ced110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593f7fe640 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 0x563df0ced650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f593effd640 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cecbd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f593000be10 tx=0x7f593001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2c192eb5a2b323 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.193+0000 7f5922ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f5922ff5640 1 -- 172.21.15.59:0/1549066981 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593001f630 con 0x563df0ce7af0 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f5922ff5640 1 -- 172.21.15.59:0/1549066981 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f593001f7d0 con 0x563df0ce7af0 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f59480ce740 1 -- 172.21.15.59:0/1549066981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59340a3f60 con 0x563df0ce7af0 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f5922ff5640 1 -- 172.21.15.59:0/1549066981 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5930048050 con 0x563df0ce7af0 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f59480ce740 10 client.15273 fetch_fsmap learned FSMap version 25 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f59480ce740 1 -- 172.21.15.59:0/1549066981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563df0d6db50 con 0x563df0ce7af0 2024-09-10T11:01:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f5922ff5640 1 -- 172.21.15.59:0/1549066981 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59340a3f60 con 0x563df0ce7af0 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f5922ff5640 1 -- 172.21.15.59:0/1549066981 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f593003a780 con 0x563df0ce7af0 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f59480ce740 10 client.15273 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f59480ce740 10 client.15273 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f59480ce740 20 client.15273 populate_metadata read hostname 'smithi059' 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f59480ce740 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x563df0d6e2f0 0x563df0d70710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f59480ce740 4 client.15273 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.194+0000 7f59480ce740 1 -- 172.21.15.59:0/1549066981 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563df0c53d70 con 0x563df0d6e2f0 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.195+0000 7f593e7fc640 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x563df0d6e2f0 0x563df0d70710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.195+0000 7f593e7fc640 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x563df0d6e2f0 0x563df0d70710 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0c4680a3a06871c server_cookie=6e2ab4c3b2da0442 in_seq=0 out_seq=0 2024-09-10T11:01:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.195+0000 7f5922ff5640 10 client.15273 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f5922ff5640 1 -- 172.21.15.59:0/1549066981 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563df0c53d70 con 0x563df0d6e2f0 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f5922ff5640 10 client.15273 handle_command_reply: tid=0 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f59480ce740 1 client.15273 shutdown 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f59480ce740 1 -- 172.21.15.59:0/1549066981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 msgr2=0x563df0cecbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f59480ce740 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cecbd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f593000be10 tx=0x7f593001ec30 comp rx=0 tx=0).stop 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f59480ce740 1 -- 172.21.15.59:0/1549066981 shutdown_connections 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f59480ce740 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x563df0d6e2f0 0x563df0d70710 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f59480ce740 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563df0cf2cb0 0x563df0ced650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f59480ce740 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563df0ce8410 0x563df0ced110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f59480ce740 1 --2- 172.21.15.59:0/1549066981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563df0ce7af0 0x563df0cecbd0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f5922ff5640 0 client.15273 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.201+0000 7f59480ce740 1 -- 172.21.15.59:0/1549066981 >> 172.21.15.59:0/1549066981 conn(0x563df0ce4060 msgr2=0x563df0ce31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f59480ce740 1 -- 172.21.15.59:0/1549066981 shutdown_connections 2024-09-10T11:01:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f59480ce740 1 -- 172.21.15.59:0/1549066981 wait complete. 2024-09-10T11:01:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f59480ce740 20 client.15273 trim_cache size 0 max 16384 2024-09-10T11:01:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:01:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:01:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:01:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 -- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f59280a2ec0 msgr2=0x7f59280a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f59280a2ec0 0x7f59280a5380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5930005d00 tx=0x7f593000b410 comp rx=0 tx=0).stop 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 -- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5940103660 msgr2=0x7f5940198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5940103660 0x7f5940198840 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f593400d770 tx=0x7f593400dc30 comp rx=0 tx=0).stop 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 -- 172.21.15.59:0/4289430523 shutdown_connections 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f594010c110 0x7f594019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5940103660 0x7f5940198840 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f59280a2ec0 0x7f59280a5380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 --2- 172.21.15.59:0/4289430523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5940102d40 0x7f5940198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 -- 172.21.15.59:0/4289430523 >> 172.21.15.59:0/4289430523 conn(0x7f5940077990 msgr2=0x7f59400fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 -- 172.21.15.59:0/4289430523 shutdown_connections 2024-09-10T11:01:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:01:52.202+0000 7f5945331640 1 -- 172.21.15.59:0/4289430523 wait complete. 2024-09-10T11:01:52.211 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:51 smithi115 ceph-mon[34719]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-10T11:01:54.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:53 smithi059 ceph-mon[30978]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-10T11:01:54.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:53 smithi181 ceph-mon[35409]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-10T11:01:54.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:53 smithi115 ceph-mon[34719]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-10T11:01:56.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:55 smithi059 ceph-mon[30978]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2024-09-10T11:01:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:55 smithi181 ceph-mon[35409]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2024-09-10T11:01:56.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:55 smithi115 ceph-mon[34719]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2024-09-10T11:01:58.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:57 smithi059 ceph-mon[30978]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T11:01:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:57 smithi181 ceph-mon[35409]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T11:01:58.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:57 smithi115 ceph-mon[34719]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T11:02:00.138 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:02:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:02:00.100+0000 7f742a4e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:02:00.138 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:02:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:02:00.100+0000 7f742a4e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:02:00.138 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:02:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:02:00.100+0000 7f742a4e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:02:00.138 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:02:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:02:00.100+0000 7f742a4e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:02:00.139 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:02:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x[31203]: 2024-09-10T11:02:00.100+0000 7f742a4e7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:02:00.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:01:59 smithi059 ceph-mon[30978]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T11:02:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:01:59 smithi181 ceph-mon[35409]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T11:02:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:01:59 smithi115 ceph-mon[34719]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T11:02:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:01 smithi181 ceph-mon[35409]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T11:02:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:01 smithi181 ceph-mon[35409]: mgrmap e24: x(active, since 38s), standbys: y, z 2024-09-10T11:02:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:01 smithi115 ceph-mon[34719]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T11:02:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:01 smithi115 ceph-mon[34719]: mgrmap e24: x(active, since 38s), standbys: y, z 2024-09-10T11:02:02.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:01 smithi059 ceph-mon[30978]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T11:02:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:01 smithi059 ceph-mon[30978]: mgrmap e24: x(active, since 38s), standbys: y, z 2024-09-10T11:02:04.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:03 smithi181 ceph-mon[35409]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T11:02:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:03 smithi115 ceph-mon[34719]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T11:02:04.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:03 smithi059 ceph-mon[30978]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T11:02:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.337+0000 7f8a99601640 1 -- 172.21.15.59:0/821259488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a94106800 msgr2=0x7f8a94106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.337+0000 7f8a99601640 1 --2- 172.21.15.59:0/821259488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a94106800 0x7f8a94106be0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009930 tx=0x7f8a8402a420 comp rx=0 tx=0).stop 2024-09-10T11:02:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.337+0000 7f8a99601640 1 -- 172.21.15.59:0/821259488 shutdown_connections 2024-09-10T11:02:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.337+0000 7f8a99601640 1 --2- 172.21.15.59:0/821259488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a94101190 0x7f8a9410d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.337+0000 7f8a99601640 1 --2- 172.21.15.59:0/821259488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a941007f0 0x7f8a94100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.337+0000 7f8a99601640 1 --2- 172.21.15.59:0/821259488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a94106800 0x7f8a94106be0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.337+0000 7f8a99601640 1 -- 172.21.15.59:0/821259488 >> 172.21.15.59:0/821259488 conn(0x7f8a940777c0 msgr2=0x7f8a940feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.337+0000 7f8a99601640 1 -- 172.21.15.59:0/821259488 shutdown_connections 2024-09-10T11:02:05.340 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.337+0000 7f8a99601640 1 -- 172.21.15.59:0/821259488 wait complete. 2024-09-10T11:02:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a99601640 1 Processor -- start 2024-09-10T11:02:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a99601640 1 -- start start 2024-09-10T11:02:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a99601640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a941007f0 0x7f8a941984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a99601640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a94101190 0x7f8a94198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a99601640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9419cda0 0x7f8a9419d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a99601640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a94110c40 con 0x7f8a941007f0 2024-09-10T11:02:05.342 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a99601640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8a94110ac0 con 0x7f8a9419cda0 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a99601640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a94110dc0 con 0x7f8a94101190 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a941007f0 0x7f8a941984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a941007f0 0x7f8a941984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46036/0 (socket says 172.21.15.59:46036) 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a8bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a94101190 0x7f8a94198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a92ffd640 1 -- 172.21.15.59:0/982459854 learned_addr learned my addr 172.21.15.59:0/982459854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.338+0000 7f8a937fe640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9419cda0 0x7f8a9419d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.339+0000 7f8a92ffd640 1 -- 172.21.15.59:0/982459854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a94101190 msgr2=0x7f8a94198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.339+0000 7f8a92ffd640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a94101190 0x7f8a94198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.339+0000 7f8a92ffd640 1 -- 172.21.15.59:0/982459854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9419cda0 msgr2=0x7f8a9419d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.339+0000 7f8a92ffd640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9419cda0 0x7f8a9419d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.339+0000 7f8a92ffd640 1 -- 172.21.15.59:0/982459854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9419d890 con 0x7f8a941007f0 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.339+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a94101190 0x7f8a94198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:02:05.343 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.339+0000 7f8a92ffd640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a941007f0 0x7f8a941984e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8a84005940 tx=0x7f8a840043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.339+0000 7f8a90ff9640 1 -- 172.21.15.59:0/982459854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8403f030 con 0x7f8a941007f0 2024-09-10T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.340+0000 7f8a90ff9640 1 -- 172.21.15.59:0/982459854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84003ad0 con 0x7f8a941007f0 2024-09-10T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.340+0000 7f8a90ff9640 1 -- 172.21.15.59:0/982459854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84035070 con 0x7f8a941007f0 2024-09-10T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.340+0000 7f8a99601640 1 -- 172.21.15.59:0/982459854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9419db20 con 0x7f8a941007f0 2024-09-10T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.340+0000 7f8a99601640 1 -- 172.21.15.59:0/982459854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a941a5290 con 0x7f8a941007f0 2024-09-10T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.344+0000 7f8a9c470740 1 Processor -- start 2024-09-10T11:02:05.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.344+0000 7f8a9c470740 1 -- start start 2024-09-10T11:02:05.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.344+0000 7f8a90ff9640 1 -- 172.21.15.59:0/982459854 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 138117+0+0 (secure 0 0 0) 0x7f8a84042030 con 0x7f8a941007f0 2024-09-10T11:02:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.344+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x5648867770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.344+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x564886781940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a937fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x5648867770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x564886784270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a9c470740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648866db2f0 con 0x564886776cc0 2024-09-10T11:02:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a9c470740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564886683270 con 0x5648867775e0 2024-09-10T11:02:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a937fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x5648867770a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46040/0 (socket says 172.21.15.59:46040) 2024-09-10T11:02:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a937fe640 1 -- 172.21.15.59:0/359835231 learned_addr learned my addr 172.21.15.59:0/359835231 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a9c470740 1 -- 172.21.15.59:0/359835231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5648866d72b0 con 0x564886781e80 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a92ffd640 1 --2- 172.21.15.59:0/359835231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x564886781940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/359835231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x564886784270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a937fe640 1 -- 172.21.15.59:0/359835231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 msgr2=0x564886784270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a937fe640 1 --2- 172.21.15.59:0/359835231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x564886784270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a937fe640 1 -- 172.21.15.59:0/359835231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 msgr2=0x564886781940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a937fe640 1 --2- 172.21.15.59:0/359835231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x564886781940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.345+0000 7f8a937fe640 1 -- 172.21.15.59:0/359835231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564886682340 con 0x564886776cc0 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.346+0000 7f8a937fe640 1 --2- 172.21.15.59:0/359835231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x5648867770a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009f70 tx=0x7f8a8c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4330bd2d5ce684e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.346+0000 7f8a90ff9640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8a800a2f20 0x7f8a800a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.346+0000 7f8a92ffd640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8a800a2f20 0x7f8a800a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.346+0000 7f8a90ff9640 1 -- 172.21.15.59:0/982459854 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f8a840ef9f0 con 0x7f8a941007f0 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.346+0000 7f8a897fa640 1 -- 172.21.15.59:0/359835231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c016070 con 0x564886776cc0 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.346+0000 7f8a897fa640 1 -- 172.21.15.59:0/359835231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8c004d20 con 0x564886776cc0 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.347+0000 7f8a897fa640 1 -- 172.21.15.59:0/359835231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c012950 con 0x564886776cc0 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.347+0000 7f8a92ffd640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8a800a2f20 0x7f8a800a53e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a840ecf40 tx=0x7f8a840f5510 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.347+0000 7f8a9c470740 1 -- 172.21.15.59:0/359835231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 msgr2=0x5648867770a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.347+0000 7f8a9c470740 1 --2- 172.21.15.59:0/359835231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x5648867770a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009f70 tx=0x7f8a8c010800 comp rx=0 tx=0).stop 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.348+0000 7f8a9c470740 1 -- 172.21.15.59:0/359835231 shutdown_connections 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.348+0000 7f8a9c470740 1 --2- 172.21.15.59:0/359835231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x564886784270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.348+0000 7f8a9c470740 1 --2- 172.21.15.59:0/359835231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x564886781940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.348+0000 7f8a9c470740 1 --2- 172.21.15.59:0/359835231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x5648867770a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.348+0000 7f8a9c470740 1 -- 172.21.15.59:0/359835231 >> 172.21.15.59:0/359835231 conn(0x564886773230 msgr2=0x564886773610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.348+0000 7f8a9c470740 1 -- 172.21.15.59:0/359835231 shutdown_connections 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.348+0000 7f8a9c470740 1 -- 172.21.15.59:0/359835231 wait complete. 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.348+0000 7f8a9c470740 1 -- start start 2024-09-10T11:02:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.348+0000 7f8a9c470740 1 Processor -- start 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x56488677f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x56488677f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a9c470740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564886784aa0 con 0x564886776cc0 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a9c470740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564886664290 con 0x5648867775e0 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a9c470740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564886784c20 con 0x564886781e80 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a9c470740 10 client.0 _ll_register_callbacks cb 0x564886695140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a937fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a937fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46044/0 (socket says 172.21.15.59:46044) 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a937fe640 1 -- 172.21.15.59:0/2412155166 learned_addr learned my addr 172.21.15.59:0/2412155166 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a937fe640 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x56488677f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x56488677f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a937fe640 1 -- 172.21.15.59:0/2412155166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 msgr2=0x56488677f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a937fe640 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x56488677f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a937fe640 1 -- 172.21.15.59:0/2412155166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 msgr2=0x56488677f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a937fe640 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x56488677f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.349+0000 7f8a937fe640 1 -- 172.21.15.59:0/2412155166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648863ee210 con 0x564886776cc0 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.350+0000 7f8a937fe640 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677ed70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0125f0 tx=0x7f8a8c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd04ef922a3f296 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.350+0000 7f8a7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.350+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/2412155166 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c016070 con 0x564886776cc0 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.350+0000 7f8a9c470740 1 -- 172.21.15.59:0/2412155166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a8c004d20 con 0x564886776cc0 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.350+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/2412155166 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f8a8c012d50 con 0x564886776cc0 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.350+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/2412155166 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c030050 con 0x564886776cc0 2024-09-10T11:02:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.350+0000 7f8a9c470740 10 client.15291 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.350+0000 7f8a9c470740 1 -- 172.21.15.59:0/2412155166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5648864ba620 con 0x564886776cc0 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.350+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/2412155166 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8c01f020 con 0x564886776cc0 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.351+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/2412155166 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a8c028020 con 0x564886776cc0 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.351+0000 7f8a9c470740 10 client.15291 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.351+0000 7f8a9c470740 10 client.15291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.351+0000 7f8a9c470740 20 client.15291 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.351+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564886790b00 0x564886790f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.351+0000 7f8a9c470740 4 client.15291 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.351+0000 7f8a9c470740 1 -- 172.21.15.59:0/2412155166 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a8c004d20 con 0x564886790b00 2024-09-10T11:02:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.351+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564886790b00 0x564886790f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.352+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564886790b00 0x564886790f10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=186d9230217b6e3b server_cookie=45c07d9229e75059 in_seq=0 out_seq=0 2024-09-10T11:02:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.352+0000 7f8a7a7fc640 10 client.15291 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.352+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/2412155166 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8a8c004d20 con 0x564886790b00 2024-09-10T11:02:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.352+0000 7f8a7a7fc640 10 client.15291 handle_command_reply: tid=0 2024-09-10T11:02:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.352+0000 7f8a9c470740 1 client.15291 shutdown 2024-09-10T11:02:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 -- 172.21.15.59:0/2412155166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 msgr2=0x56488677ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677ed70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0125f0 tx=0x7f8a8c009800 comp rx=0 tx=0).stop 2024-09-10T11:02:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 -- 172.21.15.59:0/2412155166 shutdown_connections 2024-09-10T11:02:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564886790b00 0x564886790f10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x56488677f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x56488677f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2412155166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677ed70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 -- 172.21.15.59:0/2412155166 >> 172.21.15.59:0/2412155166 conn(0x564886773230 msgr2=0x564886778f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a7a7fc640 0 client.15291 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 -- 172.21.15.59:0/2412155166 shutdown_connections 2024-09-10T11:02:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 1 -- 172.21.15.59:0/2412155166 wait complete. 2024-09-10T11:02:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.353+0000 7f8a9c470740 20 client.15291 trim_cache size 0 max 16384 2024-09-10T11:02:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.382+0000 7f8a9c470740 1 Processor -- start 2024-09-10T11:02:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.382+0000 7f8a9c470740 1 -- start start 2024-09-10T11:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.382+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.382+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x5648867805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.382+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x564886780b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.382+0000 7f8a9c470740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941ae4b0 con 0x564886776cc0 2024-09-10T11:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.382+0000 7f8a9c470740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941abd80 con 0x5648867775e0 2024-09-10T11:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.382+0000 7f8a9c470740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941a9bd0 con 0x564886781e80 2024-09-10T11:02:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a8bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x5648867805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a8bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x5648867805d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.59:57394/0 (socket says 172.21.15.59:57394) 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a8bfff640 1 -- 172.21.15.59:0/2315385345 learned_addr learned my addr 172.21.15.59:0/2315385345 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a937fe640 1 --2- 172.21.15.59:0/2315385345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a8bfff640 1 -- 172.21.15.59:0/2315385345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 msgr2=0x564886780b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/2315385345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x564886780b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a8bfff640 1 -- 172.21.15.59:0/2315385345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 msgr2=0x56488677f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/2315385345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a8bfff640 1 -- 172.21.15.59:0/2315385345 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564886777410 con 0x5648867775e0 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a937fe640 1 --2- 172.21.15.59:0/2315385345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/2315385345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x5648867805d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a94105dd0 tx=0x7f8a7c0039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3297372500ee96e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.383+0000 7f8a88ff9640 1 -- 172.21.15.59:0/2315385345 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c011640 con 0x5648867775e0 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.384+0000 7f8a88ff9640 1 -- 172.21.15.59:0/2315385345 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a7c011cc0 con 0x5648867775e0 2024-09-10T11:02:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.384+0000 7f8a88ff9640 1 -- 172.21.15.59:0/2315385345 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c01ccf0 con 0x5648867775e0 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.384+0000 7f8a9c470740 1 -- 172.21.15.59:0/2315385345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 msgr2=0x5648867805d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.384+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2315385345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x5648867805d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a94105dd0 tx=0x7f8a7c0039c0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.385+0000 7f8a9c470740 1 -- 172.21.15.59:0/2315385345 shutdown_connections 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.385+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2315385345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x564886780b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.385+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2315385345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x5648867805d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.385+0000 7f8a9c470740 1 --2- 172.21.15.59:0/2315385345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488677f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.385+0000 7f8a9c470740 1 -- 172.21.15.59:0/2315385345 >> 172.21.15.59:0/2315385345 conn(0x564886773230 msgr2=0x564886791cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.385+0000 7f8a9c470740 1 -- 172.21.15.59:0/2315385345 shutdown_connections 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.385+0000 7f8a9c470740 1 -- 172.21.15.59:0/2315385345 wait complete. 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.385+0000 7f8a9c470740 1 -- start start 2024-09-10T11:02:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.385+0000 7f8a9c470740 1 Processor -- start 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488679cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x56488679d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a9c470740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x56488679d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a9c470740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941aa240 con 0x564886776cc0 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a9c470740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941ab6b0 con 0x5648867775e0 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a9c470740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941aa910 con 0x564886781e80 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a9c470740 10 client.0 _ll_register_callbacks cb 0x7f8a840f53e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a937fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488679cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a937fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488679cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46062/0 (socket says 172.21.15.59:46062) 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a937fe640 1 -- 172.21.15.59:0/77113259 learned_addr learned my addr 172.21.15.59:0/77113259 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x56488679d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a937fe640 1 -- 172.21.15.59:0/77113259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 msgr2=0x56488679d850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:02:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a937fe640 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x56488679d850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a937fe640 1 -- 172.21.15.59:0/77113259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 msgr2=0x56488679d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a937fe640 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x56488679d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a937fe640 1 -- 172.21.15.59:0/77113259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648867a1770 con 0x564886776cc0 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.386+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x56488679d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.387+0000 7f8a937fe640 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488679cdd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c011010 tx=0x7f8a8c01beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47418f31a53b087f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.387+0000 7f8a7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.387+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/77113259 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c016050 con 0x564886776cc0 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.387+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/77113259 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f8a8c009600 con 0x564886776cc0 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.387+0000 7f8a9c470740 1 -- 172.21.15.59:0/77113259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a7c011cc0 con 0x564886776cc0 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.387+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/77113259 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c042050 con 0x564886776cc0 2024-09-10T11:02:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.387+0000 7f8a9c470740 10 client.15297 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.387+0000 7f8a9c470740 1 -- 172.21.15.59:0/77113259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5648868043c0 con 0x564886776cc0 2024-09-10T11:02:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.388+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/77113259 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a7c011cc0 con 0x564886776cc0 2024-09-10T11:02:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.388+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/77113259 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a8c028040 con 0x564886776cc0 2024-09-10T11:02:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.388+0000 7f8a9c470740 10 client.15297 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.388+0000 7f8a9c470740 10 client.15297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.388+0000 7f8a9c470740 20 client.15297 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.388+0000 7f8a9c470740 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564886804a80 0x564886806ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.388+0000 7f8a9c470740 4 client.15297 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:02:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.388+0000 7f8a9c470740 1 -- 172.21.15.59:0/77113259 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5648866e8a20 con 0x564886804a80 2024-09-10T11:02:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.388+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564886804a80 0x564886806ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.389+0000 7f8a7a7fc640 10 client.15297 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.389+0000 7f8a8bfff640 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564886804a80 0x564886806ea0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9113b4ef054dcca server_cookie=2e0a58069a0977e7 in_seq=0 out_seq=0 2024-09-10T11:02:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a7a7fc640 1 -- 172.21.15.59:0/77113259 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5648866e8a20 con 0x564886804a80 2024-09-10T11:02:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a7a7fc640 10 client.15297 handle_command_reply: tid=0 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a9c470740 1 client.15297 shutdown 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a9c470740 1 -- 172.21.15.59:0/77113259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 msgr2=0x56488679cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a9c470740 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488679cdd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c011010 tx=0x7f8a8c01beb0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a9c470740 1 -- 172.21.15.59:0/77113259 shutdown_connections 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a9c470740 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564886804a80 0x564886806ea0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a9c470740 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564886781e80 0x56488679d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a9c470740 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648867775e0 0x56488679d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a7a7fc640 0 client.15297 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a9c470740 1 --2- 172.21.15.59:0/77113259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564886776cc0 0x56488679cdd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.396+0000 7f8a9c470740 1 -- 172.21.15.59:0/77113259 >> 172.21.15.59:0/77113259 conn(0x564886773230 msgr2=0x5648867913b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.397+0000 7f8a9c470740 1 -- 172.21.15.59:0/77113259 shutdown_connections 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.397+0000 7f8a9c470740 1 -- 172.21.15.59:0/77113259 wait complete. 2024-09-10T11:02:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.397+0000 7f8a9c470740 20 client.15297 trim_cache size 0 max 16384 2024-09-10T11:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:02:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.397+0000 7f8a99601640 1 -- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8a800a2f20 msgr2=0x7f8a800a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.397+0000 7f8a99601640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8a800a2f20 0x7f8a800a53e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a840ecf40 tx=0x7f8a840f5510 comp rx=0 tx=0).stop 2024-09-10T11:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.397+0000 7f8a99601640 1 -- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a941007f0 msgr2=0x7f8a941984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.397+0000 7f8a99601640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a941007f0 0x7f8a941984e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8a84005940 tx=0x7f8a840043b0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.397+0000 7f8a99601640 1 -- 172.21.15.59:0/982459854 shutdown_connections 2024-09-10T11:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.397+0000 7f8a99601640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a9419cda0 0x7f8a9419d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.398+0000 7f8a99601640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8a800a2f20 0x7f8a800a53e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.398+0000 7f8a99601640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a94101190 0x7f8a94198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.398+0000 7f8a99601640 1 --2- 172.21.15.59:0/982459854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a941007f0 0x7f8a941984e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.398+0000 7f8a99601640 1 -- 172.21.15.59:0/982459854 >> 172.21.15.59:0/982459854 conn(0x7f8a940777c0 msgr2=0x7f8a94069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.398+0000 7f8a99601640 1 -- 172.21.15.59:0/982459854 shutdown_connections 2024-09-10T11:02:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:05.398+0000 7f8a99601640 1 -- 172.21.15.59:0/982459854 wait complete. 2024-09-10T11:02:06.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:05 smithi181 ceph-mon[35409]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-10T11:02:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:05 smithi115 ceph-mon[34719]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-10T11:02:06.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:05 smithi059 ceph-mon[30978]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-10T11:02:08.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:07 smithi181 ceph-mon[35409]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-10T11:02:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:07 smithi115 ceph-mon[34719]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-10T11:02:08.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:07 smithi059 ceph-mon[30978]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-10T11:02:10.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:09 smithi181 ceph-mon[35409]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-10T11:02:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:09 smithi115 ceph-mon[34719]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-10T11:02:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:09 smithi059 ceph-mon[30978]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-10T11:02:12.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:11 smithi181 ceph-mon[35409]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-10T11:02:12.189 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:11 smithi059 ceph-mon[30978]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-10T11:02:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:11 smithi115 ceph-mon[34719]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-10T11:02:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:13 smithi181 ceph-mon[35409]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-10T11:02:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:13 smithi115 ceph-mon[34719]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-10T11:02:14.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:13 smithi059 ceph-mon[30978]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-10T11:02:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:15 smithi181 ceph-mon[35409]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-10T11:02:16.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:15 smithi115 ceph-mon[34719]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-10T11:02:16.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:15 smithi059 ceph-mon[30978]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-10T11:02:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:17 smithi181 ceph-mon[35409]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-10T11:02:18.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:17 smithi115 ceph-mon[34719]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-10T11:02:18.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:17 smithi059 ceph-mon[30978]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-10T11:02:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.533+0000 7fa0b82d9640 1 -- 172.21.15.59:0/2239496732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b01035a0 msgr2=0x7fa0b010ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.533+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/2239496732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b01035a0 0x7fa0b010ba80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009900 tx=0x7fa0a002a4a0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.533+0000 7fa0b82d9640 1 -- 172.21.15.59:0/2239496732 shutdown_connections 2024-09-10T11:02:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.533+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/2239496732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0b010c0d0 0x7fa0b010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.533+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/2239496732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b01035a0 0x7fa0b010ba80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.533+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/2239496732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b0102c80 0x7fa0b0103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.533+0000 7fa0b82d9640 1 -- 172.21.15.59:0/2239496732 >> 172.21.15.59:0/2239496732 conn(0x7fa0b0077990 msgr2=0x7fa0b00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.533+0000 7fa0b82d9640 1 -- 172.21.15.59:0/2239496732 shutdown_connections 2024-09-10T11:02:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.533+0000 7fa0b82d9640 1 -- 172.21.15.59:0/2239496732 wait complete. 2024-09-10T11:02:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.534+0000 7fa0b82d9640 1 Processor -- start 2024-09-10T11:02:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.534+0000 7fa0b82d9640 1 -- start start 2024-09-10T11:02:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b82d9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0b0102c80 0x7fa0b01961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b82d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b01035a0 0x7fa0b0196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b82d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b010c0d0 0x7fa0b019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b82d9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b010fd10 con 0x7fa0b010c0d0 2024-09-10T11:02:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b82d9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b010fb90 con 0x7fa0b0102c80 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b82d9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b010fe90 con 0x7fa0b01035a0 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6075640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0b0102c80 0x7fa0b01961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6876640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b010c0d0 0x7fa0b019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6876640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b010c0d0 0x7fa0b019aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60038/0 (socket says 172.21.15.59:60038) 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6876640 1 -- 172.21.15.59:0/341684986 learned_addr learned my addr 172.21.15.59:0/341684986 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b5874640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b01035a0 0x7fa0b0196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6075640 1 -- 172.21.15.59:0/341684986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b01035a0 msgr2=0x7fa0b0196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6075640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b01035a0 0x7fa0b0196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6075640 1 -- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b010c0d0 msgr2=0x7fa0b019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6075640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b010c0d0 0x7fa0b019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6075640 1 -- 172.21.15.59:0/341684986 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b019b1d0 con 0x7fa0b0102c80 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.535+0000 7fa0b6876640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b010c0d0 0x7fa0b019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:02:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.536+0000 7fa0b6075640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0b0102c80 0x7fa0b01961e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e9f0 tx=0x7fa0ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.536+0000 7fa0a77fe640 1 -- 172.21.15.59:0/341684986 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00ccc0 con 0x7fa0b0102c80 2024-09-10T11:02:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.536+0000 7fa0a77fe640 1 -- 172.21.15.59:0/341684986 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0ac005020 con 0x7fa0b0102c80 2024-09-10T11:02:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.536+0000 7fa0a77fe640 1 -- 172.21.15.59:0/341684986 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0049e0 con 0x7fa0b0102c80 2024-09-10T11:02:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.536+0000 7fa0b82d9640 1 -- 172.21.15.59:0/341684986 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b019b4c0 con 0x7fa0b0102c80 2024-09-10T11:02:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.536+0000 7fa0b82d9640 1 -- 172.21.15.59:0/341684986 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b01a2d50 con 0x7fa0b0102c80 2024-09-10T11:02:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.540+0000 7fa0a77fe640 1 -- 172.21.15.59:0/341684986 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) ==== 138117+0+0 (secure 0 0 0) 0x7fa0ac005560 con 0x7fa0b0102c80 2024-09-10T11:02:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.540+0000 7fa0bb06e740 1 Processor -- start 2024-09-10T11:02:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.540+0000 7fa0bb06e740 1 -- start start 2024-09-10T11:02:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.540+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0231c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e02326f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 0x556e023298b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0b6876640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0231c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0b6876640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0231c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60046/0 (socket says 172.21.15.59:60046) 2024-09-10T11:02:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556e022782f0 con 0x556e0231c300 2024-09-10T11:02:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556e02220270 con 0x556e023274c0 2024-09-10T11:02:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556e022742b0 con 0x556e0231cc20 2024-09-10T11:02:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0b6876640 1 -- 172.21.15.59:0/3628211760 learned_addr learned my addr 172.21.15.59:0/3628211760 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0b5874640 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 0x556e023298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.541+0000 7fa0b6876640 1 -- 172.21.15.59:0/3628211760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 msgr2=0x556e02326f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0b6075640 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e02326f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0a77fe640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa09c0a2f50 0x7fa09c0a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0b6876640 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e02326f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0b6876640 1 -- 172.21.15.59:0/3628211760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 msgr2=0x556e023298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0b6876640 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 0x556e023298b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0b6876640 1 -- 172.21.15.59:0/3628211760 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e0221f340 con 0x556e0231c300 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0b5874640 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 0x556e023298b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0a77fe640 1 -- 172.21.15.59:0/341684986 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fa0ac0cf750 con 0x7fa0b0102c80 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0b6876640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa09c0a2f50 0x7fa09c0a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.542+0000 7fa0b6876640 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0231c6e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c620 tx=0x7fa0a8009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a12df0391acaf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.543+0000 7fa0a4bfe640 1 -- 172.21.15.59:0/3628211760 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800a950 con 0x556e0231c300 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.543+0000 7fa0a4bfe640 1 -- 172.21.15.59:0/3628211760 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0a801d020 con 0x556e0231c300 2024-09-10T11:02:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.543+0000 7fa0a4bfe640 1 -- 172.21.15.59:0/3628211760 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80183f0 con 0x556e0231c300 2024-09-10T11:02:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0b6876640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa09c0a2f50 0x7fa09c0a5410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0a801e000 tx=0x7fa0a80189e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3628211760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 msgr2=0x556e0231c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0231c6e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c620 tx=0x7fa0a8009500 comp rx=0 tx=0).stop 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3628211760 shutdown_connections 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 0x556e023298b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e02326f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/3628211760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0231c6e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3628211760 >> 172.21.15.59:0/3628211760 conn(0x556e02318870 msgr2=0x556e02318c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3628211760 shutdown_connections 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3628211760 wait complete. 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 -- start start 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.544+0000 7fa0bb06e740 1 Processor -- start 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231c300 0x556e02324290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231cc20 0x556e023247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e02324d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556e0232a090 con 0x556e023274c0 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556e02201290 con 0x556e0231cc20 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556e0232a210 con 0x556e0231c300 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0b6876640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e02324d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0b6876640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e02324d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60048/0 (socket says 172.21.15.59:60048) 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0b6876640 1 -- 172.21.15.59:0/2948444879 learned_addr learned my addr 172.21.15.59:0/2948444879 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0b6075640 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231c300 0x556e02324290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0b5874640 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231cc20 0x556e023247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.545+0000 7fa0bb06e740 10 client.0 _ll_register_callbacks cb 0x556e02232140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa0b6876640 1 -- 172.21.15.59:0/2948444879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231c300 msgr2=0x556e02324290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa0b6876640 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231c300 0x556e02324290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa0b6876640 1 -- 172.21.15.59:0/2948444879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231cc20 msgr2=0x556e023247d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa0b6876640 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231cc20 0x556e023247d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa0b6876640 1 -- 172.21.15.59:0/2948444879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e01f8b210 con 0x556e023274c0 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa0b6075640 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231c300 0x556e02324290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa0b6876640 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e02324d10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8023c20 tx=0x7fa0a8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa442e3d3b6b613 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa099ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa099ffb640 1 -- 172.21.15.59:0/2948444879 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a801c050 con 0x556e023274c0 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa099ffb640 1 -- 172.21.15.59:0/2948444879 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fa0a800ad60 con 0x556e023274c0 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.546+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2948444879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0a801d020 con 0x556e023274c0 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa099ffb640 1 -- 172.21.15.59:0/2948444879 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa0a803b050 con 0x556e023274c0 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa0bb06e740 10 client.15309 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2948444879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556e02057620 con 0x556e023274c0 2024-09-10T11:02:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa099ffb640 1 -- 172.21.15.59:0/2948444879 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0a8023920 con 0x556e023274c0 2024-09-10T11:02:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa099ffb640 1 -- 172.21.15.59:0/2948444879 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa0a8017030 con 0x556e023274c0 2024-09-10T11:02:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa0bb06e740 10 client.15309 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa0bb06e740 10 client.15309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa0bb06e740 20 client.15309 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e02337260 0x556e02339650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa0bb06e740 4 client.15309 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:02:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.547+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2948444879 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa0a801d020 con 0x556e02337260 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.548+0000 7fa0b6075640 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e02337260 0x556e02339650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.548+0000 7fa099ffb640 10 client.15309 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.548+0000 7fa0b6075640 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e02337260 0x556e02339650 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5d34fb410e1e3e9 server_cookie=1a0ffb56363c46e4 in_seq=0 out_seq=0 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa099ffb640 1 -- 172.21.15.59:0/2948444879 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa0a801d020 con 0x556e02337260 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa099ffb640 10 client.15309 handle_command_reply: tid=0 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 client.15309 shutdown 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2948444879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 msgr2=0x556e02324d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e02324d10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8023c20 tx=0x7fa0a8014000 comp rx=0 tx=0).stop 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2948444879 shutdown_connections 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e02337260 0x556e02339650 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e02324d10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231cc20 0x556e023247d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2948444879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231c300 0x556e02324290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2948444879 >> 172.21.15.59:0/2948444879 conn(0x556e02318870 msgr2=0x556e0231e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa099ffb640 0 client.15309 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2948444879 shutdown_connections 2024-09-10T11:02:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2948444879 wait complete. 2024-09-10T11:02:18.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.549+0000 7fa0bb06e740 20 client.15309 trim_cache size 0 max 16384 2024-09-10T11:02:18.581 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.578+0000 7fa0bb06e740 1 Processor -- start 2024-09-10T11:02:18.581 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.578+0000 7fa0bb06e740 1 -- start start 2024-09-10T11:02:18.581 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.578+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231c300 0x556e0233ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.581 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.578+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0233f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e0230e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01ae020 con 0x556e023274c0 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01ab8f0 con 0x556e0231c300 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01a9740 con 0x556e0231cc20 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6876640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e0230e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6876640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e0230e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60050/0 (socket says 172.21.15.59:60050) 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6876640 1 -- 172.21.15.59:0/3182256168 learned_addr learned my addr 172.21.15.59:0/3182256168 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6075640 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231c300 0x556e0233ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b5874640 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0233f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6075640 1 -- 172.21.15.59:0/3182256168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 msgr2=0x556e0233f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6075640 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0233f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6075640 1 -- 172.21.15.59:0/3182256168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 msgr2=0x556e0230e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6075640 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e0230e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6075640 1 -- 172.21.15.59:0/3182256168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e023186a0 con 0x556e0231c300 2024-09-10T11:02:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6876640 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e0230e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:02:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b5874640 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0233f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:02:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.579+0000 7fa0b6075640 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231c300 0x556e0233ee30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0ccc40 tx=0x7fa0ac0d1be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19a5c816bf4ff79c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.580+0000 7fa09bfff640 1 -- 172.21.15.59:0/3182256168 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac01c040 con 0x556e0231c300 2024-09-10T11:02:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.580+0000 7fa09bfff640 1 -- 172.21.15.59:0/3182256168 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0ac09fdc0 con 0x556e0231c300 2024-09-10T11:02:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.580+0000 7fa09bfff640 1 -- 172.21.15.59:0/3182256168 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0a4450 con 0x556e0231c300 2024-09-10T11:02:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3182256168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231c300 msgr2=0x556e0233ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231c300 0x556e0233ee30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0ccc40 tx=0x7fa0ac0d1be0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3182256168 shutdown_connections 2024-09-10T11:02:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e023274c0 0x556e0230e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0233f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/3182256168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e0231c300 0x556e0233ee30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3182256168 >> 172.21.15.59:0/3182256168 conn(0x556e02318870 msgr2=0x556e02323380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3182256168 shutdown_connections 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 -- 172.21.15.59:0/3182256168 wait complete. 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 -- start start 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.581+0000 7fa0bb06e740 1 Processor -- start 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0232f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0232f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0bb06e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 0x556e02320640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01a9db0 con 0x556e0231c300 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01ab220 con 0x556e023274c0 2024-09-10T11:02:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0b6075640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0232f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0bb06e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01aa480 con 0x556e0231cc20 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0b6075640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0232f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60056/0 (socket says 172.21.15.59:60056) 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0b6075640 1 -- 172.21.15.59:0/2375869611 learned_addr learned my addr 172.21.15.59:0/2375869611 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0b5874640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0232f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0bb06e740 10 client.0 _ll_register_callbacks cb 0x7fa0a8004d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.582+0000 7fa0b6876640 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 0x556e02320640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa0b5874640 1 -- 172.21.15.59:0/2375869611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 msgr2=0x556e02320640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa0b5874640 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 0x556e02320640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa0b5874640 1 -- 172.21.15.59:0/2375869611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 msgr2=0x556e0232f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa0b5874640 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0232f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa0b5874640 1 -- 172.21.15.59:0/2375869611 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e02320b80 con 0x556e0231cc20 2024-09-10T11:02:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa0b6075640 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0232f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa0b5874640 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0232f9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0a002aa90 tx=0x7fa0a0005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d027f7aaa425b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa099ffb640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa099ffb640 1 -- 172.21.15.59:0/2375869611 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0035040 con 0x556e0231cc20 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.583+0000 7fa099ffb640 1 -- 172.21.15.59:0/2375869611 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fa0a0005570 con 0x556e0231cc20 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.584+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2375869611 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0ac09fdc0 con 0x556e0231cc20 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.584+0000 7fa099ffb640 1 -- 172.21.15.59:0/2375869611 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa0a00046c0 con 0x556e0231cc20 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.584+0000 7fa0bb06e740 10 client.24985 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.584+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2375869611 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556e023a1460 con 0x556e0231cc20 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.584+0000 7fa099ffb640 1 -- 172.21.15.59:0/2375869611 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0a0004d40 con 0x556e0231cc20 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.584+0000 7fa099ffb640 1 -- 172.21.15.59:0/2375869611 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa0a0003c60 con 0x556e0231cc20 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.585+0000 7fa0bb06e740 10 client.24985 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.585+0000 7fa0bb06e740 10 client.24985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.585+0000 7fa0bb06e740 20 client.24985 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.585+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e023a1be0 0x556e023a4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.585+0000 7fa0bb06e740 4 client.24985 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:02:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.585+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2375869611 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa0ac09fdc0 con 0x556e023a1be0 2024-09-10T11:02:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.585+0000 7fa0b6075640 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e023a1be0 0x556e023a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.585+0000 7fa0b6075640 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e023a1be0 0x556e023a4000 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79f421d5ade40f33 server_cookie=8ed334e0dd1eca16 in_seq=0 out_seq=0 2024-09-10T11:02:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.585+0000 7fa099ffb640 10 client.24985 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.588+0000 7fa099ffb640 1 -- 172.21.15.59:0/2375869611 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa0ac09fdc0 con 0x556e023a1be0 2024-09-10T11:02:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.588+0000 7fa099ffb640 10 client.24985 handle_command_reply: tid=0 2024-09-10T11:02:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 client.24985 shutdown 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2375869611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 msgr2=0x556e0232f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0232f9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0a002aa90 tx=0x7fa0a0005270 comp rx=0 tx=0).stop 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2375869611 shutdown_connections 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e023a1be0 0x556e023a4000 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e023274c0 0x556e02320640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa099ffb640 0 client.24985 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e0231cc20 0x556e0232f9e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 --2- 172.21.15.59:0/2375869611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e0231c300 0x556e0232f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2375869611 >> 172.21.15.59:0/2375869611 conn(0x556e02318870 msgr2=0x556e02325af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2375869611 shutdown_connections 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 1 -- 172.21.15.59:0/2375869611 wait complete. 2024-09-10T11:02:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.589+0000 7fa0bb06e740 20 client.24985 trim_cache size 0 max 16384 2024-09-10T11:02:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:02:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:02:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:02:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:02:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 -- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa09c0a2f50 msgr2=0x7fa09c0a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa09c0a2f50 0x7fa09c0a5410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0a801e000 tx=0x7fa0a80189e0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 -- 172.21.15.59:0/341684986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0b0102c80 msgr2=0x7fa0b01961e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0b0102c80 0x7fa0b01961e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e9f0 tx=0x7fa0ac00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 -- 172.21.15.59:0/341684986 shutdown_connections 2024-09-10T11:02:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0b010c0d0 0x7fa0b019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa09c0a2f50 0x7fa09c0a5410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0b01035a0 0x7fa0b0196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 --2- 172.21.15.59:0/341684986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0b0102c80 0x7fa0b01961e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 -- 172.21.15.59:0/341684986 >> 172.21.15.59:0/341684986 conn(0x7fa0b0077990 msgr2=0x7fa0b00fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 -- 172.21.15.59:0/341684986 shutdown_connections 2024-09-10T11:02:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:18.590+0000 7fa0b82d9640 1 -- 172.21.15.59:0/341684986 wait complete. 2024-09-10T11:02:20.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:19 smithi181 ceph-mon[35409]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-10T11:02:20.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:19 smithi115 ceph-mon[34719]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-10T11:02:20.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:19 smithi059 ceph-mon[30978]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-10T11:02:22.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:21 smithi181 ceph-mon[35409]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-10T11:02:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:21 smithi115 ceph-mon[34719]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-10T11:02:22.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:21 smithi059 ceph-mon[30978]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-10T11:02:24.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:23 smithi181 ceph-mon[35409]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:02:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:23 smithi115 ceph-mon[34719]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:02:24.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:23 smithi059 ceph-mon[30978]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T11:02:26.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:25 smithi181 ceph-mon[35409]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T11:02:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:25 smithi115 ceph-mon[34719]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T11:02:26.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:25 smithi059 ceph-mon[30978]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T11:02:27.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:02:27.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:02:27.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:02:27.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:26 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:02:27.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:02:27.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:02:27.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:02:27.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:26 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:02:27.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:02:27.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:02:27.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:02:27.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:26 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:02:28.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:27 smithi181 ceph-mon[35409]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T11:02:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:27 smithi115 ceph-mon[34719]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T11:02:28.304 INFO:tasks.workunit.client.0.smithi059.stderr:Updating files: 91% (11642/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T11:02:28.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:27 smithi059 ceph-mon[30978]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T11:02:28.861 INFO:tasks.workunit.client.0.smithi059.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T11:02:28.861 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T11:02:28.861 INFO:tasks.workunit.client.0.smithi059.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr: git switch -c 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr:Or undo this operation with: 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr: git switch - 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T11:02:28.862 INFO:tasks.workunit.client.0.smithi059.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T11:02:28.863 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T11:02:28.863 INFO:tasks.workunit.client.0.smithi059.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T11:02:28.867 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T11:02:28.933 INFO:tasks.workunit.client.0.smithi059.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T11:02:28.935 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T11:02:28.935 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T11:02:29.623 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T11:02:29.707 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T11:02:29.752 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T11:02:29.753 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T11:02:29.754 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T11:02:29.795 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T11:02:29.798 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T11:02:29.798 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T11:02:29.855 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-10T11:02:29.857 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-10T11:02:29.857 DEBUG:teuthology.orchestra.run.smithi059:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-10T11:02:29.918 INFO:tasks.workunit.client.0.smithi059.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-10T11:02:29.918 INFO:tasks.workunit.client.0.smithi059.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-10T11:02:29.918 INFO:tasks.workunit.client.0.smithi059.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-10T11:02:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:29 smithi181 ceph-mon[35409]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T11:02:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:29 smithi115 ceph-mon[34719]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T11:02:30.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:29 smithi059 ceph-mon[30978]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T11:02:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.693+0000 7f1e4b62e640 1 -- 172.21.15.59:0/2557149818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e441009f0 msgr2=0x7f1e44100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.693+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/2557149818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e441009f0 0x7f1e44100e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009930 tx=0x7f1e3402a420 comp rx=0 tx=0).stop 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.693+0000 7f1e4b62e640 1 -- 172.21.15.59:0/2557149818 shutdown_connections 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.693+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/2557149818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e44101390 0x7f1e4410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.693+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/2557149818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e441009f0 0x7f1e44100e50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.693+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/2557149818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e44106a00 0x7f1e44106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.693+0000 7f1e4b62e640 1 -- 172.21.15.59:0/2557149818 >> 172.21.15.59:0/2557149818 conn(0x7f1e440fc6b0 msgr2=0x7f1e440fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.693+0000 7f1e4b62e640 1 -- 172.21.15.59:0/2557149818 shutdown_connections 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.693+0000 7f1e4b62e640 1 -- 172.21.15.59:0/2557149818 wait complete. 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.694+0000 7f1e4b62e640 1 Processor -- start 2024-09-10T11:02:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.694+0000 7f1e4b62e640 1 -- start start 2024-09-10T11:02:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.694+0000 7f1e4b62e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e441009f0 0x7f1e441983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.694+0000 7f1e4b62e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e44101390 0x7f1e44198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.694+0000 7f1e4b62e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e44106a00 0x7f1e4419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.694+0000 7f1e4b62e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1e44111f30 con 0x7f1e44106a00 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.694+0000 7f1e4b62e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1e44111db0 con 0x7f1e44101390 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.694+0000 7f1e4b62e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e441120b0 con 0x7f1e441009f0 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.694+0000 7f1e49bcb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e44106a00 0x7f1e4419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e49bcb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e44106a00 0x7f1e4419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41096/0 (socket says 172.21.15.59:41096) 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e49bcb640 1 -- 172.21.15.59:0/3239447633 learned_addr learned my addr 172.21.15.59:0/3239447633 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e44101390 0x7f1e44198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e493ca640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e441009f0 0x7f1e441983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e49bcb640 1 -- 172.21.15.59:0/3239447633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e441009f0 msgr2=0x7f1e441983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e49bcb640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e441009f0 0x7f1e441983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e49bcb640 1 -- 172.21.15.59:0/3239447633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e44101390 msgr2=0x7f1e44198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e49bcb640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e44101390 0x7f1e44198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e49bcb640 1 -- 172.21.15.59:0/3239447633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4419d3b0 con 0x7f1e44106a00 2024-09-10T11:02:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e44101390 0x7f1e44198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:02:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e49bcb640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e44106a00 0x7f1e4419cc80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00eb10 tx=0x7f1e3c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e3a7fc640 1 -- 172.21.15.59:0/3239447633 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c004b20 con 0x7f1e44106a00 2024-09-10T11:02:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e4b62e640 1 -- 172.21.15.59:0/3239447633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4419d6a0 con 0x7f1e44106a00 2024-09-10T11:02:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e3a7fc640 1 -- 172.21.15.59:0/3239447633 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e3c004cc0 con 0x7f1e44106a00 2024-09-10T11:02:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e3a7fc640 1 -- 172.21.15.59:0/3239447633 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c010760 con 0x7f1e44106a00 2024-09-10T11:02:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.695+0000 7f1e4b62e640 1 -- 172.21.15.59:0/3239447633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e441a4f30 con 0x7f1e44106a00 2024-09-10T11:02:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.698+0000 7f1e3a7fc640 1 -- 172.21.15.59:0/3239447633 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 138117+0+0 (secure 0 0 0) 0x7f1e3c005020 con 0x7f1e44106a00 2024-09-10T11:02:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.698+0000 7f1e4e3cd740 1 Processor -- start 2024-09-10T11:02:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.698+0000 7f1e4e3cd740 1 -- start start 2024-09-10T11:02:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.698+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 0x5592de149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de154770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 0x5592de1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5592de0ae2f0 con 0x5592de14a410 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5592de056270 con 0x5592de154cb0 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5592de0aa2b0 con 0x5592de149af0 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e493ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e493ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41108/0 (socket says 172.21.15.59:41108) 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e493ca640 1 -- 172.21.15.59:0/1362908350 learned_addr learned my addr 172.21.15.59:0/1362908350 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/1362908350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 0x5592de149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e3a7fc640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f1e300a2f50 0x7f1e300a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e49bcb640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f1e300a2f50 0x7f1e300a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/1362908350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 0x5592de1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e493ca640 1 -- 172.21.15.59:0/1362908350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 msgr2=0x5592de149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e493ca640 1 --2- 172.21.15.59:0/1362908350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 0x5592de149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e493ca640 1 -- 172.21.15.59:0/1362908350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 msgr2=0x5592de1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e493ca640 1 --2- 172.21.15.59:0/1362908350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 0x5592de1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e493ca640 1 -- 172.21.15.59:0/1362908350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592de055340 con 0x5592de14a410 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e3a7fc640 1 -- 172.21.15.59:0/3239447633 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f1e3c0cff40 con 0x7f1e44106a00 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.699+0000 7f1e493ca640 1 --2- 172.21.15.59:0/1362908350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de154770 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009c00 tx=0x7f1e400117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82920c23fa703fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e49bcb640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f1e300a2f50 0x7f1e300a5410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0cd490 tx=0x7f1e3c06b130 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e2f7fe640 1 -- 172.21.15.59:0/1362908350 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40012450 con 0x5592de14a410 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e2f7fe640 1 -- 172.21.15.59:0/1362908350 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e40012ad0 con 0x5592de14a410 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e2f7fe640 1 -- 172.21.15.59:0/1362908350 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000fab0 con 0x5592de14a410 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1362908350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 msgr2=0x5592de154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1362908350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de154770 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009c00 tx=0x7f1e400117b0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1362908350 shutdown_connections 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1362908350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 0x5592de1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1362908350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de154770 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1362908350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 0x5592de149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1362908350 >> 172.21.15.59:0/1362908350 conn(0x5592de146060 msgr2=0x5592de146440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1362908350 shutdown_connections 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.700+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1362908350 wait complete. 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.701+0000 7f1e4e3cd740 1 -- start start 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.701+0000 7f1e4e3cd740 1 Processor -- start 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.701+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 0x5592de151b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.701+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de1520b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.701+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de154cb0 0x5592de1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.701+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5592de157880 con 0x5592de14a410 2024-09-10T11:02:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.701+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5592de037290 con 0x5592de149af0 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.701+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5592de157a00 con 0x5592de154cb0 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.701+0000 7f1e4e3cd740 10 client.0 _ll_register_callbacks cb 0x5592de068140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e493ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de1520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e493ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de1520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41112/0 (socket says 172.21.15.59:41112) 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e493ca640 1 -- 172.21.15.59:0/1315103036 learned_addr learned my addr 172.21.15.59:0/1315103036 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 0x5592de151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de154cb0 0x5592de1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e493ca640 1 -- 172.21.15.59:0/1315103036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de154cb0 msgr2=0x5592de1525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e493ca640 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de154cb0 0x5592de1525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e493ca640 1 -- 172.21.15.59:0/1315103036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 msgr2=0x5592de151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e493ca640 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 0x5592de151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e493ca640 1 -- 172.21.15.59:0/1315103036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592dddc1210 con 0x5592de14a410 2024-09-10T11:02:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e493ca640 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de1520b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1e400056f0 tx=0x7f1e40005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4eb652160f67a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e2cff9640 1 -- 172.21.15.59:0/1315103036 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40029020 con 0x5592de14a410 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e2cff9640 1 -- 172.21.15.59:0/1315103036 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f1e40012660 con 0x5592de14a410 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.702+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1315103036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e40012ad0 con 0x5592de14a410 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e2cff9640 1 -- 172.21.15.59:0/1315103036 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e40034050 con 0x5592de14a410 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e4e3cd740 10 client.15327 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1315103036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5592dde8d620 con 0x5592de14a410 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e2cff9640 1 -- 172.21.15.59:0/1315103036 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e40012ad0 con 0x5592de14a410 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e2cff9640 1 -- 172.21.15.59:0/1315103036 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1e40003680 con 0x5592de14a410 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e4e3cd740 10 client.15327 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e4e3cd740 10 client.15327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e4e3cd740 20 client.15327 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5592de164b20 0x5592de166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e4e3cd740 4 client.15327 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:02:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1315103036 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592de0bba20 con 0x5592de164b20 2024-09-10T11:02:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.703+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5592de164b20 0x5592de166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.704+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5592de164b20 0x5592de166f10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6205a90c3b25ae42 server_cookie=a3d4362af3125eab in_seq=0 out_seq=0 2024-09-10T11:02:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.704+0000 7f1e2cff9640 10 client.15327 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e2cff9640 1 -- 172.21.15.59:0/1315103036 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5592de0bba20 con 0x5592de164b20 2024-09-10T11:02:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e2cff9640 10 client.15327 handle_command_reply: tid=0 2024-09-10T11:02:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 client.15327 shutdown 2024-09-10T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1315103036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 msgr2=0x5592de1520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de1520b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1e400056f0 tx=0x7f1e40005720 comp rx=0 tx=0).stop 2024-09-10T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1315103036 shutdown_connections 2024-09-10T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5592de164b20 0x5592de166f10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de154cb0 0x5592de1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e2cff9640 0 client.15327 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de1520b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/1315103036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 0x5592de151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1315103036 >> 172.21.15.59:0/1315103036 conn(0x5592de146060 msgr2=0x5592de1451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1315103036 shutdown_connections 2024-09-10T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/1315103036 wait complete. 2024-09-10T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.705+0000 7f1e4e3cd740 20 client.15327 trim_cache size 0 max 16384 2024-09-10T11:02:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e4e3cd740 1 Processor -- start 2024-09-10T11:02:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e4e3cd740 1 -- start start 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 0x5592de161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de152420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 0x5592de16c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1e441b02b0 con 0x5592de14a410 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1e441adb80 con 0x5592de154cb0 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e441ab9d0 con 0x5592de149af0 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e493ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e493ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41120/0 (socket says 172.21.15.59:41120) 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e493ca640 1 -- 172.21.15.59:0/2034116123 learned_addr learned my addr 172.21.15.59:0/2034116123 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.720+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 0x5592de16c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 0x5592de161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e493ca640 1 -- 172.21.15.59:0/2034116123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 msgr2=0x5592de161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e493ca640 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 0x5592de161210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e493ca640 1 -- 172.21.15.59:0/2034116123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 msgr2=0x5592de16c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e493ca640 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 0x5592de16c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e493ca640 1 -- 172.21.15.59:0/2034116123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592de150b00 con 0x5592de14a410 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 0x5592de16c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e493ca640 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de152420 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009c00 tx=0x7f1e40011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88221416ca4ebe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e2effd640 1 -- 172.21.15.59:0/2034116123 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40029040 con 0x5592de14a410 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e2effd640 1 -- 172.21.15.59:0/2034116123 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e40005520 con 0x5592de14a410 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.721+0000 7f1e2effd640 1 -- 172.21.15.59:0/2034116123 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000f760 con 0x5592de14a410 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/2034116123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 msgr2=0x5592de152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de152420 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009c00 tx=0x7f1e40011d60 comp rx=0 tx=0).stop 2024-09-10T11:02:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/2034116123 shutdown_connections 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de154cb0 0x5592de16c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de152420 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/2034116123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de149af0 0x5592de161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/2034116123 >> 172.21.15.59:0/2034116123 conn(0x5592de146060 msgr2=0x5592de153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/2034116123 shutdown_connections 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/2034116123 wait complete. 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 -- start start 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.722+0000 7f1e4e3cd740 1 Processor -- start 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 0x5592de15d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e4e3cd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de154cb0 0x5592de14f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1e441ac040 con 0x5592de14a410 2024-09-10T11:02:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1e441ad4b0 con 0x5592de149af0 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e4e3cd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1e441ac710 con 0x5592de154cb0 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e4e3cd740 10 client.0 _ll_register_callbacks cb 0x7f1e40005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e493ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e493ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de14e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41124/0 (socket says 172.21.15.59:41124) 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e493ca640 1 -- 172.21.15.59:0/359589715 learned_addr learned my addr 172.21.15.59:0/359589715 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 0x5592de15d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e493ca640 1 -- 172.21.15.59:0/359589715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de154cb0 msgr2=0x5592de14f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e493ca640 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de154cb0 0x5592de14f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e493ca640 1 -- 172.21.15.59:0/359589715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 msgr2=0x5592de15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e493ca640 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 0x5592de15d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e493ca640 1 -- 172.21.15.59:0/359589715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592de1ce560 con 0x5592de14a410 2024-09-10T11:02:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 0x5592de15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e493ca640 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de14e9f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1e40003c40 tx=0x7f1e40005930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0068604d87a6042 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e2cff9640 1 -- 172.21.15.59:0/359589715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40029040 con 0x5592de14a410 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e2cff9640 1 -- 172.21.15.59:0/359589715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f1e40003800 con 0x5592de14a410 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.723+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/359589715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e40005520 con 0x5592de14a410 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e2cff9640 1 -- 172.21.15.59:0/359589715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e4004e050 con 0x5592de14a410 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e4e3cd740 10 client.15333 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/359589715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5592de1cf710 con 0x5592de14a410 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e2cff9640 1 -- 172.21.15.59:0/359589715 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e40005520 con 0x5592de14a410 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e2cff9640 1 -- 172.21.15.59:0/359589715 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1e40041450 con 0x5592de14a410 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e4e3cd740 10 client.15333 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e4e3cd740 10 client.15333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e4e3cd740 20 client.15333 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5592de1cfd70 0x5592de1d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e4e3cd740 4 client.15333 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:02:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/359589715 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5592de0b5d70 con 0x5592de1cfd70 2024-09-10T11:02:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.724+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5592de1cfd70 0x5592de1d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.725+0000 7f1e2cff9640 10 client.15333 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.725+0000 7f1e48bc9640 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5592de1cfd70 0x5592de1d2190 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77d07287ccde7675 server_cookie=8aacc116fcc0ef70 in_seq=0 out_seq=0 2024-09-10T11:02:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e2cff9640 1 -- 172.21.15.59:0/359589715 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5592de0b5d70 con 0x5592de1cfd70 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e2cff9640 10 client.15333 handle_command_reply: tid=0 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e4e3cd740 1 client.15333 shutdown 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/359589715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 msgr2=0x5592de14e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de14e9f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1e40003c40 tx=0x7f1e40005930 comp rx=0 tx=0).stop 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/359589715 shutdown_connections 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5592de1cfd70 0x5592de1d2190 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592de154cb0 0x5592de14f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e2cff9640 0 client.15333 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.733+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5592de14a410 0x5592de14e9f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4e3cd740 1 --2- 172.21.15.59:0/359589715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5592de149af0 0x5592de15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/359589715 >> 172.21.15.59:0/359589715 conn(0x5592de146060 msgr2=0x5592de14b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/359589715 shutdown_connections 2024-09-10T11:02:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4e3cd740 1 -- 172.21.15.59:0/359589715 wait complete. 2024-09-10T11:02:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4e3cd740 20 client.15333 trim_cache size 0 max 16384 2024-09-10T11:02:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:02:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:02:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:02:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:02:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 -- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f1e300a2f50 msgr2=0x7f1e300a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f1e300a2f50 0x7f1e300a5410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0cd490 tx=0x7f1e3c06b130 comp rx=0 tx=0).stop 2024-09-10T11:02:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 -- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e44106a00 msgr2=0x7f1e4419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e44106a00 0x7f1e4419cc80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00eb10 tx=0x7f1e3c00c2d0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 -- 172.21.15.59:0/3239447633 shutdown_connections 2024-09-10T11:02:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e44106a00 0x7f1e4419cc80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e44101390 0x7f1e44198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f1e300a2f50 0x7f1e300a5410 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 --2- 172.21.15.59:0/3239447633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e441009f0 0x7f1e441983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.734+0000 7f1e4b62e640 1 -- 172.21.15.59:0/3239447633 >> 172.21.15.59:0/3239447633 conn(0x7f1e440fc6b0 msgr2=0x7f1e440fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.735+0000 7f1e4b62e640 1 -- 172.21.15.59:0/3239447633 shutdown_connections 2024-09-10T11:02:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:31.735+0000 7f1e4b62e640 1 -- 172.21.15.59:0/3239447633 wait complete. 2024-09-10T11:02:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:31 smithi115 ceph-mon[34719]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T11:02:32.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:31 smithi059 ceph-mon[30978]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T11:02:32.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:31 smithi181 ceph-mon[35409]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T11:02:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:33 smithi115 ceph-mon[34719]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T11:02:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:33 smithi059 ceph-mon[30978]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T11:02:34.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:33 smithi181 ceph-mon[35409]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T11:02:36.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:35 smithi115 ceph-mon[34719]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.9 KiB/s wr, 12 op/s 2024-09-10T11:02:36.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:35 smithi059 ceph-mon[30978]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.9 KiB/s wr, 12 op/s 2024-09-10T11:02:36.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:35 smithi181 ceph-mon[35409]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.9 KiB/s wr, 12 op/s 2024-09-10T11:02:38.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:37 smithi115 ceph-mon[34719]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.7 KiB/s wr, 9 op/s 2024-09-10T11:02:38.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:37 smithi059 ceph-mon[30978]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.7 KiB/s wr, 9 op/s 2024-09-10T11:02:38.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:37 smithi181 ceph-mon[35409]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.7 KiB/s wr, 9 op/s 2024-09-10T11:02:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:39 smithi115 ceph-mon[34719]: pgmap v41: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-10T11:02:40.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:39 smithi059 ceph-mon[30978]: pgmap v41: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-10T11:02:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:39 smithi181 ceph-mon[35409]: pgmap v41: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-10T11:02:42.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:41 smithi115 ceph-mon[34719]: pgmap v42: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-10T11:02:42.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:41 smithi059 ceph-mon[30978]: pgmap v42: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-10T11:02:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:41 smithi181 ceph-mon[35409]: pgmap v42: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-10T11:02:44.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:43 smithi115 ceph-mon[34719]: pgmap v43: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-10T11:02:44.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:43 smithi059 ceph-mon[30978]: pgmap v43: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-10T11:02:44.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:43 smithi181 ceph-mon[35409]: pgmap v43: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-10T11:02:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.835+0000 7f6ae5518640 1 -- 172.21.15.59:0/1445410079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 msgr2=0x7f6ae0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.835+0000 7f6ae5518640 1 --2- 172.21.15.59:0/1445410079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 0x7f6ae0100e50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009930 tx=0x7f6ac802a420 comp rx=0 tx=0).stop 2024-09-10T11:02:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.835+0000 7f6ae5518640 1 -- 172.21.15.59:0/1445410079 shutdown_connections 2024-09-10T11:02:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.835+0000 7f6ae5518640 1 --2- 172.21.15.59:0/1445410079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ae0101390 0x7f6ae010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.835+0000 7f6ae5518640 1 --2- 172.21.15.59:0/1445410079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 0x7f6ae0100e50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.835+0000 7f6ae5518640 1 --2- 172.21.15.59:0/1445410079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ae0106a00 0x7f6ae0106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.835+0000 7f6ae5518640 1 -- 172.21.15.59:0/1445410079 >> 172.21.15.59:0/1445410079 conn(0x7f6ae00fc6b0 msgr2=0x7f6ae00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.835+0000 7f6ae5518640 1 -- 172.21.15.59:0/1445410079 shutdown_connections 2024-09-10T11:02:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.835+0000 7f6ae5518640 1 -- 172.21.15.59:0/1445410079 wait complete. 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.836+0000 7f6ae5518640 1 Processor -- start 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.836+0000 7f6ae5518640 1 -- start start 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.836+0000 7f6ae5518640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 0x7f6ae0197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.836+0000 7f6ae5518640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ae0101390 0x7f6ae01977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.836+0000 7f6ae5518640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ae0106a00 0x7f6ae019bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.836+0000 7f6ae5518640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0110e40 con 0x7f6ae01009f0 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.836+0000 7f6ae5518640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0110cc0 con 0x7f6ae0106a00 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.836+0000 7f6ae5518640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0110fc0 con 0x7f6ae0101390 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 0x7f6ae0197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 0x7f6ae0197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42028/0 (socket says 172.21.15.59:42028) 2024-09-10T11:02:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adeffd640 1 -- 172.21.15.59:0/338241941 learned_addr learned my addr 172.21.15.59:0/338241941 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ae0101390 0x7f6ae01977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ae0106a00 0x7f6ae019bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adeffd640 1 -- 172.21.15.59:0/338241941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ae0101390 msgr2=0x7f6ae01977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adeffd640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ae0101390 0x7f6ae01977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adeffd640 1 -- 172.21.15.59:0/338241941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ae0106a00 msgr2=0x7f6ae019bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adeffd640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ae0106a00 0x7f6ae019bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adeffd640 1 -- 172.21.15.59:0/338241941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae019c280 con 0x7f6ae01009f0 2024-09-10T11:02:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6adeffd640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 0x7f6ae0197290 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000d950 tx=0x7f6ad000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:44.841 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6ad7fff640 1 -- 172.21.15.59:0/338241941 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0017070 con 0x7f6ae01009f0 2024-09-10T11:02:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6ad7fff640 1 -- 172.21.15.59:0/338241941 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad0009c30 con 0x7f6ae01009f0 2024-09-10T11:02:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6ae5518640 1 -- 172.21.15.59:0/338241941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae019c570 con 0x7f6ae01009f0 2024-09-10T11:02:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6ad7fff640 1 -- 172.21.15.59:0/338241941 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000f6b0 con 0x7f6ae01009f0 2024-09-10T11:02:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.837+0000 7f6ae5518640 1 -- 172.21.15.59:0/338241941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae01a3e00 con 0x7f6ae01009f0 2024-09-10T11:02:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.840+0000 7f6ad7fff640 1 -- 172.21.15.59:0/338241941 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 138117+0+0 (secure 0 0 0) 0x7f6ad00109d0 con 0x7f6ae01009f0 2024-09-10T11:02:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.840+0000 7f6ae82b1740 1 Processor -- start 2024-09-10T11:02:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.840+0000 7f6ae82b1740 1 -- start start 2024-09-10T11:02:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 0x55ee59eb9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 0x55ee59ec6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ee59e1e2f0 con 0x55ee59ec6ec0 2024-09-10T11:02:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ee59dc6270 con 0x55ee59eba2d0 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ee59e1a2b0 con 0x55ee59eb99b0 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ade7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ad7fff640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6acc0a2f50 0x7f6acc0a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ade7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42034/0 (socket says 172.21.15.59:42034) 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ade7fc640 1 -- 172.21.15.59:0/2028292583 learned_addr learned my addr 172.21.15.59:0/2028292583 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6adeffd640 1 --2- 172.21.15.59:0/2028292583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 0x55ee59ec6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/2028292583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 0x55ee59eb9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6acc0a2f50 0x7f6acc0a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ade7fc640 1 -- 172.21.15.59:0/2028292583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 msgr2=0x55ee59eb9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/2028292583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 0x55ee59eb9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ade7fc640 1 -- 172.21.15.59:0/2028292583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 msgr2=0x55ee59ec6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/2028292583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 0x55ee59ec6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ade7fc640 1 -- 172.21.15.59:0/2028292583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee59dc5340 con 0x55ee59ec6ec0 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.841+0000 7f6ad7fff640 1 -- 172.21.15.59:0/338241941 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f6ad00cf2f0 con 0x7f6ae01009f0 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.842+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/2028292583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec92b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6ac802a940 tx=0x7f6ac8005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2d15c7c12e65dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.842+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6acc0a2f50 0x7f6acc0a5410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009fd0 tx=0x7f6ad8005bd0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.842+0000 7f6ad57fa640 1 -- 172.21.15.59:0/2028292583 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8040070 con 0x55ee59ec6ec0 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.842+0000 7f6ad57fa640 1 -- 172.21.15.59:0/2028292583 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ac80319f0 con 0x55ee59ec6ec0 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.842+0000 7f6ad57fa640 1 -- 172.21.15.59:0/2028292583 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8035040 con 0x55ee59ec6ec0 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.842+0000 7f6ae82b1740 1 -- 172.21.15.59:0/2028292583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 msgr2=0x55ee59ec92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.842+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/2028292583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec92b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6ac802a940 tx=0x7f6ac8005c00 comp rx=0 tx=0).stop 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 -- 172.21.15.59:0/2028292583 shutdown_connections 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/2028292583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec92b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/2028292583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 0x55ee59ec6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/2028292583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 0x55ee59eb9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 -- 172.21.15.59:0/2028292583 >> 172.21.15.59:0/2028292583 conn(0x55ee59eb6060 msgr2=0x55ee59eb6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 -- 172.21.15.59:0/2028292583 shutdown_connections 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 -- 172.21.15.59:0/2028292583 wait complete. 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 -- start start 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 Processor -- start 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59eb99b0 0x55ee59ec3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 0x55ee59ec42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ee59ec9a30 con 0x55ee59eb99b0 2024-09-10T11:02:44.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ee59da7290 con 0x55ee59ec6ec0 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ee59ec9bb0 con 0x55ee59eba2d0 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6ae82b1740 10 client.0 _ll_register_callbacks cb 0x55ee59dd8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.843+0000 7f6adeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59eb99b0 0x55ee59ec3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59eb99b0 0x55ee59ec3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42042/0 (socket says 172.21.15.59:42042) 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adeffd640 1 -- 172.21.15.59:0/225564518 learned_addr learned my addr 172.21.15.59:0/225564518 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 0x55ee59ec42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adeffd640 1 -- 172.21.15.59:0/225564518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 msgr2=0x55ee59ec42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adeffd640 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 0x55ee59ec42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adeffd640 1 -- 172.21.15.59:0/225564518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59ec6ec0 msgr2=0x55ee59ec47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adeffd640 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adeffd640 1 -- 172.21.15.59:0/225564518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee59b31210 con 0x55ee59eb99b0 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 0x55ee59ec42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6adeffd640 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59eb99b0 0x55ee59ec3d60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00cc8d0 tx=0x7f6ad000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ade311ff75ef70e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6ac67fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6ac67fc640 1 -- 172.21.15.59:0/225564518 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0020040 con 0x55ee59eb99b0 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6ac67fc640 1 -- 172.21.15.59:0/225564518 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f6ad0097c20 con 0x55ee59eb99b0 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6ae82b1740 1 -- 172.21.15.59:0/225564518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ac80319f0 con 0x55ee59eb99b0 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6ac67fc640 1 -- 172.21.15.59:0/225564518 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ad009bcb0 con 0x55ee59eb99b0 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6ae82b1740 10 client.15345 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.844+0000 7f6ae82b1740 1 -- 172.21.15.59:0/225564518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ee59bfd620 con 0x55ee59eb99b0 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.845+0000 7f6ac67fc640 1 -- 172.21.15.59:0/225564518 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ac80319f0 con 0x55ee59eb99b0 2024-09-10T11:02:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.845+0000 7f6ac67fc640 1 -- 172.21.15.59:0/225564518 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6ad001ad20 con 0x55ee59eb99b0 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.845+0000 7f6ae82b1740 10 client.15345 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.845+0000 7f6ae82b1740 10 client.15345 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.845+0000 7f6ae82b1740 20 client.15345 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.845+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ee59ed6d50 0x55ee59ed91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.845+0000 7f6ae82b1740 4 client.15345 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.845+0000 7f6ae82b1740 1 -- 172.21.15.59:0/225564518 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee59e2ba20 con 0x55ee59ed6d50 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.845+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ee59ed6d50 0x55ee59ed91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.846+0000 7f6ac67fc640 10 client.15345 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.846+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ee59ed6d50 0x55ee59ed91c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c31cc54c2175b8 server_cookie=40e78c883fd9807c in_seq=0 out_seq=0 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.846+0000 7f6ac67fc640 1 -- 172.21.15.59:0/225564518 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee59e2ba20 con 0x55ee59ed6d50 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.846+0000 7f6ac67fc640 10 client.15345 handle_command_reply: tid=0 2024-09-10T11:02:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 client.15345 shutdown 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 -- 172.21.15.59:0/225564518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59eb99b0 msgr2=0x55ee59ec3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59eb99b0 0x55ee59ec3d60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00cc8d0 tx=0x7f6ad000bf60 comp rx=0 tx=0).stop 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 -- 172.21.15.59:0/225564518 shutdown_connections 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ee59ed6d50 0x55ee59ed91c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 0x55ee59ec42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ac67fc640 0 client.15345 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/225564518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59eb99b0 0x55ee59ec3d60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 -- 172.21.15.59:0/225564518 >> 172.21.15.59:0/225564518 conn(0x55ee59eb6060 msgr2=0x55ee59ebbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 -- 172.21.15.59:0/225564518 shutdown_connections 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 1 -- 172.21.15.59:0/225564518 wait complete. 2024-09-10T11:02:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.847+0000 7f6ae82b1740 20 client.15345 trim_cache size 0 max 16384 2024-09-10T11:02:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6ae82b1740 1 Processor -- start 2024-09-10T11:02:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6ae82b1740 1 -- start start 2024-09-10T11:02:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 0x55ee59eb50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 0x55ee59edead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59edf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01adfd0 con 0x55ee59ec6ec0 2024-09-10T11:02:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01ab8a0 con 0x55ee59eba2d0 2024-09-10T11:02:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01a96f0 con 0x55ee59eb99b0 2024-09-10T11:02:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59edf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59edf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42056/0 (socket says 172.21.15.59:42056) 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6adf7fe640 1 -- 172.21.15.59:0/3314752792 learned_addr learned my addr 172.21.15.59:0/3314752792 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6adeffd640 1 --2- 172.21.15.59:0/3314752792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 0x55ee59eb50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.862+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/3314752792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 0x55ee59edead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.863+0000 7f6adf7fe640 1 -- 172.21.15.59:0/3314752792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 msgr2=0x55ee59eb50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.863+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/3314752792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 0x55ee59eb50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.863+0000 7f6adf7fe640 1 -- 172.21.15.59:0/3314752792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 msgr2=0x55ee59edead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.863+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/3314752792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 0x55ee59edead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.863+0000 7f6adf7fe640 1 -- 172.21.15.59:0/3314752792 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee59eb5e90 con 0x55ee59ec6ec0 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.863+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/3314752792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59edf010 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8010900 tx=0x7f6ad8009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4af6b981ec73c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.863+0000 7f6ad4ff9640 1 -- 172.21.15.59:0/3314752792 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8004b20 con 0x55ee59ec6ec0 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.863+0000 7f6ad4ff9640 1 -- 172.21.15.59:0/3314752792 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad8024070 con 0x55ee59ec6ec0 2024-09-10T11:02:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.863+0000 7f6ad4ff9640 1 -- 172.21.15.59:0/3314752792 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8005540 con 0x55ee59ec6ec0 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3314752792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 msgr2=0x55ee59edf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3314752792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59edf010 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8010900 tx=0x7f6ad8009720 comp rx=0 tx=0).stop 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3314752792 shutdown_connections 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3314752792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59edf010 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3314752792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eba2d0 0x55ee59edead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3314752792 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eb99b0 0x55ee59eb50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3314752792 >> 172.21.15.59:0/3314752792 conn(0x55ee59eb6060 msgr2=0x55ee59eb49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3314752792 shutdown_connections 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3314752792 wait complete. 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 -- start start 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 Processor -- start 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eb99b0 0x55ee59ecee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 0x55ee59ecf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01a9d60 con 0x55ee59ec6ec0 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01ab1d0 con 0x55ee59eb99b0 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.864+0000 7f6ae82b1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01aa430 con 0x55ee59eba2d0 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6ae82b1740 10 client.0 _ll_register_callbacks cb 0x7f6ad0097850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42064/0 (socket says 172.21.15.59:42064) 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adf7fe640 1 -- 172.21.15.59:0/3470814707 learned_addr learned my addr 172.21.15.59:0/3470814707 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6ade7fc640 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 0x55ee59ecf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adeffd640 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eb99b0 0x55ee59ecee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adf7fe640 1 -- 172.21.15.59:0/3470814707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 msgr2=0x55ee59ecf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 0x55ee59ecf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adf7fe640 1 -- 172.21.15.59:0/3470814707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eb99b0 msgr2=0x55ee59ecee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eb99b0 0x55ee59ecee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adf7fe640 1 -- 172.21.15.59:0/3470814707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee59ecfa60 con 0x55ee59ec6ec0 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adeffd640 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eb99b0 0x55ee59ecee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6adf7fe640 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec9e30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8011010 tx=0x7f6ad8009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cc1842d16aad06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6ac67fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6ac67fc640 1 -- 172.21.15.59:0/3470814707 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8036060 con 0x55ee59ec6ec0 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6ac67fc640 1 -- 172.21.15.59:0/3470814707 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f6ad8019050 con 0x55ee59ec6ec0 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3470814707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad8024070 con 0x55ee59ec6ec0 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6ac67fc640 1 -- 172.21.15.59:0/3470814707 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ad8004c50 con 0x55ee59ec6ec0 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6ae82b1740 10 client.15351 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.865+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3470814707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ee59f42070 con 0x55ee59ec6ec0 2024-09-10T11:02:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.866+0000 7f6ac67fc640 1 -- 172.21.15.59:0/3470814707 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad8024070 con 0x55ee59ec6ec0 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.866+0000 7f6ac67fc640 1 -- 172.21.15.59:0/3470814707 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6ad8028420 con 0x55ee59ec6ec0 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.866+0000 7f6ae82b1740 10 client.15351 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.866+0000 7f6ae82b1740 10 client.15351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.866+0000 7f6ae82b1740 20 client.15351 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.866+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ee59f42710 0x55ee59f44b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.866+0000 7f6ae82b1740 4 client.15351 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.866+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3470814707 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee59e25d70 con 0x55ee59f42710 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.866+0000 7f6adeffd640 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ee59f42710 0x55ee59f44b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.867+0000 7f6ac67fc640 10 client.15351 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.867+0000 7f6adeffd640 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ee59f42710 0x55ee59f44b30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a61ecf0548da1e08 server_cookie=7112cc7cce14cf5d in_seq=0 out_seq=0 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ac67fc640 1 -- 172.21.15.59:0/3470814707 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee59e25d70 con 0x55ee59f42710 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ac67fc640 10 client.15351 handle_command_reply: tid=0 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ae82b1740 1 client.15351 shutdown 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3470814707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 msgr2=0x55ee59ec9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec9e30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8011010 tx=0x7f6ad8009a30 comp rx=0 tx=0).stop 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3470814707 shutdown_connections 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ee59f42710 0x55ee59f44b30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee59ec6ec0 0x55ee59ec9e30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ee59eba2d0 0x55ee59ecf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ac67fc640 0 client.15351 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.878+0000 7f6ae82b1740 1 --2- 172.21.15.59:0/3470814707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee59eb99b0 0x55ee59ecee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3470814707 >> 172.21.15.59:0/3470814707 conn(0x55ee59eb6060 msgr2=0x55ee59ec4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:44.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3470814707 shutdown_connections 2024-09-10T11:02:44.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae82b1740 1 -- 172.21.15.59:0/3470814707 wait complete. 2024-09-10T11:02:44.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae82b1740 20 client.15351 trim_cache size 0 max 16384 2024-09-10T11:02:44.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:02:44.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:02:44.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:02:44.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:02:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 -- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6acc0a2f50 msgr2=0x7f6acc0a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6acc0a2f50 0x7f6acc0a5410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009fd0 tx=0x7f6ad8005bd0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 -- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 msgr2=0x7f6ae0197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 0x7f6ae0197290 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000d950 tx=0x7f6ad000de10 comp rx=0 tx=0).stop 2024-09-10T11:02:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 -- 172.21.15.59:0/338241941 shutdown_connections 2024-09-10T11:02:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ae0106a00 0x7f6ae019bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6acc0a2f50 0x7f6acc0a5410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ae0101390 0x7f6ae01977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 --2- 172.21.15.59:0/338241941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae01009f0 0x7f6ae0197290 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 -- 172.21.15.59:0/338241941 >> 172.21.15.59:0/338241941 conn(0x7f6ae00fc6b0 msgr2=0x7f6ae00fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 -- 172.21.15.59:0/338241941 shutdown_connections 2024-09-10T11:02:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:44.879+0000 7f6ae5518640 1 -- 172.21.15.59:0/338241941 wait complete. 2024-09-10T11:02:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:45 smithi115 ceph-mon[34719]: pgmap v44: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-10T11:02:46.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:45 smithi059 ceph-mon[30978]: pgmap v44: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-10T11:02:46.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:45 smithi181 ceph-mon[35409]: pgmap v44: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-10T11:02:48.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:47 smithi059 ceph-mon[30978]: pgmap v45: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-09-10T11:02:48.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:47 smithi181 ceph-mon[35409]: pgmap v45: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-09-10T11:02:48.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:47 smithi115 ceph-mon[34719]: pgmap v45: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-09-10T11:02:50.238 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:49 smithi181 ceph-mon[35409]: pgmap v46: 97 pgs: 97 active+clean; 1.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-10T11:02:50.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:49 smithi059 ceph-mon[30978]: pgmap v46: 97 pgs: 97 active+clean; 1.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-10T11:02:50.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:49 smithi115 ceph-mon[34719]: pgmap v46: 97 pgs: 97 active+clean; 1.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-10T11:02:52.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:51 smithi059 ceph-mon[30978]: pgmap v47: 97 pgs: 97 active+clean; 1.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-10T11:02:52.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:51 smithi181 ceph-mon[35409]: pgmap v47: 97 pgs: 97 active+clean; 1.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-10T11:02:52.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:51 smithi115 ceph-mon[34719]: pgmap v47: 97 pgs: 97 active+clean; 1.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-10T11:02:54.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:53 smithi059 ceph-mon[30978]: pgmap v48: 97 pgs: 97 active+clean; 1.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-10T11:02:54.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:53 smithi181 ceph-mon[35409]: pgmap v48: 97 pgs: 97 active+clean; 1.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-10T11:02:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:53 smithi115 ceph-mon[34719]: pgmap v48: 97 pgs: 97 active+clean; 1.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-10T11:02:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:55 smithi059 ceph-mon[30978]: pgmap v49: 97 pgs: 97 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-09-10T11:02:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:55 smithi059 ceph-mon[30978]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-10T11:02:56.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:55 smithi181 ceph-mon[35409]: pgmap v49: 97 pgs: 97 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-09-10T11:02:56.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:55 smithi181 ceph-mon[35409]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-10T11:02:56.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:55 smithi115 ceph-mon[34719]: pgmap v49: 97 pgs: 97 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-09-10T11:02:56.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:55 smithi115 ceph-mon[34719]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-10T11:02:57.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.983+0000 7eff803f1640 1 -- 172.21.15.59:0/4023424837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78107b80 msgr2=0x7eff78107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.983+0000 7eff803f1640 1 --2- 172.21.15.59:0/4023424837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78107b80 0x7eff78107f60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7eff74009930 tx=0x7eff7402a420 comp rx=0 tx=0).stop 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.983+0000 7eff803f1640 1 -- 172.21.15.59:0/4023424837 shutdown_connections 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.983+0000 7eff803f1640 1 --2- 172.21.15.59:0/4023424837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff78102480 0x7eff7810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.983+0000 7eff803f1640 1 --2- 172.21.15.59:0/4023424837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff78101ae0 0x7eff78101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.983+0000 7eff803f1640 1 --2- 172.21.15.59:0/4023424837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78107b80 0x7eff78107f60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.983+0000 7eff803f1640 1 -- 172.21.15.59:0/4023424837 >> 172.21.15.59:0/4023424837 conn(0x7eff780fd7e0 msgr2=0x7eff780ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.983+0000 7eff803f1640 1 -- 172.21.15.59:0/4023424837 shutdown_connections 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.983+0000 7eff803f1640 1 -- 172.21.15.59:0/4023424837 wait complete. 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.984+0000 7eff803f1640 1 Processor -- start 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.984+0000 7eff803f1640 1 -- start start 2024-09-10T11:02:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.984+0000 7eff803f1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78101ae0 0x7eff780744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.984+0000 7eff803f1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff78102480 0x7eff78074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.984+0000 7eff803f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff78107b80 0x7eff78074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.984+0000 7eff803f1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff78111f80 con 0x7eff78101ae0 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.984+0000 7eff803f1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7eff78111e00 con 0x7eff78102480 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.984+0000 7eff803f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff78112100 con 0x7eff78107b80 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e18d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78101ae0 0x7eff780744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e18d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78101ae0 0x7eff780744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45840/0 (socket says 172.21.15.59:45840) 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e18d640 1 -- 172.21.15.59:0/524075069 learned_addr learned my addr 172.21.15.59:0/524075069 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e98e640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff78107b80 0x7eff78074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7d98c640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff78102480 0x7eff78074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e18d640 1 -- 172.21.15.59:0/524075069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff78107b80 msgr2=0x7eff78074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e18d640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff78107b80 0x7eff78074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e18d640 1 -- 172.21.15.59:0/524075069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff78102480 msgr2=0x7eff78074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e18d640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff78102480 0x7eff78074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e18d640 1 -- 172.21.15.59:0/524075069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff781a6890 con 0x7eff78101ae0 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff7e18d640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78101ae0 0x7eff780744f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7eff7402a940 tx=0x7eff74003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff6f7fe640 1 -- 172.21.15.59:0/524075069 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7403f070 con 0x7eff78101ae0 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff6f7fe640 1 -- 172.21.15.59:0/524075069 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff74031c90 con 0x7eff78101ae0 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff803f1640 1 -- 172.21.15.59:0/524075069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff781a6b20 con 0x7eff78101ae0 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.985+0000 7eff6f7fe640 1 -- 172.21.15.59:0/524075069 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74035030 con 0x7eff78101ae0 2024-09-10T11:02:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.986+0000 7eff803f1640 1 -- 172.21.15.59:0/524075069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff781a7060 con 0x7eff78101ae0 2024-09-10T11:02:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.988+0000 7eff6f7fe640 1 -- 172.21.15.59:0/524075069 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7eff74042070 con 0x7eff78101ae0 2024-09-10T11:02:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.988+0000 7eff83263740 1 Processor -- start 2024-09-10T11:02:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff83263740 1 -- start start 2024-09-10T11:02:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff83263740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a4af0 0x558c131a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff83263740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff83263740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 0x558c131b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff83263740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558c131092f0 con 0x558c131a5410 2024-09-10T11:02:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff83263740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558c130b1270 con 0x558c131a4af0 2024-09-10T11:02:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff83263740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558c131052b0 con 0x558c131afcb0 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff6f7fe640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7eff640a2e20 0x7eff640a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e18d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e98e640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7eff640a2e20 0x7eff640a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e18d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45850/0 (socket says 172.21.15.59:45850) 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e18d640 1 -- 172.21.15.59:0/431452636 learned_addr learned my addr 172.21.15.59:0/431452636 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7d98c640 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 0x558c131b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e98e640 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a4af0 0x558c131a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff6f7fe640 1 -- 172.21.15.59:0/524075069 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7eff740ef740 con 0x7eff78101ae0 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e18d640 1 -- 172.21.15.59:0/431452636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 msgr2=0x558c131b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e18d640 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 0x558c131b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e18d640 1 -- 172.21.15.59:0/431452636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a4af0 msgr2=0x558c131a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e18d640 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a4af0 0x558c131a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7e18d640 1 -- 172.21.15.59:0/431452636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c130b0340 con 0x558c131a5410 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.989+0000 7eff7d98c640 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 0x558c131b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.990+0000 7eff7e18d640 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131af770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff740b8150 tx=0x7eff7408ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f566aa1278c8d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.990+0000 7eff7e98e640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7eff640a2e20 0x7eff640a52e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7eff70005fd0 tx=0x7eff70009e80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.990+0000 7eff6cbfe640 1 -- 172.21.15.59:0/431452636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74049070 con 0x558c131a5410 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.990+0000 7eff6cbfe640 1 -- 172.21.15.59:0/431452636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff740bbcf0 con 0x558c131a5410 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.990+0000 7eff6cbfe640 1 -- 172.21.15.59:0/431452636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740ed0f0 con 0x558c131a5410 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 -- 172.21.15.59:0/431452636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 msgr2=0x558c131af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131af770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff740b8150 tx=0x7eff7408ed60 comp rx=0 tx=0).stop 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 -- 172.21.15.59:0/431452636 shutdown_connections 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 0x558c131b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131af770 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 --2- 172.21.15.59:0/431452636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a4af0 0x558c131a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 -- 172.21.15.59:0/431452636 >> 172.21.15.59:0/431452636 conn(0x558c131a1060 msgr2=0x558c131a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 -- 172.21.15.59:0/431452636 shutdown_connections 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 -- 172.21.15.59:0/431452636 wait complete. 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 -- start start 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.991+0000 7eff83263740 1 Processor -- start 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff83263740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff83263740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 0x558c131ad170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff83263740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131afcb0 0x558c131ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff83263740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558c131b2640 con 0x558c131afcb0 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff83263740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558c13092290 con 0x558c131a5410 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff83263740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558c131b27c0 con 0x558c131a4af0 2024-09-10T11:02:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff83263740 10 client.0 _ll_register_callbacks cb 0x558c130c3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e98e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131afcb0 0x558c131ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e98e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131afcb0 0x558c131ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45852/0 (socket says 172.21.15.59:45852) 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e98e640 1 -- 172.21.15.59:0/1080279760 learned_addr learned my addr 172.21.15.59:0/1080279760 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e18d640 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7d98c640 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 0x558c131ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e98e640 1 -- 172.21.15.59:0/1080279760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 msgr2=0x558c131acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e98e640 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131acc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e98e640 1 -- 172.21.15.59:0/1080279760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 msgr2=0x558c131ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e98e640 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 0x558c131ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e98e640 1 -- 172.21.15.59:0/1080279760 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c12e1c210 con 0x558c131afcb0 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7d98c640 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 0x558c131ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e18d640 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff7e98e640 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131afcb0 0x558c131ad6b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7eff70009dc0 tx=0x7eff7001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422e1b9a397512ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff61ffb640 1 -- 172.21.15.59:0/1080279760 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70024070 con 0x558c131afcb0 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.992+0000 7eff61ffb640 1 -- 172.21.15.59:0/1080279760 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7eff700047c0 con 0x558c131afcb0 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff83263740 1 -- 172.21.15.59:0/1080279760 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff740bbcf0 con 0x558c131afcb0 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff61ffb640 1 -- 172.21.15.59:0/1080279760 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff70031480 con 0x558c131afcb0 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff83263740 10 client.15363 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff83263740 1 -- 172.21.15.59:0/1080279760 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c12ee8620 con 0x558c131afcb0 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff61ffb640 1 -- 172.21.15.59:0/1080279760 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff740bbcf0 con 0x558c131afcb0 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff61ffb640 1 -- 172.21.15.59:0/1080279760 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7eff7001f570 con 0x558c131afcb0 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff83263740 10 client.15363 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff83263740 10 client.15363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff83263740 20 client.15363 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff83263740 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558c131bfaa0 0x558c131c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff83263740 4 client.15363 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.993+0000 7eff83263740 1 -- 172.21.15.59:0/1080279760 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c13116a20 con 0x558c131bfaa0 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.994+0000 7eff7e18d640 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558c131bfaa0 0x558c131c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.994+0000 7eff7e18d640 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558c131bfaa0 0x558c131c1ed0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a65d90cf7828c252 server_cookie=cee9dcfe7bb381cc in_seq=0 out_seq=0 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.994+0000 7eff61ffb640 10 client.15363 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff61ffb640 1 -- 172.21.15.59:0/1080279760 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c13116a20 con 0x558c131bfaa0 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff61ffb640 10 client.15363 handle_command_reply: tid=0 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 client.15363 shutdown 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 -- 172.21.15.59:0/1080279760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131afcb0 msgr2=0x558c131ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131afcb0 0x558c131ad6b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7eff70009dc0 tx=0x7eff7001d000 comp rx=0 tx=0).stop 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 -- 172.21.15.59:0/1080279760 shutdown_connections 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558c131bfaa0 0x558c131c1ed0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131afcb0 0x558c131ad6b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 0x558c131ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff61ffb640 0 client.15363 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 --2- 172.21.15.59:0/1080279760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 -- 172.21.15.59:0/1080279760 >> 172.21.15.59:0/1080279760 conn(0x558c131a1060 msgr2=0x558c131a6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 -- 172.21.15.59:0/1080279760 shutdown_connections 2024-09-10T11:02:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 1 -- 172.21.15.59:0/1080279760 wait complete. 2024-09-10T11:02:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:57.995+0000 7eff83263740 20 client.15363 trim_cache size 0 max 16384 2024-09-10T11:02:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff83263740 1 Processor -- start 2024-09-10T11:02:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff83263740 1 -- start start 2024-09-10T11:02:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff83263740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff83263740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff83263740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131afcb0 0x558c131c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff83263740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff781b2370 con 0x558c131a5410 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff83263740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7eff781afc40 con 0x558c131afcb0 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff83263740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff781ada90 con 0x558c131a4af0 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff7d98c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff7d98c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45864/0 (socket says 172.21.15.59:45864) 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff7d98c640 1 -- 172.21.15.59:0/1726393511 learned_addr learned my addr 172.21.15.59:0/1726393511 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff7e18d640 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.010+0000 7eff7e98e640 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131afcb0 0x558c131c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff7d98c640 1 -- 172.21.15.59:0/1726393511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 msgr2=0x558c131ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff7d98c640 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff7d98c640 1 -- 172.21.15.59:0/1726393511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131afcb0 msgr2=0x558c131c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff7d98c640 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131afcb0 0x558c131c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff7d98c640 1 -- 172.21.15.59:0/1726393511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c131a5240 con 0x558c131a5410 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff7e98e640 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131afcb0 0x558c131c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff7e18d640 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff7d98c640 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131aeba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7eff68005fd0 tx=0x7eff6800bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a9349d70d89174 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff63fff640 1 -- 172.21.15.59:0/1726393511 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68003ad0 con 0x558c131a5410 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff63fff640 1 -- 172.21.15.59:0/1726393511 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff68003c70 con 0x558c131a5410 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff63fff640 1 -- 172.21.15.59:0/1726393511 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68010690 con 0x558c131a5410 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff83263740 1 -- 172.21.15.59:0/1726393511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 msgr2=0x558c131aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.011+0000 7eff83263740 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131aeba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7eff68005fd0 tx=0x7eff6800bc90 comp rx=0 tx=0).stop 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 -- 172.21.15.59:0/1726393511 shutdown_connections 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131afcb0 0x558c131c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a5410 0x558c131aeba0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 --2- 172.21.15.59:0/1726393511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131a4af0 0x558c131ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 -- 172.21.15.59:0/1726393511 >> 172.21.15.59:0/1726393511 conn(0x558c131a1060 msgr2=0x558c131ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 -- 172.21.15.59:0/1726393511 shutdown_connections 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 -- 172.21.15.59:0/1726393511 wait complete. 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 -- start start 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 Processor -- start 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a4af0 0x558c131b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 0x558c131b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 0x558c13222770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff781ae100 con 0x558c131a4af0 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7eff781af570 con 0x558c131a5410 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff781ae7d0 con 0x558c131afcb0 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff83263740 10 client.0 _ll_register_callbacks cb 0x7eff70009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff7e18d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a4af0 0x558c131b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff7e18d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a4af0 0x558c131b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45874/0 (socket says 172.21.15.59:45874) 2024-09-10T11:02:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.012+0000 7eff7e18d640 1 -- 172.21.15.59:0/1820537153 learned_addr learned my addr 172.21.15.59:0/1820537153 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff7d98c640 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 0x558c131b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff7e98e640 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 0x558c13222770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff7e18d640 1 -- 172.21.15.59:0/1820537153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 msgr2=0x558c13222770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff7e18d640 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 0x558c13222770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff7e18d640 1 -- 172.21.15.59:0/1820537153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 msgr2=0x558c131b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff7e18d640 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 0x558c131b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff7e18d640 1 -- 172.21.15.59:0/1820537153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c13222db0 con 0x558c131a4af0 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff7e18d640 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a4af0 0x558c131b3180 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7eff740c4380 tx=0x7eff74003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cfa0a3e53abc84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:02:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff61ffb640 1 -- 172.21.15.59:0/1820537153 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74049070 con 0x558c131a4af0 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff61ffb640 1 -- 172.21.15.59:0/1820537153 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7eff740b9ff0 con 0x558c131a4af0 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff83263740 1 -- 172.21.15.59:0/1820537153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff68003c70 con 0x558c131a4af0 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff61ffb640 1 -- 172.21.15.59:0/1820537153 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff740bbcf0 con 0x558c131a4af0 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff83263740 10 client.15369 fetch_fsmap learned FSMap version 25 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff83263740 1 -- 172.21.15.59:0/1820537153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c1322a120 con 0x558c131a4af0 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.013+0000 7eff61ffb640 1 -- 172.21.15.59:0/1820537153 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff68003c70 con 0x558c131a4af0 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff61ffb640 1 -- 172.21.15.59:0/1820537153 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7eff7403bce0 con 0x558c131a4af0 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff83263740 10 client.15369 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff83263740 10 client.15369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff83263740 20 client.15369 populate_metadata read hostname 'smithi059' 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff83263740 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558c1322a6b0 0x558c1322caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:02:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff83263740 4 client.15369 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:02:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff83263740 1 -- 172.21.15.59:0/1820537153 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558c13110d70 con 0x558c1322a6b0 2024-09-10T11:02:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff7d98c640 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558c1322a6b0 0x558c1322caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:02:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff61ffb640 10 client.15369 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.014+0000 7eff7d98c640 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558c1322a6b0 0x558c1322caa0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fb22c467629941a server_cookie=ae938178f1e7183d in_seq=0 out_seq=0 2024-09-10T11:02:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff61ffb640 1 -- 172.21.15.59:0/1820537153 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558c13110d70 con 0x558c1322a6b0 2024-09-10T11:02:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff61ffb640 10 client.15369 handle_command_reply: tid=0 2024-09-10T11:02:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 client.15369 shutdown 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 -- 172.21.15.59:0/1820537153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a4af0 msgr2=0x558c131b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a4af0 0x558c131b3180 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7eff740c4380 tx=0x7eff74003f90 comp rx=0 tx=0).stop 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 -- 172.21.15.59:0/1820537153 shutdown_connections 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558c1322a6b0 0x558c1322caa0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c131afcb0 0x558c13222770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c131a5410 0x558c131b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff61ffb640 0 client.15369 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 --2- 172.21.15.59:0/1820537153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c131a4af0 0x558c131b3180 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 -- 172.21.15.59:0/1820537153 >> 172.21.15.59:0/1820537153 conn(0x558c131a1060 msgr2=0x558c131a01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 -- 172.21.15.59:0/1820537153 shutdown_connections 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 1 -- 172.21.15.59:0/1820537153 wait complete. 2024-09-10T11:02:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.027+0000 7eff83263740 20 client.15369 trim_cache size 0 max 16384 2024-09-10T11:02:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:02:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:02:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:02:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 -- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7eff640a2e20 msgr2=0x7eff640a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7eff640a2e20 0x7eff640a52e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7eff70005fd0 tx=0x7eff70009e80 comp rx=0 tx=0).stop 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 -- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78101ae0 msgr2=0x7eff780744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78101ae0 0x7eff780744f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7eff7402a940 tx=0x7eff74003b90 comp rx=0 tx=0).stop 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 -- 172.21.15.59:0/524075069 shutdown_connections 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7eff640a2e20 0x7eff640a52e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff78107b80 0x7eff78074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff78102480 0x7eff78074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 --2- 172.21.15.59:0/524075069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff78101ae0 0x7eff780744f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:02:58.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 -- 172.21.15.59:0/524075069 >> 172.21.15.59:0/524075069 conn(0x7eff780fd7e0 msgr2=0x7eff780fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:02:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 -- 172.21.15.59:0/524075069 shutdown_connections 2024-09-10T11:02:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:02:58.028+0000 7eff803f1640 1 -- 172.21.15.59:0/524075069 wait complete. 2024-09-10T11:02:58.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:57 smithi059 ceph-mon[30978]: pgmap v50: 97 pgs: 97 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-10T11:02:58.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:57 smithi181 ceph-mon[35409]: pgmap v50: 97 pgs: 97 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-10T11:02:58.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:57 smithi115 ceph-mon[34719]: pgmap v50: 97 pgs: 97 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-10T11:03:00.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:02:59 smithi059 ceph-mon[30978]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-09-10T11:03:00.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:02:59 smithi181 ceph-mon[35409]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-09-10T11:03:00.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:02:59 smithi115 ceph-mon[34719]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-09-10T11:03:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:01 smithi059 ceph-mon[30978]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-10T11:03:02.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:01 smithi181 ceph-mon[35409]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-10T11:03:02.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:01 smithi115 ceph-mon[34719]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-10T11:03:04.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:03 smithi059 ceph-mon[30978]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-10T11:03:04.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:03 smithi181 ceph-mon[35409]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-10T11:03:04.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:03 smithi115 ceph-mon[34719]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-10T11:03:06.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:05 smithi059 ceph-mon[30978]: pgmap v54: 97 pgs: 97 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 49 KiB/s wr, 33 op/s 2024-09-10T11:03:06.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:05 smithi181 ceph-mon[35409]: pgmap v54: 97 pgs: 97 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 49 KiB/s wr, 33 op/s 2024-09-10T11:03:06.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:05 smithi115 ceph-mon[34719]: pgmap v54: 97 pgs: 97 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 49 KiB/s wr, 33 op/s 2024-09-10T11:03:08.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:07 smithi059 ceph-mon[30978]: pgmap v55: 97 pgs: 97 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 KiB/s wr, 27 op/s 2024-09-10T11:03:08.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:07 smithi181 ceph-mon[35409]: pgmap v55: 97 pgs: 97 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 KiB/s wr, 27 op/s 2024-09-10T11:03:08.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:07 smithi115 ceph-mon[34719]: pgmap v55: 97 pgs: 97 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 KiB/s wr, 27 op/s 2024-09-10T11:03:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:09 smithi059 ceph-mon[30978]: pgmap v56: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 32 op/s 2024-09-10T11:03:10.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:09 smithi181 ceph-mon[35409]: pgmap v56: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 32 op/s 2024-09-10T11:03:10.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:09 smithi115 ceph-mon[34719]: pgmap v56: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 32 op/s 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.129+0000 7fc4f58eb640 1 -- 172.21.15.59:0/1388755627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f010c110 msgr2=0x7fc4f010e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.129+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/1388755627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f010c110 0x7fc4f010e590 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009ca0 tx=0x7fc4e802a950 comp rx=0 tx=0).stop 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.129+0000 7fc4f58eb640 1 -- 172.21.15.59:0/1388755627 shutdown_connections 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.129+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/1388755627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f010c110 0x7fc4f010e590 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.129+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/1388755627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f01035e0 0x7fc4f010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.129+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/1388755627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4f0102cc0 0x7fc4f01030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.129+0000 7fc4f58eb640 1 -- 172.21.15.59:0/1388755627 >> 172.21.15.59:0/1388755627 conn(0x7fc4f00fc6b0 msgr2=0x7fc4f00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.129+0000 7fc4f58eb640 1 -- 172.21.15.59:0/1388755627 shutdown_connections 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.129+0000 7fc4f58eb640 1 -- 172.21.15.59:0/1388755627 wait complete. 2024-09-10T11:03:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.130+0000 7fc4f58eb640 1 Processor -- start 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.130+0000 7fc4f58eb640 1 -- start start 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.130+0000 7fc4f58eb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0102cc0 0x7fc4f0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.130+0000 7fc4f58eb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4f01035e0 0x7fc4f0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.130+0000 7fc4f58eb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f010c110 0x7fc4f019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.130+0000 7fc4f58eb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0111eb0 con 0x7fc4f0102cc0 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.130+0000 7fc4f58eb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0111d30 con 0x7fc4f010c110 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.130+0000 7fc4f58eb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0112030 con 0x7fc4f01035e0 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4eeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0102cc0 0x7fc4f0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4eeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0102cc0 0x7fc4f0198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43846/0 (socket says 172.21.15.59:43846) 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4eeffd640 1 -- 172.21.15.59:0/454136484 learned_addr learned my addr 172.21.15.59:0/454136484 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4f01035e0 0x7fc4f0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f010c110 0x7fc4f019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4eeffd640 1 -- 172.21.15.59:0/454136484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4f01035e0 msgr2=0x7fc4f0198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4f01035e0 0x7fc4f0198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4eeffd640 1 -- 172.21.15.59:0/454136484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f010c110 msgr2=0x7fc4f019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f010c110 0x7fc4f019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4eeffd640 1 -- 172.21.15.59:0/454136484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f019d310 con 0x7fc4f0102cc0 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f010c110 0x7fc4f019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0102cc0 0x7fc4f0198320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000d950 tx=0x7fc4e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4f48e9640 1 -- 172.21.15.59:0/454136484 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0017030 con 0x7fc4f0102cc0 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4f48e9640 1 -- 172.21.15.59:0/454136484 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e0004020 con 0x7fc4f0102cc0 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4f58eb640 1 -- 172.21.15.59:0/454136484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f019d600 con 0x7fc4f0102cc0 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4f48e9640 1 -- 172.21.15.59:0/454136484 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00047a0 con 0x7fc4f0102cc0 2024-09-10T11:03:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.131+0000 7fc4f58eb640 1 -- 172.21.15.59:0/454136484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f01a4e90 con 0x7fc4f0102cc0 2024-09-10T11:03:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.134+0000 7fc4f48e9640 1 -- 172.21.15.59:0/454136484 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc4e00041d0 con 0x7fc4f0102cc0 2024-09-10T11:03:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4f868a740 1 Processor -- start 2024-09-10T11:03:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4f868a740 1 -- start start 2024-09-10T11:03:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b69b0 0x55fcd77b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b72d0 0x55fcd77c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4f868a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fcd771b2f0 con 0x55fcd77b69b0 2024-09-10T11:03:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4f868a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55fcd76c3270 con 0x55fcd77c60c0 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4f868a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fcd77172b0 con 0x55fcd77b72d0 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4ef7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b69b0 0x55fcd77b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4ef7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b69b0 0x55fcd77b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43850/0 (socket says 172.21.15.59:43850) 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4ef7fe640 1 -- 172.21.15.59:0/1898092908 learned_addr learned my addr 172.21.15.59:0/1898092908 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4f48e9640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc4d80a2da0 0x7fc4d80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/1898092908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b72d0 0x55fcd77c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.135+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/1898092908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc4d80a2da0 0x7fc4d80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4ef7fe640 1 -- 172.21.15.59:0/1898092908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b72d0 msgr2=0x55fcd77c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4f48e9640 1 -- 172.21.15.59:0/454136484 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fc4e00cef70 con 0x7fc4f0102cc0 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/1898092908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b72d0 0x55fcd77c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4ef7fe640 1 -- 172.21.15.59:0/1898092908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 msgr2=0x55fcd77c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/1898092908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4ef7fe640 1 -- 172.21.15.59:0/1898092908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd76c2340 con 0x55fcd77b69b0 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/1898092908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b69b0 0x55fcd77b6d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8004af0 tx=0x7fc4e802fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62585f67265ef5e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4d5ffb640 1 -- 172.21.15.59:0/1898092908 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8034070 con 0x55fcd77b69b0 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4d5ffb640 1 -- 172.21.15.59:0/1898092908 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e804d070 con 0x55fcd77b69b0 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.136+0000 7fc4d5ffb640 1 -- 172.21.15.59:0/1898092908 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8048690 con 0x55fcd77b69b0 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 -- 172.21.15.59:0/1898092908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b69b0 msgr2=0x55fcd77b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 --2- 172.21.15.59:0/1898092908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b69b0 0x55fcd77b6d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8004af0 tx=0x7fc4e802fc60 comp rx=0 tx=0).stop 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc4d80a2da0 0x7fc4d80a5260 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc4e804c000 tx=0x7fc4e804a000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 -- 172.21.15.59:0/1898092908 shutdown_connections 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 --2- 172.21.15.59:0/1898092908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 --2- 172.21.15.59:0/1898092908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b72d0 0x55fcd77c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 --2- 172.21.15.59:0/1898092908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b69b0 0x55fcd77b6d90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 -- 172.21.15.59:0/1898092908 >> 172.21.15.59:0/1898092908 conn(0x55fcd77b3060 msgr2=0x55fcd77b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 -- 172.21.15.59:0/1898092908 shutdown_connections 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 -- 172.21.15.59:0/1898092908 wait complete. 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.137+0000 7fc4f868a740 1 -- start start 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4f868a740 1 Processor -- start 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77b72d0 0x55fcd77c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77c60c0 0x55fcd77c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4f868a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fcd77c8c90 con 0x55fcd77c60c0 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4f868a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55fcd76a4290 con 0x55fcd77b72d0 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4f868a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55fcd77c8e10 con 0x55fcd77b69b0 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4f868a740 10 client.0 _ll_register_callbacks cb 0x55fcd76d5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ef7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77c60c0 0x55fcd77c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4eeffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ef7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77c60c0 0x55fcd77c3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43854/0 (socket says 172.21.15.59:43854) 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ef7fe640 1 -- 172.21.15.59:0/2182295021 learned_addr learned my addr 172.21.15.59:0/2182295021 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4eeffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.59:58838/0 (socket says 172.21.15.59:58838) 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77b72d0 0x55fcd77c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ef7fe640 1 -- 172.21.15.59:0/2182295021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 msgr2=0x55fcd77c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ef7fe640 1 -- 172.21.15.59:0/2182295021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77b72d0 msgr2=0x55fcd77c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77b72d0 0x55fcd77c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ef7fe640 1 -- 172.21.15.59:0/2182295021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcd742e210 con 0x55fcd77c60c0 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.138+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77b72d0 0x55fcd77c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77c60c0 0x55fcd77c3ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80487c0 tx=0x7fc4e8004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24bfa826b29f54d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:03:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4ceffd640 1 -- 172.21.15.59:0/2182295021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8034070 con 0x55fcd77c60c0 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4ceffd640 1 -- 172.21.15.59:0/2182295021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fc4e8004250 con 0x55fcd77c60c0 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4f868a740 1 -- 172.21.15.59:0/2182295021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4e804d070 con 0x55fcd77c60c0 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4ceffd640 1 -- 172.21.15.59:0/2182295021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc4e8004850 con 0x55fcd77c60c0 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4f868a740 10 client.15381 fetch_fsmap learned FSMap version 25 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4f868a740 1 -- 172.21.15.59:0/2182295021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fcd74fa620 con 0x55fcd77c60c0 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4ceffd640 1 -- 172.21.15.59:0/2182295021 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e804d070 con 0x55fcd77c60c0 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4ceffd640 1 -- 172.21.15.59:0/2182295021 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc4e805a6d0 con 0x55fcd77c60c0 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4f868a740 10 client.15381 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.139+0000 7fc4f868a740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.140+0000 7fc4f868a740 20 client.15381 populate_metadata read hostname 'smithi059' 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.140+0000 7fc4f868a740 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55fcd77d5f80 0x55fcd77d8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.140+0000 7fc4f868a740 4 client.15381 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:03:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.140+0000 7fc4f868a740 1 -- 172.21.15.59:0/2182295021 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcd7728a20 con 0x55fcd77d5f80 2024-09-10T11:03:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.140+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55fcd77d5f80 0x55fcd77d8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.140+0000 7fc4ceffd640 10 client.15381 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.140+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55fcd77d5f80 0x55fcd77d8370 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4a2e90bf45c3e21 server_cookie=ca4ce2aed23c31f0 in_seq=0 out_seq=0 2024-09-10T11:03:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4ceffd640 1 -- 172.21.15.59:0/2182295021 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fcd7728a20 con 0x55fcd77d5f80 2024-09-10T11:03:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4ceffd640 10 client.15381 handle_command_reply: tid=0 2024-09-10T11:03:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 client.15381 shutdown 2024-09-10T11:03:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 -- 172.21.15.59:0/2182295021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77c60c0 msgr2=0x55fcd77c3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77c60c0 0x55fcd77c3ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80487c0 tx=0x7fc4e8004630 comp rx=0 tx=0).stop 2024-09-10T11:03:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 -- 172.21.15.59:0/2182295021 shutdown_connections 2024-09-10T11:03:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55fcd77d5f80 0x55fcd77d8370 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77c60c0 0x55fcd77c3ae0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4ceffd640 0 client.15381 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77b72d0 0x55fcd77c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 --2- 172.21.15.59:0/2182295021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 -- 172.21.15.59:0/2182295021 >> 172.21.15.59:0/2182295021 conn(0x55fcd77b3060 msgr2=0x55fcd77b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 -- 172.21.15.59:0/2182295021 shutdown_connections 2024-09-10T11:03:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 1 -- 172.21.15.59:0/2182295021 wait complete. 2024-09-10T11:03:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.141+0000 7fc4f868a740 20 client.15381 trim_cache size 0 max 16384 2024-09-10T11:03:11.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4f868a740 1 Processor -- start 2024-09-10T11:03:11.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4f868a740 1 -- start start 2024-09-10T11:03:11.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77dd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4f868a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01ae000 con 0x55fcd77b72d0 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4f868a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01ab8d0 con 0x55fcd77c60c0 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4f868a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01a9740 con 0x55fcd77b69b0 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4ee7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4ee7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77c3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43862/0 (socket says 172.21.15.59:43862) 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4ee7fc640 1 -- 172.21.15.59:0/382433654 learned_addr learned my addr 172.21.15.59:0/382433654 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.156+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77dd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4ee7fc640 1 -- 172.21.15.59:0/382433654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 msgr2=0x55fcd77d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4ee7fc640 1 -- 172.21.15.59:0/382433654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 msgr2=0x55fcd77dd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77dd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4ee7fc640 1 -- 172.21.15.59:0/382433654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd77c1ff0 con 0x55fcd77b72d0 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77c3910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009a30 tx=0x7fc4e4009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0148191446b3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4d57fa640 1 -- 172.21.15.59:0/382433654 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4021070 con 0x55fcd77b72d0 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4d57fa640 1 -- 172.21.15.59:0/382433654 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e4012cd0 con 0x55fcd77b72d0 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.157+0000 7fc4d57fa640 1 -- 172.21.15.59:0/382433654 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e401c430 con 0x55fcd77b72d0 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 -- 172.21.15.59:0/382433654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 msgr2=0x55fcd77c3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77c3910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009a30 tx=0x7fc4e4009ef0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 -- 172.21.15.59:0/382433654 shutdown_connections 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77dd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77c3910 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 --2- 172.21.15.59:0/382433654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 -- 172.21.15.59:0/382433654 >> 172.21.15.59:0/382433654 conn(0x55fcd77b3060 msgr2=0x55fcd77c50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:11.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 -- 172.21.15.59:0/382433654 shutdown_connections 2024-09-10T11:03:11.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 -- 172.21.15.59:0/382433654 wait complete. 2024-09-10T11:03:11.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 -- start start 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 Processor -- start 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.158+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4f868a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4f868a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01a9d90 con 0x55fcd77b72d0 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4f868a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01ab200 con 0x55fcd77c60c0 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4f868a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f01aa460 con 0x55fcd77b69b0 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4f868a740 10 client.0 _ll_register_callbacks cb 0x7fc4f006b360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ee7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ee7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43868/0 (socket says 172.21.15.59:43868) 2024-09-10T11:03:11.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ee7fc640 1 -- 172.21.15.59:0/3421561087 learned_addr learned my addr 172.21.15.59:0/3421561087 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ef7fe640 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ee7fc640 1 -- 172.21.15.59:0/3421561087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 msgr2=0x55fcd77ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ee7fc640 1 -- 172.21.15.59:0/3421561087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 msgr2=0x55fcd77cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ee7fc640 1 -- 172.21.15.59:0/3421561087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcd77cb710 con 0x55fcd77b72d0 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ee7fc640 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77ce800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009a00 tx=0x7fc4e40044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb4ea9e605e6032 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ceffd640 1 -- 172.21.15.59:0/3421561087 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4021030 con 0x55fcd77b72d0 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ceffd640 1 -- 172.21.15.59:0/3421561087 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fc4e4005050 con 0x55fcd77b72d0 2024-09-10T11:03:11.165 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4f868a740 1 -- 172.21.15.59:0/3421561087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4e4012cd0 con 0x55fcd77b72d0 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.159+0000 7fc4ceffd640 1 -- 172.21.15.59:0/3421561087 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc4e4034050 con 0x55fcd77b72d0 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4f868a740 10 client.15387 fetch_fsmap learned FSMap version 25 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4f868a740 1 -- 172.21.15.59:0/3421561087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fcd78411e0 con 0x55fcd77b72d0 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4ceffd640 1 -- 172.21.15.59:0/3421561087 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e4012cd0 con 0x55fcd77b72d0 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4ceffd640 1 -- 172.21.15.59:0/3421561087 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc4e402f030 con 0x55fcd77b72d0 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4f868a740 10 client.15387 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4f868a740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4f868a740 20 client.15387 populate_metadata read hostname 'smithi059' 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4f868a740 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55fcd7841890 0x55fcd7843cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4f868a740 4 client.15387 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4f868a740 1 -- 172.21.15.59:0/3421561087 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fcd7722d70 con 0x55fcd7841890 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.160+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55fcd7841890 0x55fcd7843cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.161+0000 7fc4ceffd640 10 client.15387 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.161+0000 7fc4eeffd640 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55fcd7841890 0x55fcd7843cb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c37de145ecb6015 server_cookie=daa93942cd3b4726 in_seq=0 out_seq=0 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.175+0000 7fc4ceffd640 1 -- 172.21.15.59:0/3421561087 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fcd7722d70 con 0x55fcd7841890 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.175+0000 7fc4ceffd640 10 client.15387 handle_command_reply: tid=0 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.175+0000 7fc4f868a740 1 client.15387 shutdown 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.175+0000 7fc4f868a740 1 -- 172.21.15.59:0/3421561087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 msgr2=0x55fcd77ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.175+0000 7fc4f868a740 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77ce800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009a00 tx=0x7fc4e40044f0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.175+0000 7fc4f868a740 1 -- 172.21.15.59:0/3421561087 shutdown_connections 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f868a740 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55fcd7841890 0x55fcd7843cb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f868a740 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fcd77c60c0 0x55fcd77cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f868a740 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fcd77b72d0 0x55fcd77ce800 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4ceffd640 0 client.15387 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f868a740 1 --2- 172.21.15.59:0/3421561087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fcd77b69b0 0x55fcd77ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f868a740 1 -- 172.21.15.59:0/3421561087 >> 172.21.15.59:0/3421561087 conn(0x55fcd77b3060 msgr2=0x55fcd77b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f868a740 1 -- 172.21.15.59:0/3421561087 shutdown_connections 2024-09-10T11:03:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f868a740 1 -- 172.21.15.59:0/3421561087 wait complete. 2024-09-10T11:03:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f868a740 20 client.15387 trim_cache size 0 max 16384 2024-09-10T11:03:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:03:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:03:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:03:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:03:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 -- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc4d80a2da0 msgr2=0x7fc4d80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc4d80a2da0 0x7fc4d80a5260 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc4e804c000 tx=0x7fc4e804a000 comp rx=0 tx=0).stop 2024-09-10T11:03:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 -- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0102cc0 msgr2=0x7fc4f0198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0102cc0 0x7fc4f0198320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000d950 tx=0x7fc4e000de10 comp rx=0 tx=0).stop 2024-09-10T11:03:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 -- 172.21.15.59:0/454136484 shutdown_connections 2024-09-10T11:03:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f010c110 0x7fc4f019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc4d80a2da0 0x7fc4d80a5260 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4f01035e0 0x7fc4f0198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 --2- 172.21.15.59:0/454136484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0102cc0 0x7fc4f0198320 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 -- 172.21.15.59:0/454136484 >> 172.21.15.59:0/454136484 conn(0x7fc4f00fc6b0 msgr2=0x7fc4f00fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 -- 172.21.15.59:0/454136484 shutdown_connections 2024-09-10T11:03:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:11.176+0000 7fc4f58eb640 1 -- 172.21.15.59:0/454136484 wait complete. 2024-09-10T11:03:12.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:12 smithi059 ceph-mon[30978]: pgmap v57: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-09-10T11:03:12.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:12 smithi181 ceph-mon[35409]: pgmap v57: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-09-10T11:03:12.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:12 smithi115 ceph-mon[34719]: pgmap v57: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-09-10T11:03:14.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:14 smithi059 ceph-mon[30978]: pgmap v58: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-09-10T11:03:14.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:14 smithi181 ceph-mon[35409]: pgmap v58: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-09-10T11:03:14.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:14 smithi115 ceph-mon[34719]: pgmap v58: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-09-10T11:03:16.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:16 smithi059 ceph-mon[30978]: pgmap v59: 97 pgs: 97 active+clean; 2.1 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-09-10T11:03:16.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:16 smithi181 ceph-mon[35409]: pgmap v59: 97 pgs: 97 active+clean; 2.1 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-09-10T11:03:16.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:16 smithi115 ceph-mon[34719]: pgmap v59: 97 pgs: 97 active+clean; 2.1 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-09-10T11:03:18.261 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:18 smithi115 ceph-mon[34719]: pgmap v60: 97 pgs: 97 active+clean; 2.1 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-10T11:03:18.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:18 smithi059 ceph-mon[30978]: pgmap v60: 97 pgs: 97 active+clean; 2.1 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-10T11:03:18.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:18 smithi181 ceph-mon[35409]: pgmap v60: 97 pgs: 97 active+clean; 2.1 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-10T11:03:20.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:20 smithi059 ceph-mon[30978]: pgmap v61: 97 pgs: 97 active+clean; 2.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 17 op/s 2024-09-10T11:03:20.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:20 smithi181 ceph-mon[35409]: pgmap v61: 97 pgs: 97 active+clean; 2.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 17 op/s 2024-09-10T11:03:20.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:20 smithi115 ceph-mon[34719]: pgmap v61: 97 pgs: 97 active+clean; 2.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 17 op/s 2024-09-10T11:03:22.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:22 smithi059 ceph-mon[30978]: pgmap v62: 97 pgs: 97 active+clean; 2.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-10T11:03:22.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:22 smithi181 ceph-mon[35409]: pgmap v62: 97 pgs: 97 active+clean; 2.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-10T11:03:22.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:22 smithi115 ceph-mon[34719]: pgmap v62: 97 pgs: 97 active+clean; 2.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-10T11:03:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.275+0000 7f615e227640 1 -- 172.21.15.59:0/2336304502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158107b80 msgr2=0x7f6158107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.275+0000 7f615e227640 1 --2- 172.21.15.59:0/2336304502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158107b80 0x7f6158107f60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6148009930 tx=0x7f614802a420 comp rx=0 tx=0).stop 2024-09-10T11:03:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.275+0000 7f615e227640 1 -- 172.21.15.59:0/2336304502 shutdown_connections 2024-09-10T11:03:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.275+0000 7f615e227640 1 --2- 172.21.15.59:0/2336304502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6158102480 0x7f615810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.275+0000 7f615e227640 1 --2- 172.21.15.59:0/2336304502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6158101ae0 0x7f6158101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.275+0000 7f615e227640 1 --2- 172.21.15.59:0/2336304502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158107b80 0x7f6158107f60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.275+0000 7f615e227640 1 -- 172.21.15.59:0/2336304502 >> 172.21.15.59:0/2336304502 conn(0x7f61580fd7e0 msgr2=0x7f61580ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:24.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.275+0000 7f615e227640 1 -- 172.21.15.59:0/2336304502 shutdown_connections 2024-09-10T11:03:24.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.275+0000 7f615e227640 1 -- 172.21.15.59:0/2336304502 wait complete. 2024-09-10T11:03:24.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f615e227640 1 Processor -- start 2024-09-10T11:03:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f615e227640 1 -- start start 2024-09-10T11:03:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f615e227640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158101ae0 0x7f6158198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f615e227640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6158102480 0x7f61581988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f615e227640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6158107b80 0x7f615819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f615e227640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6158111f30 con 0x7f6158101ae0 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f615e227640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6158111db0 con 0x7f6158107b80 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f615e227640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f61581120b0 con 0x7f6158102480 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f61577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158101ae0 0x7f6158198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f61577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158101ae0 0x7f6158198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36590/0 (socket says 172.21.15.59:36590) 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f61577fe640 1 -- 172.21.15.59:0/3056649690 learned_addr learned my addr 172.21.15.59:0/3056649690 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.276+0000 7f6156ffd640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6158102480 0x7f61581988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f6157fff640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6158107b80 0x7f615819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f61577fe640 1 -- 172.21.15.59:0/3056649690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6158102480 msgr2=0x7f61581988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f61577fe640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6158102480 0x7f61581988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f61577fe640 1 -- 172.21.15.59:0/3056649690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6158107b80 msgr2=0x7f615819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f61577fe640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6158107b80 0x7f615819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f61577fe640 1 -- 172.21.15.59:0/3056649690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615819d370 con 0x7f6158101ae0 2024-09-10T11:03:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f61577fe640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158101ae0 0x7f6158198380 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6148009230 tx=0x7f6148004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f6154ff9640 1 -- 172.21.15.59:0/3056649690 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614803f030 con 0x7f6158101ae0 2024-09-10T11:03:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f6154ff9640 1 -- 172.21.15.59:0/3056649690 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6148003ad0 con 0x7f6158101ae0 2024-09-10T11:03:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f6154ff9640 1 -- 172.21.15.59:0/3056649690 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148035070 con 0x7f6158101ae0 2024-09-10T11:03:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f615e227640 1 -- 172.21.15.59:0/3056649690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615819d600 con 0x7f6158101ae0 2024-09-10T11:03:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.277+0000 7f615e227640 1 -- 172.21.15.59:0/3056649690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61581a4ef0 con 0x7f6158101ae0 2024-09-10T11:03:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6154ff9640 1 -- 172.21.15.59:0/3056649690 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6148042030 con 0x7f6158101ae0 2024-09-10T11:03:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6160fc0740 1 Processor -- start 2024-09-10T11:03:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6160fc0740 1 -- start start 2024-09-10T11:03:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e88ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e89410 0x55f5d2e93770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e960a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6160fc0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f5d2ded2f0 con 0x55f5d2e88af0 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6160fc0740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f5d2d95270 con 0x55f5d2e89410 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6160fc0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f5d2de92b0 con 0x55f5d2e93cb0 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6157fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e88ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6157fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e88ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36600/0 (socket says 172.21.15.59:36600) 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.280+0000 7f6157fff640 1 -- 172.21.15.59:0/2921868910 learned_addr learned my addr 172.21.15.59:0/2921868910 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f6156ffd640 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f61577fe640 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e89410 0x55f5d2e93770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f6157fff640 1 -- 172.21.15.59:0/2921868910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e93cb0 msgr2=0x55f5d2e960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f6157fff640 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f6157fff640 1 -- 172.21.15.59:0/2921868910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e89410 msgr2=0x55f5d2e93770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f6157fff640 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e89410 0x55f5d2e93770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f6157fff640 1 -- 172.21.15.59:0/2921868910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5d2d94340 con 0x55f5d2e88af0 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f61577fe640 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e89410 0x55f5d2e93770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f6154ff9640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f61400a2da0 0x7f61400a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f6157fff640 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e88ed0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6150009f90 tx=0x7f6150010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821fe6c3f0511007 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f61577fe640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f61400a2da0 0x7f61400a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f6154ff9640 1 -- 172.21.15.59:0/3056649690 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f61480ef730 con 0x7f6158101ae0 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f613dffb640 1 -- 172.21.15.59:0/2921868910 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150011700 con 0x55f5d2e88af0 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f613dffb640 1 -- 172.21.15.59:0/2921868910 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6150011d80 con 0x55f5d2e88af0 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.281+0000 7f613dffb640 1 -- 172.21.15.59:0/2921868910 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150019e40 con 0x55f5d2e88af0 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 -- 172.21.15.59:0/2921868910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 msgr2=0x55f5d2e88ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f61577fe640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f61400a2da0 0x7f61400a5260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55f5d2e85ec0 tx=0x7f6148009260 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e88ed0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6150009f90 tx=0x7f6150010860 comp rx=0 tx=0).stop 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 -- 172.21.15.59:0/2921868910 shutdown_connections 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e89410 0x55f5d2e93770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2921868910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e88ed0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 -- 172.21.15.59:0/2921868910 >> 172.21.15.59:0/2921868910 conn(0x55f5d2e85060 msgr2=0x55f5d2e85440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 -- 172.21.15.59:0/2921868910 shutdown_connections 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 -- 172.21.15.59:0/2921868910 wait complete. 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.282+0000 7f6160fc0740 1 -- start start 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6160fc0740 1 Processor -- start 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 0x55f5d2e90bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e91100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e91640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6160fc0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f5d2e96880 con 0x55f5d2e89410 2024-09-10T11:03:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6160fc0740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f5d2d76290 con 0x55f5d2e93cb0 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6160fc0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f5d2e96a00 con 0x55f5d2e88af0 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6160fc0740 10 client.0 _ll_register_callbacks cb 0x55f5d2da7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6156ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e91100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6156ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e91100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36614/0 (socket says 172.21.15.59:36614) 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6156ffd640 1 -- 172.21.15.59:0/2210926214 learned_addr learned my addr 172.21.15.59:0/2210926214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6157fff640 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 0x55f5d2e90bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.283+0000 7f6157fff640 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e91640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6156ffd640 1 -- 172.21.15.59:0/2210926214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 msgr2=0x55f5d2e90bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6156ffd640 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 0x55f5d2e90bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6156ffd640 1 -- 172.21.15.59:0/2210926214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 msgr2=0x55f5d2e91640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6156ffd640 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e91640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6156ffd640 1 -- 172.21.15.59:0/2210926214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5d2b00210 con 0x55f5d2e89410 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6156ffd640 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e91100 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f614c012700 tx=0x7f614c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eba8336530f326d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6136ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6136ffd640 1 -- 172.21.15.59:0/2210926214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c00f920 con 0x55f5d2e89410 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6136ffd640 1 -- 172.21.15.59:0/2210926214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f614c00fac0 con 0x55f5d2e89410 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6160fc0740 1 -- 172.21.15.59:0/2210926214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6150011d80 con 0x55f5d2e89410 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6136ffd640 1 -- 172.21.15.59:0/2210926214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f614c00fcc0 con 0x55f5d2e89410 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6160fc0740 10 client.15399 fetch_fsmap learned FSMap version 25 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6160fc0740 1 -- 172.21.15.59:0/2210926214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f5d2bcc620 con 0x55f5d2e89410 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.284+0000 7f6136ffd640 1 -- 172.21.15.59:0/2210926214 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6150011d80 con 0x55f5d2e89410 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6136ffd640 1 -- 172.21.15.59:0/2210926214 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f614c024420 con 0x55f5d2e89410 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6160fc0740 10 client.15399 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6160fc0740 10 client.15399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:03:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6160fc0740 20 client.15399 populate_metadata read hostname 'smithi059' 2024-09-10T11:03:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5d2ea3d40 0x55f5d2ea6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6160fc0740 4 client.15399 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:03:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6160fc0740 1 -- 172.21.15.59:0/2210926214 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5d2dfaa20 con 0x55f5d2ea3d40 2024-09-10T11:03:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6157fff640 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5d2ea3d40 0x55f5d2ea6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6136ffd640 10 client.15399 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.285+0000 7f6157fff640 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5d2ea3d40 0x55f5d2ea6130 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab0196ba3e997c5d server_cookie=e39e9e2df6cefeea in_seq=0 out_seq=0 2024-09-10T11:03:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6136ffd640 1 -- 172.21.15.59:0/2210926214 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5d2dfaa20 con 0x55f5d2ea3d40 2024-09-10T11:03:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6136ffd640 10 client.15399 handle_command_reply: tid=0 2024-09-10T11:03:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6160fc0740 1 client.15399 shutdown 2024-09-10T11:03:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6160fc0740 1 -- 172.21.15.59:0/2210926214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 msgr2=0x55f5d2e91100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e91100 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f614c012700 tx=0x7f614c012bc0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6160fc0740 1 -- 172.21.15.59:0/2210926214 shutdown_connections 2024-09-10T11:03:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5d2ea3d40 0x55f5d2ea6130 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e91640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e91100 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6160fc0740 1 --2- 172.21.15.59:0/2210926214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 0x55f5d2e90bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6136ffd640 0 client.15399 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:24.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.286+0000 7f6160fc0740 1 -- 172.21.15.59:0/2210926214 >> 172.21.15.59:0/2210926214 conn(0x55f5d2e85060 msgr2=0x55f5d2e8adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:24.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.287+0000 7f6160fc0740 1 -- 172.21.15.59:0/2210926214 shutdown_connections 2024-09-10T11:03:24.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.287+0000 7f6160fc0740 1 -- 172.21.15.59:0/2210926214 wait complete. 2024-09-10T11:03:24.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.287+0000 7f6160fc0740 20 client.15399 trim_cache size 0 max 16384 2024-09-10T11:03:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.301+0000 7f6160fc0740 1 Processor -- start 2024-09-10T11:03:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.301+0000 7f6160fc0740 1 -- start start 2024-09-10T11:03:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.301+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e91470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.301+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e89410 0x55f5d2eab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.301+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2eabf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.301+0000 7f6160fc0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f61581b0200 con 0x55f5d2e88af0 2024-09-10T11:03:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.301+0000 7f6160fc0740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f61581adad0 con 0x55f5d2e93cb0 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.301+0000 7f6160fc0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f61581ab920 con 0x55f5d2e89410 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6157fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e91470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6157fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e91470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36622/0 (socket says 172.21.15.59:36622) 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6157fff640 1 -- 172.21.15.59:0/1504184468 learned_addr learned my addr 172.21.15.59:0/1504184468 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6156ffd640 1 --2- 172.21.15.59:0/1504184468 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e89410 0x55f5d2eab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6157fff640 1 -- 172.21.15.59:0/1504184468 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e89410 msgr2=0x55f5d2eab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6157fff640 1 --2- 172.21.15.59:0/1504184468 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e89410 0x55f5d2eab9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6157fff640 1 -- 172.21.15.59:0/1504184468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 msgr2=0x55f5d2eabf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6157fff640 1 --2- 172.21.15.59:0/1504184468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2eabf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6157fff640 1 -- 172.21.15.59:0/1504184468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5d2ea64a0 con 0x55f5d2e88af0 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f6157fff640 1 --2- 172.21.15.59:0/1504184468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e91470 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6150019620 tx=0x7f61500199a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98111bf8b67e182 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f613d7fa640 1 -- 172.21.15.59:0/1504184468 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150019ad0 con 0x55f5d2e88af0 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f613d7fa640 1 -- 172.21.15.59:0/1504184468 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6150020040 con 0x55f5d2e88af0 2024-09-10T11:03:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.302+0000 7f613d7fa640 1 -- 172.21.15.59:0/1504184468 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150011990 con 0x55f5d2e88af0 2024-09-10T11:03:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 -- 172.21.15.59:0/1504184468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 msgr2=0x55f5d2e91470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 --2- 172.21.15.59:0/1504184468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e91470 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6150019620 tx=0x7f61500199a0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 -- 172.21.15.59:0/1504184468 shutdown_connections 2024-09-10T11:03:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 --2- 172.21.15.59:0/1504184468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2eabf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 --2- 172.21.15.59:0/1504184468 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e89410 0x55f5d2eab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 --2- 172.21.15.59:0/1504184468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e88af0 0x55f5d2e91470 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 -- 172.21.15.59:0/1504184468 >> 172.21.15.59:0/1504184468 conn(0x55f5d2e85060 msgr2=0x55f5d2e92c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 -- 172.21.15.59:0/1504184468 shutdown_connections 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 -- 172.21.15.59:0/1504184468 wait complete. 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.303+0000 7f6160fc0740 1 -- start start 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6160fc0740 1 Processor -- start 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 0x55f5d2e9bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e9c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6160fc0740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e971d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6160fc0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f61581abf90 con 0x55f5d2e89410 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6160fc0740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f61581ad400 con 0x55f5d2e93cb0 2024-09-10T11:03:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6160fc0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f61581ac660 con 0x55f5d2e88af0 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6160fc0740 10 client.0 _ll_register_callbacks cb 0x7f614c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6156ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e9c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6156ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e9c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36630/0 (socket says 172.21.15.59:36630) 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6156ffd640 1 -- 172.21.15.59:0/3821980415 learned_addr learned my addr 172.21.15.59:0/3821980415 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6157fff640 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6157fff640 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 0x55f5d2e9bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6156ffd640 1 -- 172.21.15.59:0/3821980415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 msgr2=0x55f5d2e9bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6156ffd640 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 0x55f5d2e9bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6156ffd640 1 -- 172.21.15.59:0/3821980415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 msgr2=0x55f5d2e971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6156ffd640 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6156ffd640 1 -- 172.21.15.59:0/3821980415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5d2e97a00 con 0x55f5d2e89410 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6157fff640 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:03:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6156ffd640 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e9c2a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f614c024810 tx=0x7f614c0096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51b198397e6610f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.304+0000 7f6136ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6136ffd640 1 -- 172.21.15.59:0/3821980415 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c025e60 con 0x55f5d2e89410 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6136ffd640 1 -- 172.21.15.59:0/3821980415 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f614c024a80 con 0x55f5d2e89410 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6160fc0740 1 -- 172.21.15.59:0/3821980415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6150020040 con 0x55f5d2e89410 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6136ffd640 1 -- 172.21.15.59:0/3821980415 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f614c0050d0 con 0x55f5d2e89410 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6160fc0740 10 client.15405 fetch_fsmap learned FSMap version 25 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6160fc0740 1 -- 172.21.15.59:0/3821980415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f5d2f0e410 con 0x55f5d2e89410 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6136ffd640 1 -- 172.21.15.59:0/3821980415 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6150020040 con 0x55f5d2e89410 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6136ffd640 1 -- 172.21.15.59:0/3821980415 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f614c0039e0 con 0x55f5d2e89410 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6160fc0740 10 client.15405 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6160fc0740 10 client.15405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6160fc0740 20 client.15405 populate_metadata read hostname 'smithi059' 2024-09-10T11:03:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6160fc0740 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5d2f0eb80 0x55f5d2f10fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6160fc0740 4 client.15405 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:03:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6160fc0740 1 -- 172.21.15.59:0/3821980415 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f5d2df4d70 con 0x55f5d2f0eb80 2024-09-10T11:03:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.305+0000 7f6157fff640 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5d2f0eb80 0x55f5d2f10fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.306+0000 7f6157fff640 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5d2f0eb80 0x55f5d2f10fa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa9b4b25c85aa587 server_cookie=568cca72104c3a54 in_seq=0 out_seq=0 2024-09-10T11:03:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.306+0000 7f6136ffd640 10 client.15405 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6136ffd640 1 -- 172.21.15.59:0/3821980415 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f5d2df4d70 con 0x55f5d2f0eb80 2024-09-10T11:03:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6136ffd640 10 client.15405 handle_command_reply: tid=0 2024-09-10T11:03:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 client.15405 shutdown 2024-09-10T11:03:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 -- 172.21.15.59:0/3821980415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 msgr2=0x55f5d2e9c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e9c2a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f614c024810 tx=0x7f614c0096b0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 -- 172.21.15.59:0/3821980415 shutdown_connections 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5d2f0eb80 0x55f5d2f10fa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5d2e93cb0 0x55f5d2e971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5d2e89410 0x55f5d2e9c2a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6136ffd640 0 client.15405 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 --2- 172.21.15.59:0/3821980415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5d2e88af0 0x55f5d2e9bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 -- 172.21.15.59:0/3821980415 >> 172.21.15.59:0/3821980415 conn(0x55f5d2e85060 msgr2=0x55f5d2e92420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 -- 172.21.15.59:0/3821980415 shutdown_connections 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 1 -- 172.21.15.59:0/3821980415 wait complete. 2024-09-10T11:03:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.321+0000 7f6160fc0740 20 client.15405 trim_cache size 0 max 16384 2024-09-10T11:03:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:03:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:03:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:03:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:03:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 -- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f61400a2da0 msgr2=0x7f61400a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f61400a2da0 0x7f61400a5260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55f5d2e85ec0 tx=0x7f6148009260 comp rx=0 tx=0).stop 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 -- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158101ae0 msgr2=0x7f6158198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158101ae0 0x7f6158198380 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6148009230 tx=0x7f6148004270 comp rx=0 tx=0).stop 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 -- 172.21.15.59:0/3056649690 shutdown_connections 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6158107b80 0x7f615819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f61400a2da0 0x7f61400a5260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6158102480 0x7f61581988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 --2- 172.21.15.59:0/3056649690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6158101ae0 0x7f6158198380 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 -- 172.21.15.59:0/3056649690 >> 172.21.15.59:0/3056649690 conn(0x7f61580fd7e0 msgr2=0x7f61580feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 -- 172.21.15.59:0/3056649690 shutdown_connections 2024-09-10T11:03:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:24.322+0000 7f615e227640 1 -- 172.21.15.59:0/3056649690 wait complete. 2024-09-10T11:03:24.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:24 smithi059 ceph-mon[30978]: pgmap v63: 97 pgs: 97 active+clean; 2.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-10T11:03:24.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:24 smithi181 ceph-mon[35409]: pgmap v63: 97 pgs: 97 active+clean; 2.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-10T11:03:24.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:24 smithi115 ceph-mon[34719]: pgmap v63: 97 pgs: 97 active+clean; 2.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-10T11:03:26.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:26 smithi059 ceph-mon[30978]: pgmap v64: 97 pgs: 97 active+clean; 2.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 16 op/s 2024-09-10T11:03:26.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:26 smithi181 ceph-mon[35409]: pgmap v64: 97 pgs: 97 active+clean; 2.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 16 op/s 2024-09-10T11:03:26.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:26 smithi115 ceph-mon[34719]: pgmap v64: 97 pgs: 97 active+clean; 2.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 16 op/s 2024-09-10T11:03:27.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:27 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:03:27.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:27 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:03:27.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:27 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:03:28.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: pgmap v65: 97 pgs: 97 active+clean; 2.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-10T11:03:28.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:03:28.390 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:03:28.390 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: pgmap v65: 97 pgs: 97 active+clean; 2.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-10T11:03:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:03:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:03:28.438 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: pgmap v65: 97 pgs: 97 active+clean; 2.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-10T11:03:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:03:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:03:28.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:03:30.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:30 smithi059 ceph-mon[30978]: pgmap v66: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-10T11:03:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:30 smithi181 ceph-mon[35409]: pgmap v66: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-10T11:03:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:30 smithi115 ceph-mon[34719]: pgmap v66: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-10T11:03:32.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:32 smithi059 ceph-mon[30978]: pgmap v67: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-10T11:03:32.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:32 smithi181 ceph-mon[35409]: pgmap v67: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-10T11:03:32.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:32 smithi115 ceph-mon[34719]: pgmap v67: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-10T11:03:33.373 INFO:tasks.workunit.client.0.smithi059.stdout:1/600: open fd = 3 2024-09-10T11:03:33.373 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:2/600: open fd = 3 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:3/600: open fd = 3 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:4/600: open fd = 3 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:5/600: open fd = 3 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:6/600: open fd = 3 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:7/600: open fd = 3 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.375 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:8/600: open fd = 3 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:9/600: open fd = 3 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:10/600: open fd = 3 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:11/600: open fd = 3 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:12/600: open fd = 3 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:13/600: open fd = 3 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:14/600: open fd = 3 2024-09-10T11:03:33.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:15/600: open fd = 3 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:16/600: open fd = 3 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:17/600: open fd = 3 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:18/600: open fd = 3 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:19/600: open fd = 3 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:20/600: open fd = 3 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.379 INFO:tasks.workunit.client.0.smithi059.stdout:21/600: open fd = 3 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:22/600: open fd = 3 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:23/600: open fd = 3 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:24/600: open fd = 3 2024-09-10T11:03:33.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:25/600: open fd = 3 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:26/600: open fd = 3 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:27/600: open fd = 3 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:28/600: open fd = 3 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:29/600: open fd = 3 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:30/600: open fd = 3 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.382 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:31/600: open fd = 3 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:32/600: open fd = 3 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:33/600: open fd = 3 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:34/600: open fd = 3 2024-09-10T11:03:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:35/600: open fd = 3 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:36/600: open fd = 3 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:37/600: open fd = 3 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.384 INFO:tasks.workunit.client.0.smithi059.stdout:38/600: open fd = 3 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:39/600: open fd = 3 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:40/600: open fd = 3 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:41/600: open fd = 3 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:42/600: open fd = 3 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:43/600: open fd = 3 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:44/600: open fd = 3 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.386 INFO:tasks.workunit.client.0.smithi059.stdout:45/600: open fd = 3 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:46/600: open fd = 3 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:47/600: open fd = 3 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:48/600: open fd = 3 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.387 INFO:tasks.workunit.client.0.smithi059.stdout:49/600: open fd = 3 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:50/600: open fd = 3 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:51/600: open fd = 3 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:52/600: open fd = 3 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.388 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:53/600: open fd = 3 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:54/600: open fd = 3 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:55/600: open fd = 3 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:56/600: open fd = 3 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.389 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:57/600: open fd = 3 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:58/600: open fd = 3 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:59/600: open fd = 3 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.390 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:60/600: open fd = 3 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:61/600: open fd = 3 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:62/600: open fd = 3 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:63/600: open fd = 3 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.391 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:03:33.392 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:03:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:34 smithi059 ceph-mon[30978]: pgmap v68: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-10T11:03:34.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:34 smithi181 ceph-mon[35409]: pgmap v68: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-10T11:03:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:34 smithi115 ceph-mon[34719]: pgmap v68: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-10T11:03:36.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:36 smithi059 ceph-mon[30978]: pgmap v69: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-10T11:03:36.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:36 smithi181 ceph-mon[35409]: pgmap v69: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-10T11:03:36.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:36 smithi115 ceph-mon[34719]: pgmap v69: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-10T11:03:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 -- 172.21.15.59:0/2062841566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b0103640 msgr2=0x7f27b010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/2062841566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b0103640 0x7f27b010bb20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009900 tx=0x7f27a402a410 comp rx=0 tx=0).stop 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 -- 172.21.15.59:0/2062841566 shutdown_connections 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/2062841566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27b010c0f0 0x7f27b010e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/2062841566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b0103640 0x7f27b010bb20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/2062841566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27b0102d20 0x7f27b0103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 -- 172.21.15.59:0/2062841566 >> 172.21.15.59:0/2062841566 conn(0x7f27b00fc6f0 msgr2=0x7f27b00feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 -- 172.21.15.59:0/2062841566 shutdown_connections 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 -- 172.21.15.59:0/2062841566 wait complete. 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.423+0000 7f27b5fe8640 1 Processor -- start 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27b5fe8640 1 -- start start 2024-09-10T11:03:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27b5fe8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27b0102d20 0x7f27b01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27b5fe8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27b0103640 0x7f27b0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27b5fe8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b010c0f0 0x7f27b019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27b5fe8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27b0111ec0 con 0x7f27b010c0f0 2024-09-10T11:03:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27b5fe8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f27b0111d40 con 0x7f27b0103640 2024-09-10T11:03:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27b5fe8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f27b0112040 con 0x7f27b0102d20 2024-09-10T11:03:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b010c0f0 0x7f27b019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b010c0f0 0x7f27b019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44064/0 (socket says 172.21.15.59:44064) 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27affff640 1 -- 172.21.15.59:0/3451956018 learned_addr learned my addr 172.21.15.59:0/3451956018 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27af7fe640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27b0102d20 0x7f27b01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27aeffd640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27b0103640 0x7f27b0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27affff640 1 -- 172.21.15.59:0/3451956018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27b0102d20 msgr2=0x7f27b01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27affff640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27b0102d20 0x7f27b01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.424+0000 7f27affff640 1 -- 172.21.15.59:0/3451956018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27b0103640 msgr2=0x7f27b0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27affff640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27b0103640 0x7f27b0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27affff640 1 -- 172.21.15.59:0/3451956018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b019d3c0 con 0x7f27b010c0f0 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27af7fe640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27b0102d20 0x7f27b01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:03:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27aeffd640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27b0103640 0x7f27b0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:03:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27affff640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b010c0f0 0x7f27b019cc90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f27a800eaa0 tx=0x7f27a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27acff9640 1 -- 172.21.15.59:0/3451956018 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a800cdb0 con 0x7f27b010c0f0 2024-09-10T11:03:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27b5fe8640 1 -- 172.21.15.59:0/3451956018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b019d6b0 con 0x7f27b010c0f0 2024-09-10T11:03:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27acff9640 1 -- 172.21.15.59:0/3451956018 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27a8005020 con 0x7f27b010c0f0 2024-09-10T11:03:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27acff9640 1 -- 172.21.15.59:0/3451956018 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80116b0 con 0x7f27b010c0f0 2024-09-10T11:03:37.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.425+0000 7f27b5fe8640 1 -- 172.21.15.59:0/3451956018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b01a4f40 con 0x7f27b010c0f0 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27b8e5e740 1 Processor -- start 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27acff9640 1 -- 172.21.15.59:0/3451956018 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f27a8005560 con 0x7f27b010c0f0 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27b8e5e740 1 -- start start 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323ef00 0x558ba323f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3249b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba324a0c0 0x558ba324c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558ba319f2f0 con 0x558ba323f820 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558ba3147270 con 0x558ba324a0c0 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558ba319b2b0 con 0x558ba323ef00 2024-09-10T11:03:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27af7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3249b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27af7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3249b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44080/0 (socket says 172.21.15.59:44080) 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27af7fe640 1 -- 172.21.15.59:0/346432984 learned_addr learned my addr 172.21.15.59:0/346432984 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27aeffd640 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba324a0c0 0x558ba324c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.428+0000 7f27aeffd640 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323ef00 0x558ba323f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27af7fe640 1 -- 172.21.15.59:0/346432984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323ef00 msgr2=0x558ba323f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27af7fe640 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323ef00 0x558ba323f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27af7fe640 1 -- 172.21.15.59:0/346432984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba324a0c0 msgr2=0x558ba324c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27af7fe640 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba324a0c0 0x558ba324c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27af7fe640 1 -- 172.21.15.59:0/346432984 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba3146340 con 0x558ba323f820 2024-09-10T11:03:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27acff9640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f27980a2da0 0x7f27980a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27aeffd640 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba324a0c0 0x558ba324c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27acff9640 1 -- 172.21.15.59:0/3451956018 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f27a80cf5d0 con 0x7f27b010c0f0 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27aeffd640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f27980a2da0 0x7f27980a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f27af7fe640 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3249b80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f27a00115f0 tx=0x7f27a0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73c4413ee4546a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f2795ffb640 1 -- 172.21.15.59:0/346432984 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a001e070 con 0x558ba323f820 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f2795ffb640 1 -- 172.21.15.59:0/346432984 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27a000fb20 con 0x558ba323f820 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.429+0000 7f2795ffb640 1 -- 172.21.15.59:0/346432984 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0019be0 con 0x558ba323f820 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 -- 172.21.15.59:0/346432984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 msgr2=0x558ba3249b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27aeffd640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f27980a2da0 0x7f27980a5260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009230 tx=0x7f27a40314e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3249b80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f27a00115f0 tx=0x7f27a0011ab0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 -- 172.21.15.59:0/346432984 shutdown_connections 2024-09-10T11:03:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba324a0c0 0x558ba324c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3249b80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/346432984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323ef00 0x558ba323f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 -- 172.21.15.59:0/346432984 >> 172.21.15.59:0/346432984 conn(0x558ba323b470 msgr2=0x558ba323b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 -- 172.21.15.59:0/346432984 shutdown_connections 2024-09-10T11:03:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 -- 172.21.15.59:0/346432984 wait complete. 2024-09-10T11:03:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.430+0000 7f27b8e5e740 1 -- start start 2024-09-10T11:03:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27b8e5e740 1 Processor -- start 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323ef00 0x558ba3246f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323f820 0x558ba32474c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3247a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558ba324cc90 con 0x558ba323ef00 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558ba3128290 con 0x558ba323f820 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558ba324ce10 con 0x558ba324a0c0 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27b8e5e740 10 client.0 _ll_register_callbacks cb 0x558ba3159140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27af7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323ef00 0x558ba3246f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27af7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323ef00 0x558ba3246f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44082/0 (socket says 172.21.15.59:44082) 2024-09-10T11:03:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27af7fe640 1 -- 172.21.15.59:0/4258666553 learned_addr learned my addr 172.21.15.59:0/4258666553 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27affff640 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3247a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27aeffd640 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323f820 0x558ba32474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27af7fe640 1 -- 172.21.15.59:0/4258666553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 msgr2=0x558ba3247a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27af7fe640 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3247a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27af7fe640 1 -- 172.21.15.59:0/4258666553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323f820 msgr2=0x558ba32474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27af7fe640 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323f820 0x558ba32474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27af7fe640 1 -- 172.21.15.59:0/4258666553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba2eb2210 con 0x558ba323ef00 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27affff640 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3247a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27aeffd640 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323f820 0x558ba32474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:03:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f27af7fe640 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323ef00 0x558ba3246f80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f27a000f920 tx=0x7f27a000f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794857c793d63ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.431+0000 7f278effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f278effd640 1 -- 172.21.15.59:0/4258666553 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a001e040 con 0x558ba323ef00 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f278effd640 1 -- 172.21.15.59:0/4258666553 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f27a0004050 con 0x558ba323ef00 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f27b8e5e740 1 -- 172.21.15.59:0/4258666553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a000fb20 con 0x558ba323ef00 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f278effd640 1 -- 172.21.15.59:0/4258666553 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27a002f050 con 0x558ba323ef00 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f27b8e5e740 10 client.15417 fetch_fsmap learned FSMap version 25 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f27b8e5e740 1 -- 172.21.15.59:0/4258666553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ba2f7e620 con 0x558ba323ef00 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f278effd640 1 -- 172.21.15.59:0/4258666553 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27a000fb20 con 0x558ba323ef00 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f278effd640 1 -- 172.21.15.59:0/4258666553 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f27a002a030 con 0x558ba323ef00 2024-09-10T11:03:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f27b8e5e740 10 client.15417 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:03:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f27b8e5e740 10 client.15417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:03:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f27b8e5e740 20 client.15417 populate_metadata read hostname 'smithi059' 2024-09-10T11:03:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558ba3259fe0 0x558ba325c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f27b8e5e740 4 client.15417 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:03:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.432+0000 7f27b8e5e740 1 -- 172.21.15.59:0/4258666553 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ba31aca20 con 0x558ba3259fe0 2024-09-10T11:03:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.433+0000 7f27aeffd640 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558ba3259fe0 0x558ba325c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.433+0000 7f278effd640 10 client.15417 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.433+0000 7f27aeffd640 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558ba3259fe0 0x558ba325c3d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfb7df3bc265b150 server_cookie=efaf564d81dc62e5 in_seq=0 out_seq=0 2024-09-10T11:03:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f278effd640 1 -- 172.21.15.59:0/4258666553 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ba31aca20 con 0x558ba3259fe0 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f278effd640 10 client.15417 handle_command_reply: tid=0 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 client.15417 shutdown 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 -- 172.21.15.59:0/4258666553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323ef00 msgr2=0x558ba3246f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323ef00 0x558ba3246f80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f27a000f920 tx=0x7f27a000f950 comp rx=0 tx=0).stop 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 -- 172.21.15.59:0/4258666553 shutdown_connections 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558ba3259fe0 0x558ba325c3d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3247a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323f820 0x558ba32474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/4258666553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323ef00 0x558ba3246f80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f278effd640 0 client.15417 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 -- 172.21.15.59:0/4258666553 >> 172.21.15.59:0/4258666553 conn(0x558ba323b470 msgr2=0x558ba3241180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 -- 172.21.15.59:0/4258666553 shutdown_connections 2024-09-10T11:03:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 1 -- 172.21.15.59:0/4258666553 wait complete. 2024-09-10T11:03:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.434+0000 7f27b8e5e740 20 client.15417 trim_cache size 0 max 16384 2024-09-10T11:03:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27b8e5e740 1 Processor -- start 2024-09-10T11:03:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27b8e5e740 1 -- start start 2024-09-10T11:03:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 0x558ba3241070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323f820 0x558ba3261b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba324a0c0 0x558ba3262080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01adf10 con 0x558ba324a0c0 2024-09-10T11:03:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01ab7e0 con 0x558ba323ef00 2024-09-10T11:03:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01a9630 con 0x558ba323f820 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba324a0c0 0x558ba3262080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba324a0c0 0x558ba3262080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44088/0 (socket says 172.21.15.59:44088) 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27affff640 1 -- 172.21.15.59:0/1838104214 learned_addr learned my addr 172.21.15.59:0/1838104214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27af7fe640 1 --2- 172.21.15.59:0/1838104214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 0x558ba3241070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.449+0000 7f27aeffd640 1 --2- 172.21.15.59:0/1838104214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323f820 0x558ba3261b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.450+0000 7f27affff640 1 -- 172.21.15.59:0/1838104214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323f820 msgr2=0x558ba3261b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.450+0000 7f27affff640 1 --2- 172.21.15.59:0/1838104214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323f820 0x558ba3261b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.450+0000 7f27affff640 1 -- 172.21.15.59:0/1838104214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 msgr2=0x558ba3241070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.450+0000 7f27affff640 1 --2- 172.21.15.59:0/1838104214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 0x558ba3241070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.450+0000 7f27affff640 1 -- 172.21.15.59:0/1838104214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba323b2a0 con 0x558ba324a0c0 2024-09-10T11:03:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.450+0000 7f27affff640 1 --2- 172.21.15.59:0/1838104214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba324a0c0 0x558ba3262080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f27a80cd300 tx=0x7f27a809ffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae549939aedf7721 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.450+0000 7f27957fa640 1 -- 172.21.15.59:0/1838104214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a801f040 con 0x558ba324a0c0 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.450+0000 7f27957fa640 1 -- 172.21.15.59:0/1838104214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27a80051d0 con 0x558ba324a0c0 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.450+0000 7f27957fa640 1 -- 172.21.15.59:0/1838104214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80978d0 con 0x558ba324a0c0 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1838104214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba324a0c0 msgr2=0x558ba3262080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1838104214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba324a0c0 0x558ba3262080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f27a80cd300 tx=0x7f27a809ffc0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1838104214 shutdown_connections 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1838104214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba324a0c0 0x558ba3262080 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1838104214 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba323f820 0x558ba3261b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1838104214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 0x558ba3241070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1838104214 >> 172.21.15.59:0/1838104214 conn(0x558ba323b470 msgr2=0x558ba3240960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1838104214 shutdown_connections 2024-09-10T11:03:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1838104214 wait complete. 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 -- start start 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 Processor -- start 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 0x558ba32529a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3243e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3244600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01a9ca0 con 0x558ba323f820 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01ab110 con 0x558ba323ef00 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.451+0000 7f27b8e5e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01aa370 con 0x558ba324a0c0 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27b8e5e740 10 client.0 _ll_register_callbacks cb 0x7f27a001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27aeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3243e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27aeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3243e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44104/0 (socket says 172.21.15.59:44104) 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27aeffd640 1 -- 172.21.15.59:0/1150750075 learned_addr learned my addr 172.21.15.59:0/1150750075 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27af7fe640 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 0x558ba32529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27affff640 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3244600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27aeffd640 1 -- 172.21.15.59:0/1150750075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 msgr2=0x558ba3244600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27aeffd640 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3244600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27aeffd640 1 -- 172.21.15.59:0/1150750075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 msgr2=0x558ba32529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27aeffd640 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 0x558ba32529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27aeffd640 1 -- 172.21.15.59:0/1150750075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba3249b10 con 0x558ba323f820 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27affff640 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3244600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27aeffd640 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3243e70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f27a402a930 tx=0x7f27a40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2445f89eca73a1d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f278effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f278effd640 1 -- 172.21.15.59:0/1150750075 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4057070 con 0x558ba323f820 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f278effd640 1 -- 172.21.15.59:0/1150750075 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f27a40037f0 con 0x558ba323f820 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1150750075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a80051d0 con 0x558ba323f820 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f278effd640 1 -- 172.21.15.59:0/1150750075 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27a4003a10 con 0x558ba323f820 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27b8e5e740 10 client.15423 fetch_fsmap learned FSMap version 25 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.452+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1150750075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ba3246d50 con 0x558ba323f820 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f278effd640 1 -- 172.21.15.59:0/1150750075 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27a80051d0 con 0x558ba323f820 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f278effd640 1 -- 172.21.15.59:0/1150750075 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f27a4065c70 con 0x558ba323f820 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f27b8e5e740 10 client.15423 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f27b8e5e740 10 client.15423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:03:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f27b8e5e740 20 client.15423 populate_metadata read hostname 'smithi059' 2024-09-10T11:03:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558ba32c50e0 0x558ba32c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f27b8e5e740 4 client.15423 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:03:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1150750075 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ba31a6d70 con 0x558ba32c50e0 2024-09-10T11:03:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f27af7fe640 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558ba32c50e0 0x558ba32c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f27af7fe640 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558ba32c50e0 0x558ba32c7500 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=492e16f6bd14186a server_cookie=4410616f8e998525 in_seq=0 out_seq=0 2024-09-10T11:03:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.453+0000 7f278effd640 10 client.15423 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f278effd640 1 -- 172.21.15.59:0/1150750075 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ba31a6d70 con 0x558ba32c50e0 2024-09-10T11:03:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f278effd640 10 client.15423 handle_command_reply: tid=0 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f27b8e5e740 1 client.15423 shutdown 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1150750075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 msgr2=0x558ba3243e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3243e70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f27a402a930 tx=0x7f27a40058d0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1150750075 shutdown_connections 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558ba32c50e0 0x558ba32c7500 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558ba324a0c0 0x558ba3244600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f278effd640 0 client.15423 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ba323f820 0x558ba3243e70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f27b8e5e740 1 --2- 172.21.15.59:0/1150750075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558ba323ef00 0x558ba32529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.465+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1150750075 >> 172.21.15.59:0/1150750075 conn(0x558ba323b470 msgr2=0x558ba32361c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1150750075 shutdown_connections 2024-09-10T11:03:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b8e5e740 1 -- 172.21.15.59:0/1150750075 wait complete. 2024-09-10T11:03:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b8e5e740 20 client.15423 trim_cache size 0 max 16384 2024-09-10T11:03:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:03:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:03:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:03:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:03:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 -- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f27980a2da0 msgr2=0x7f27980a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f27980a2da0 0x7f27980a5260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009230 tx=0x7f27a40314e0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 -- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b010c0f0 msgr2=0x7f27b019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b010c0f0 0x7f27b019cc90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f27a800eaa0 tx=0x7f27a800ef60 comp rx=0 tx=0).stop 2024-09-10T11:03:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 -- 172.21.15.59:0/3451956018 shutdown_connections 2024-09-10T11:03:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27b010c0f0 0x7f27b019cc90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27b0103640 0x7f27b0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f27980a2da0 0x7f27980a5260 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 --2- 172.21.15.59:0/3451956018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f27b0102d20 0x7f27b01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 -- 172.21.15.59:0/3451956018 >> 172.21.15.59:0/3451956018 conn(0x7f27b00fc6f0 msgr2=0x7f27b00fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 -- 172.21.15.59:0/3451956018 shutdown_connections 2024-09-10T11:03:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:37.466+0000 7f27b5fe8640 1 -- 172.21.15.59:0/3451956018 wait complete. 2024-09-10T11:03:38.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:38 smithi059 ceph-mon[30978]: pgmap v70: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-10T11:03:38.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:38 smithi181 ceph-mon[35409]: pgmap v70: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-10T11:03:38.460 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:38 smithi115 ceph-mon[34719]: pgmap v70: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-10T11:03:40.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:40 smithi059 ceph-mon[30978]: pgmap v71: 97 pgs: 97 active+clean; 2.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-09-10T11:03:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:40 smithi181 ceph-mon[35409]: pgmap v71: 97 pgs: 97 active+clean; 2.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-09-10T11:03:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:40 smithi115 ceph-mon[34719]: pgmap v71: 97 pgs: 97 active+clean; 2.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-09-10T11:03:42.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:42 smithi059 ceph-mon[30978]: pgmap v72: 97 pgs: 97 active+clean; 2.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:03:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:42 smithi181 ceph-mon[35409]: pgmap v72: 97 pgs: 97 active+clean; 2.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:03:42.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:42 smithi115 ceph-mon[34719]: pgmap v72: 97 pgs: 97 active+clean; 2.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:03:44.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:44 smithi059 ceph-mon[30978]: pgmap v73: 97 pgs: 97 active+clean; 2.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:03:44.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:44 smithi181 ceph-mon[35409]: pgmap v73: 97 pgs: 97 active+clean; 2.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:03:44.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:44 smithi115 ceph-mon[34719]: pgmap v73: 97 pgs: 97 active+clean; 2.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:03:46.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:46 smithi059 ceph-mon[30978]: pgmap v74: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 17 op/s 2024-09-10T11:03:46.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:46 smithi181 ceph-mon[35409]: pgmap v74: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 17 op/s 2024-09-10T11:03:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:46 smithi115 ceph-mon[34719]: pgmap v74: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 17 op/s 2024-09-10T11:03:48.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:48 smithi059 ceph-mon[30978]: pgmap v75: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:03:48.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:48 smithi181 ceph-mon[35409]: pgmap v75: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:03:48.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:48 smithi115 ceph-mon[34719]: pgmap v75: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:03:49.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:49 smithi059 ceph-mon[30978]: pgmap v76: 97 pgs: 97 active+clean; 2.8 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 17 op/s 2024-09-10T11:03:49.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:49 smithi181 ceph-mon[35409]: pgmap v76: 97 pgs: 97 active+clean; 2.8 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 17 op/s 2024-09-10T11:03:49.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:49 smithi115 ceph-mon[34719]: pgmap v76: 97 pgs: 97 active+clean; 2.8 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 17 op/s 2024-09-10T11:03:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.567+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/2364825812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df8101350 msgr2=0x7f7df810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.567+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/2364825812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df8101350 0x7f7df810d880 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009cd0 tx=0x7f7df002a8e0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.567+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/2364825812 shutdown_connections 2024-09-10T11:03:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.567+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/2364825812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df8101350 0x7f7df810d880 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.567+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/2364825812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7df81009b0 0x7f7df8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.567+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/2364825812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7df81069c0 0x7f7df8106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.567+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/2364825812 >> 172.21.15.59:0/2364825812 conn(0x7f7df8077990 msgr2=0x7f7df80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.567+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/2364825812 shutdown_connections 2024-09-10T11:03:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.567+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/2364825812 wait complete. 2024-09-10T11:03:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7dfd4b7640 1 Processor -- start 2024-09-10T11:03:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7dfd4b7640 1 -- start start 2024-09-10T11:03:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7dfd4b7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7df81009b0 0x7f7df81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7dfd4b7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7df8101350 0x7f7df8198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7dfd4b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df81069c0 0x7f7df819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7dfd4b7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7df8111ef0 con 0x7f7df81069c0 2024-09-10T11:03:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7dfd4b7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7df8111d70 con 0x7f7df81009b0 2024-09-10T11:03:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7dfd4b7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7df8112070 con 0x7f7df8101350 2024-09-10T11:03:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7df77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df81069c0 0x7f7df819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7df67fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7df8101350 0x7f7df8198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7df77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df81069c0 0x7f7df819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47592/0 (socket says 172.21.15.59:47592) 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7df77fe640 1 -- 172.21.15.59:0/643670715 learned_addr learned my addr 172.21.15.59:0/643670715 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.568+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7df81009b0 0x7f7df81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7df77fe640 1 -- 172.21.15.59:0/643670715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7df8101350 msgr2=0x7f7df8198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7df77fe640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7df8101350 0x7f7df8198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7df77fe640 1 -- 172.21.15.59:0/643670715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7df81009b0 msgr2=0x7f7df81982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7df77fe640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7df81009b0 0x7f7df81982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7df77fe640 1 -- 172.21.15.59:0/643670715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df819d2e0 con 0x7f7df81069c0 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7df77fe640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df81069c0 0x7f7df819cbb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7df0005cc0 tx=0x7f7df0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7ddffff640 1 -- 172.21.15.59:0/643670715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df0004040 con 0x7f7df81069c0 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/643670715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df819d570 con 0x7f7df81069c0 2024-09-10T11:03:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7ddffff640 1 -- 172.21.15.59:0/643670715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7df00046c0 con 0x7f7df81069c0 2024-09-10T11:03:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7ddffff640 1 -- 172.21.15.59:0/643670715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df0046480 con 0x7f7df81069c0 2024-09-10T11:03:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.569+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/643670715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df81a4e60 con 0x7f7df81069c0 2024-09-10T11:03:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.572+0000 7f7ddffff640 1 -- 172.21.15.59:0/643670715 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7df00305a0 con 0x7f7df81069c0 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.572+0000 7f7e0024f740 1 Processor -- start 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.572+0000 7f7e0024f740 1 -- start start 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b359e9d0 0x55a2b359edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35adb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b35ae0c0 0x55a2b35b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7e0024f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a2b35032f0 con 0x55a2b359e9d0 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7e0024f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a2b34ab270 con 0x55a2b35ae0c0 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7e0024f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a2b34ff2b0 con 0x55a2b359f2f0 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b359e9d0 0x55a2b359edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b359e9d0 0x55a2b359edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47604/0 (socket says 172.21.15.59:47604) 2024-09-10T11:03:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df67fc640 1 -- 172.21.15.59:0/637909439 learned_addr learned my addr 172.21.15.59:0/637909439 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/637909439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7ddffff640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f7de00a2da0 0x7f7de00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df67fc640 1 -- 172.21.15.59:0/637909439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 msgr2=0x55a2b35adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df67fc640 1 --2- 172.21.15.59:0/637909439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df67fc640 1 -- 172.21.15.59:0/637909439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b35ae0c0 msgr2=0x55a2b35b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df67fc640 1 --2- 172.21.15.59:0/637909439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b35ae0c0 0x55a2b35b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df67fc640 1 -- 172.21.15.59:0/637909439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b34aa340 con 0x55a2b359e9d0 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df77fe640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f7de00a2da0 0x7f7de00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7ddffff640 1 -- 172.21.15.59:0/643670715 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f7df002e030 con 0x7f7df81069c0 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.573+0000 7f7df67fc640 1 --2- 172.21.15.59:0/637909439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b359e9d0 0x55a2b359edb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00aca0 tx=0x7f7dec0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1a6cefa363c5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.574+0000 7f7ddd7fa640 1 -- 172.21.15.59:0/637909439 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec005020 con 0x55a2b359e9d0 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.574+0000 7f7ddd7fa640 1 -- 172.21.15.59:0/637909439 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dec0047a0 con 0x55a2b359e9d0 2024-09-10T11:03:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.574+0000 7f7ddd7fa640 1 -- 172.21.15.59:0/637909439 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0126b0 con 0x55a2b359e9d0 2024-09-10T11:03:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.574+0000 7f7e0024f740 1 -- 172.21.15.59:0/637909439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b359e9d0 msgr2=0x55a2b359edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.574+0000 7f7df77fe640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f7de00a2da0 0x7f7de00a5260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7df00ee800 tx=0x7f7df00dd040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.574+0000 7f7e0024f740 1 --2- 172.21.15.59:0/637909439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b359e9d0 0x55a2b359edb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00aca0 tx=0x7f7dec0117b0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 -- 172.21.15.59:0/637909439 shutdown_connections 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 --2- 172.21.15.59:0/637909439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b35ae0c0 0x55a2b35b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 --2- 172.21.15.59:0/637909439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 --2- 172.21.15.59:0/637909439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b359e9d0 0x55a2b359edb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 -- 172.21.15.59:0/637909439 >> 172.21.15.59:0/637909439 conn(0x55a2b359b060 msgr2=0x55a2b359b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 -- 172.21.15.59:0/637909439 shutdown_connections 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 -- 172.21.15.59:0/637909439 wait complete. 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 -- start start 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 Processor -- start 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35aba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a2b35b0cf0 con 0x55a2b35ae0c0 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a2b348c290 con 0x55a2b359e9d0 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a2b35b0e70 con 0x55a2b359f2f0 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.575+0000 7f7e0024f740 10 client.0 _ll_register_callbacks cb 0x55a2b34bd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47608/0 (socket says 172.21.15.59:47608) 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 -- 172.21.15.59:0/1402770609 learned_addr learned my addr 172.21.15.59:0/1402770609 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 -- 172.21.15.59:0/1402770609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 msgr2=0x55a2b35ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 -- 172.21.15.59:0/1402770609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 msgr2=0x55a2b35aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 -- 172.21.15.59:0/1402770609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b3216210 con 0x55a2b35ae0c0 2024-09-10T11:03:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:03:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7df67fc640 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35aba00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7dec005450 tx=0x7f7dec00afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c81a62e9584b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7ddaff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:03:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7ddaff5640 1 -- 172.21.15.59:0/1402770609 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec024040 con 0x55a2b35ae0c0 2024-09-10T11:03:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7ddaff5640 1 -- 172.21.15.59:0/1402770609 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f7dec012650 con 0x55a2b35ae0c0 2024-09-10T11:03:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7e0024f740 1 -- 172.21.15.59:0/1402770609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dec0047a0 con 0x55a2b35ae0c0 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.576+0000 7f7ddaff5640 1 -- 172.21.15.59:0/1402770609 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7dec0110d0 con 0x55a2b35ae0c0 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7e0024f740 10 client.15435 fetch_fsmap learned FSMap version 25 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7e0024f740 1 -- 172.21.15.59:0/1402770609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a2b32e2620 con 0x55a2b35ae0c0 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7ddaff5640 1 -- 172.21.15.59:0/1402770609 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dec0047a0 con 0x55a2b35ae0c0 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7ddaff5640 1 -- 172.21.15.59:0/1402770609 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7dec00f870 con 0x55a2b35ae0c0 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7e0024f740 10 client.15435 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7e0024f740 10 client.15435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7e0024f740 20 client.15435 populate_metadata read hostname 'smithi059' 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7e0024f740 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a2b35be010 0x55a2b35c0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7e0024f740 4 client.15435 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7e0024f740 1 -- 172.21.15.59:0/1402770609 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2b3510a20 con 0x55a2b35be010 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.577+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a2b35be010 0x55a2b35c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.578+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a2b35be010 0x55a2b35c0400 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d466e9730f38be9a server_cookie=9eeb4f9ad9c3c25c in_seq=0 out_seq=0 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.578+0000 7f7ddaff5640 10 client.15435 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7ddaff5640 1 -- 172.21.15.59:0/1402770609 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2b3510a20 con 0x55a2b35be010 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7ddaff5640 10 client.15435 handle_command_reply: tid=0 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 client.15435 shutdown 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 -- 172.21.15.59:0/1402770609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 msgr2=0x55a2b35aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35aba00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7dec005450 tx=0x7f7dec00afa0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 -- 172.21.15.59:0/1402770609 shutdown_connections 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a2b35be010 0x55a2b35c0400 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35aba00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 --2- 172.21.15.59:0/1402770609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7ddaff5640 0 client.15435 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 -- 172.21.15.59:0/1402770609 >> 172.21.15.59:0/1402770609 conn(0x55a2b359b060 msgr2=0x55a2b35a0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 -- 172.21.15.59:0/1402770609 shutdown_connections 2024-09-10T11:03:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 1 -- 172.21.15.59:0/1402770609 wait complete. 2024-09-10T11:03:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.579+0000 7f7e0024f740 20 client.15435 trim_cache size 0 max 16384 2024-09-10T11:03:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.593+0000 7f7e0024f740 1 Processor -- start 2024-09-10T11:03:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.593+0000 7f7e0024f740 1 -- start start 2024-09-10T11:03:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35c6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7e0024f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81adee0 con 0x55a2b35ae0c0 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7e0024f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81ab7b0 con 0x55a2b359e9d0 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7e0024f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81a9600 con 0x55a2b359f2f0 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47620/0 (socket says 172.21.15.59:47620) 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 -- 172.21.15.59:0/860482675 learned_addr learned my addr 172.21.15.59:0/860482675 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 -- 172.21.15.59:0/860482675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 msgr2=0x55a2b35c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 -- 172.21.15.59:0/860482675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 msgr2=0x55a2b35acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 -- 172.21.15.59:0/860482675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b359ae90 con 0x55a2b35ae0c0 2024-09-10T11:03:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7df67fc640 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35c6060 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00aca0 tx=0x7f7dec0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d82c988b4f01eff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.594+0000 7f7ddcff9640 1 -- 172.21.15.59:0/860482675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00fe60 con 0x55a2b35ae0c0 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7ddcff9640 1 -- 172.21.15.59:0/860482675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dec035030 con 0x55a2b35ae0c0 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7ddcff9640 1 -- 172.21.15.59:0/860482675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00e870 con 0x55a2b35ae0c0 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 -- 172.21.15.59:0/860482675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 msgr2=0x55a2b35c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35c6060 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00aca0 tx=0x7f7dec0117b0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 -- 172.21.15.59:0/860482675 shutdown_connections 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35c6060 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 --2- 172.21.15.59:0/860482675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 -- 172.21.15.59:0/860482675 >> 172.21.15.59:0/860482675 conn(0x55a2b359b060 msgr2=0x55a2b35ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 -- 172.21.15.59:0/860482675 shutdown_connections 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 -- 172.21.15.59:0/860482675 wait complete. 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 -- start start 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.595+0000 7f7e0024f740 1 Processor -- start 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35b6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7e0024f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7e0024f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81a9c70 con 0x55a2b35ae0c0 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7e0024f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81ab0e0 con 0x55a2b359e9d0 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7e0024f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81aa340 con 0x55a2b359f2f0 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7e0024f740 10 client.0 _ll_register_callbacks cb 0x7f7de800b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47624/0 (socket says 172.21.15.59:47624) 2024-09-10T11:03:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 -- 172.21.15.59:0/185051166 learned_addr learned my addr 172.21.15.59:0/185051166 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 -- 172.21.15.59:0/185051166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 msgr2=0x55a2b35b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 -- 172.21.15.59:0/185051166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 msgr2=0x55a2b35b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35b6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 -- 172.21.15.59:0/185051166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b35b22b0 con 0x55a2b35ae0c0 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7df67fc640 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35b1a80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7dec011310 tx=0x7f7dec004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c80df280f734ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.596+0000 7f7ddaff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7ddaff5640 1 -- 172.21.15.59:0/185051166 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00fe60 con 0x55a2b35ae0c0 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7ddaff5640 1 -- 172.21.15.59:0/185051166 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f7dec00a650 con 0x55a2b35ae0c0 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7e0024f740 1 -- 172.21.15.59:0/185051166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dec035030 con 0x55a2b35ae0c0 2024-09-10T11:03:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7ddaff5640 1 -- 172.21.15.59:0/185051166 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7dec00a850 con 0x55a2b35ae0c0 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7e0024f740 10 client.15441 fetch_fsmap learned FSMap version 25 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7e0024f740 1 -- 172.21.15.59:0/185051166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a2b3628720 con 0x55a2b35ae0c0 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7ddaff5640 1 -- 172.21.15.59:0/185051166 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dec035030 con 0x55a2b35ae0c0 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7ddaff5640 1 -- 172.21.15.59:0/185051166 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7dec03a8c0 con 0x55a2b35ae0c0 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7e0024f740 10 client.15441 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7e0024f740 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7e0024f740 20 client.15441 populate_metadata read hostname 'smithi059' 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7e0024f740 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a2b3628de0 0x55a2b362b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7e0024f740 4 client.15441 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.597+0000 7f7e0024f740 1 -- 172.21.15.59:0/185051166 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a2b350ad70 con 0x55a2b3628de0 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.598+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a2b3628de0 0x55a2b362b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.598+0000 7f7ddaff5640 10 client.15441 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:50.605 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.598+0000 7f7df6ffd640 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a2b3628de0 0x55a2b362b200 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da8878aa01354fca server_cookie=5569f8316aa47105 in_seq=0 out_seq=0 2024-09-10T11:03:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.611+0000 7f7ddaff5640 1 -- 172.21.15.59:0/185051166 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a2b350ad70 con 0x55a2b3628de0 2024-09-10T11:03:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.611+0000 7f7ddaff5640 10 client.15441 handle_command_reply: tid=0 2024-09-10T11:03:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.611+0000 7f7e0024f740 1 client.15441 shutdown 2024-09-10T11:03:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 -- 172.21.15.59:0/185051166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 msgr2=0x55a2b35b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35b1a80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7dec011310 tx=0x7f7dec004840 comp rx=0 tx=0).stop 2024-09-10T11:03:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 -- 172.21.15.59:0/185051166 shutdown_connections 2024-09-10T11:03:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a2b3628de0 0x55a2b362b200 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2b35ae0c0 0x55a2b35b1a80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7ddaff5640 0 client.15441 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a2b359f2f0 0x55a2b35b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 --2- 172.21.15.59:0/185051166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a2b359e9d0 0x55a2b35b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 -- 172.21.15.59:0/185051166 >> 172.21.15.59:0/185051166 conn(0x55a2b359b060 msgr2=0x55a2b35ab760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 -- 172.21.15.59:0/185051166 shutdown_connections 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 1 -- 172.21.15.59:0/185051166 wait complete. 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7e0024f740 20 client.15441 trim_cache size 0 max 16384 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:03:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:03:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:03:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:03:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f7de00a2da0 msgr2=0x7f7de00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:50.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f7de00a2da0 0x7f7de00a5260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7df00ee800 tx=0x7f7df00dd040 comp rx=0 tx=0).stop 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df81069c0 msgr2=0x7f7df819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df81069c0 0x7f7df819cbb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7df0005cc0 tx=0x7f7df0003970 comp rx=0 tx=0).stop 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/643670715 shutdown_connections 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df81069c0 0x7f7df819cbb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f7de00a2da0 0x7f7de00a5260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7df8101350 0x7f7df8198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 --2- 172.21.15.59:0/643670715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7df81009b0 0x7f7df81982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.612+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/643670715 >> 172.21.15.59:0/643670715 conn(0x7f7df8077990 msgr2=0x7f7df8103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.613+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/643670715 shutdown_connections 2024-09-10T11:03:50.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:03:50.613+0000 7f7dfd4b7640 1 -- 172.21.15.59:0/643670715 wait complete. 2024-09-10T11:03:51.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:51 smithi059 ceph-mon[30978]: pgmap v77: 97 pgs: 97 active+clean; 2.8 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-10T11:03:51.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:51 smithi181 ceph-mon[35409]: pgmap v77: 97 pgs: 97 active+clean; 2.8 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-10T11:03:51.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:51 smithi115 ceph-mon[34719]: pgmap v77: 97 pgs: 97 active+clean; 2.8 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-10T11:03:53.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:53 smithi059 ceph-mon[30978]: pgmap v78: 97 pgs: 97 active+clean; 2.8 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-10T11:03:53.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:53 smithi181 ceph-mon[35409]: pgmap v78: 97 pgs: 97 active+clean; 2.8 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-10T11:03:53.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:53 smithi115 ceph-mon[34719]: pgmap v78: 97 pgs: 97 active+clean; 2.8 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-10T11:03:55.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:55 smithi059 ceph-mon[30978]: pgmap v79: 97 pgs: 97 active+clean; 2.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 17 op/s 2024-09-10T11:03:55.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:55 smithi181 ceph-mon[35409]: pgmap v79: 97 pgs: 97 active+clean; 2.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 17 op/s 2024-09-10T11:03:55.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:55 smithi115 ceph-mon[34719]: pgmap v79: 97 pgs: 97 active+clean; 2.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 17 op/s 2024-09-10T11:03:57.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:57 smithi059 ceph-mon[30978]: pgmap v80: 97 pgs: 97 active+clean; 2.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-10T11:03:57.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:57 smithi181 ceph-mon[35409]: pgmap v80: 97 pgs: 97 active+clean; 2.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-10T11:03:57.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:57 smithi115 ceph-mon[34719]: pgmap v80: 97 pgs: 97 active+clean; 2.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-10T11:03:59.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:03:59 smithi059 ceph-mon[30978]: pgmap v81: 97 pgs: 97 active+clean; 3.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-09-10T11:03:59.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:03:59 smithi181 ceph-mon[35409]: pgmap v81: 97 pgs: 97 active+clean; 3.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-09-10T11:03:59.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:03:59 smithi115 ceph-mon[34719]: pgmap v81: 97 pgs: 97 active+clean; 3.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-09-10T11:04:01.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:01 smithi059 ceph-mon[30978]: pgmap v82: 97 pgs: 97 active+clean; 3.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:04:01.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:01 smithi181 ceph-mon[35409]: pgmap v82: 97 pgs: 97 active+clean; 3.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:04:01.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:01 smithi115 ceph-mon[34719]: pgmap v82: 97 pgs: 97 active+clean; 3.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:04:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.714+0000 7f53ecf42640 1 -- 172.21.15.59:0/3800653011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e810c110 msgr2=0x7f53e810e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.714+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3800653011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e810c110 0x7f53e810e590 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009ca0 tx=0x7f53e002a950 comp rx=0 tx=0).stop 2024-09-10T11:04:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.714+0000 7f53ecf42640 1 -- 172.21.15.59:0/3800653011 shutdown_connections 2024-09-10T11:04:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.714+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3800653011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e810c110 0x7f53e810e590 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.714+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3800653011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53e81035e0 0x7f53e810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.714+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3800653011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e8102cc0 0x7f53e81030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.714+0000 7f53ecf42640 1 -- 172.21.15.59:0/3800653011 >> 172.21.15.59:0/3800653011 conn(0x7f53e80fc6b0 msgr2=0x7f53e80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.714+0000 7f53ecf42640 1 -- 172.21.15.59:0/3800653011 shutdown_connections 2024-09-10T11:04:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.714+0000 7f53ecf42640 1 -- 172.21.15.59:0/3800653011 wait complete. 2024-09-10T11:04:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53ecf42640 1 Processor -- start 2024-09-10T11:04:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53ecf42640 1 -- start start 2024-09-10T11:04:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53ecf42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53e8102cc0 0x7f53e8100910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53ecf42640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e81035e0 0x7f53e8100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53ecf42640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e810c110 0x7f53e8101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53ecf42640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53e8111ef0 con 0x7f53e81035e0 2024-09-10T11:04:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53ecf42640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f53e8111d70 con 0x7f53e810c110 2024-09-10T11:04:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53ecf42640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f53e8112070 con 0x7f53e8102cc0 2024-09-10T11:04:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53e5d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e81035e0 0x7f53e8100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53e5d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e81035e0 0x7f53e8100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48698/0 (socket says 172.21.15.59:48698) 2024-09-10T11:04:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53e5d9b640 1 -- 172.21.15.59:0/3567748166 learned_addr learned my addr 172.21.15.59:0/3567748166 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53e659c640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53e8102cc0 0x7f53e8100910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.715+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e810c110 0x7f53e8101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53e5d9b640 1 -- 172.21.15.59:0/3567748166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53e8102cc0 msgr2=0x7f53e8100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53e5d9b640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53e8102cc0 0x7f53e8100910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53e5d9b640 1 -- 172.21.15.59:0/3567748166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e810c110 msgr2=0x7f53e8101390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53e5d9b640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e810c110 0x7f53e8101390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53e5d9b640 1 -- 172.21.15.59:0/3567748166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e81a6820 con 0x7f53e81035e0 2024-09-10T11:04:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e810c110 0x7f53e8101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:04:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53e5d9b640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e81035e0 0x7f53e8100e50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00d740 tx=0x7f53dc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53d77fe640 1 -- 172.21.15.59:0/3567748166 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc017070 con 0x7f53e81035e0 2024-09-10T11:04:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53d77fe640 1 -- 172.21.15.59:0/3567748166 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53dc00de50 con 0x7f53e81035e0 2024-09-10T11:04:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53ecf42640 1 -- 172.21.15.59:0/3567748166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e81a6b10 con 0x7f53e81035e0 2024-09-10T11:04:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53d77fe640 1 -- 172.21.15.59:0/3567748166 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00f620 con 0x7f53e81035e0 2024-09-10T11:04:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.716+0000 7f53ecf42640 1 -- 172.21.15.59:0/3567748166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e81a7060 con 0x7f53e81035e0 2024-09-10T11:04:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.718+0000 7f53d77fe640 1 -- 172.21.15.59:0/3567748166 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f53dc009c30 con 0x7f53e81035e0 2024-09-10T11:04:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53efcdc740 1 Processor -- start 2024-09-10T11:04:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53efcdc740 1 -- start start 2024-09-10T11:04:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6baf0 0x55d767b6bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6c410 0x55d767b76770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b76cb0 0x55d767b790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53efcdc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d767ad02f0 con 0x55d767b6baf0 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53efcdc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d767a78270 con 0x55d767b6c410 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53efcdc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d767acc2b0 con 0x55d767b76cb0 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53d77fe640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53d00a2da0 0x7f53d00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6baf0 0x55d767b6bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6baf0 0x55d767b6bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48712/0 (socket says 172.21.15.59:48712) 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.719+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3098244524 learned_addr learned my addr 172.21.15.59:0/3098244524 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e5d9b640 1 --2- 172.21.15.59:0/3098244524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b76cb0 0x55d767b790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e659c640 1 --2- 172.21.15.59:0/3098244524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6c410 0x55d767b76770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53d00a2da0 0x7f53d00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53d77fe640 1 -- 172.21.15.59:0/3567748166 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f53dc0cefe0 con 0x7f53e81035e0 2024-09-10T11:04:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3098244524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b76cb0 msgr2=0x55d767b790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3098244524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b76cb0 0x55d767b790a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3098244524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6c410 msgr2=0x55d767b76770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3098244524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6c410 0x55d767b76770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3098244524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d767a77340 con 0x55d767b6baf0 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3098244524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6baf0 0x55d767b6bed0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f53e0004af0 tx=0x7f53e002fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a560e431e2ca01a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53d4ff9640 1 -- 172.21.15.59:0/3098244524 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0034070 con 0x55d767b6baf0 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53d4ff9640 1 -- 172.21.15.59:0/3098244524 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e004d070 con 0x55d767b6baf0 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53d00a2da0 0x7f53d00a5260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53e004c000 tx=0x7f53e004a000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.720+0000 7f53d4ff9640 1 -- 172.21.15.59:0/3098244524 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e00487b0 con 0x55d767b6baf0 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.721+0000 7f53efcdc740 1 -- 172.21.15.59:0/3098244524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6baf0 msgr2=0x55d767b6bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.721+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3098244524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6baf0 0x55d767b6bed0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f53e0004af0 tx=0x7f53e002fd10 comp rx=0 tx=0).stop 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.721+0000 7f53efcdc740 1 -- 172.21.15.59:0/3098244524 shutdown_connections 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.721+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3098244524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b76cb0 0x55d767b790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.721+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3098244524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6c410 0x55d767b76770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.721+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3098244524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6baf0 0x55d767b6bed0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.721+0000 7f53efcdc740 1 -- 172.21.15.59:0/3098244524 >> 172.21.15.59:0/3098244524 conn(0x55d767b68060 msgr2=0x55d767b68440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.721+0000 7f53efcdc740 1 -- 172.21.15.59:0/3098244524 shutdown_connections 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.721+0000 7f53efcdc740 1 -- 172.21.15.59:0/3098244524 wait complete. 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53efcdc740 1 -- start start 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53efcdc740 1 Processor -- start 2024-09-10T11:04:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 0x55d767b73bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 0x55d767b74100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b74640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53efcdc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d767b79880 con 0x55d767b76cb0 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53efcdc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d767a59290 con 0x55d767b6baf0 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53efcdc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d767b79a00 con 0x55d767b6c410 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53efcdc740 10 client.0 _ll_register_callbacks cb 0x55d767a8a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b74640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b74640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48720/0 (socket says 172.21.15.59:48720) 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3235785628 learned_addr learned my addr 172.21.15.59:0/3235785628 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53e659c640 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 0x55d767b73bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.722+0000 7f53e5d9b640 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 0x55d767b74100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3235785628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 msgr2=0x55d767b74100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 0x55d767b74100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3235785628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 msgr2=0x55d767b73bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 0x55d767b73bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3235785628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7677e3210 con 0x55d767b76cb0 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53e659c640 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 0x55d767b73bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b74640 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f53e002a990 tx=0x7f53e002f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48d42a879f6103 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53cdffb640 1 -- 172.21.15.59:0/3235785628 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0058030 con 0x55d767b76cb0 2024-09-10T11:04:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53cdffb640 1 -- 172.21.15.59:0/3235785628 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f53e0048c80 con 0x55d767b76cb0 2024-09-10T11:04:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53efcdc740 1 -- 172.21.15.59:0/3235785628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53e004d070 con 0x55d767b76cb0 2024-09-10T11:04:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53cdffb640 1 -- 172.21.15.59:0/3235785628 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f53e0034050 con 0x55d767b76cb0 2024-09-10T11:04:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53efcdc740 10 client.15453 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53efcdc740 1 -- 172.21.15.59:0/3235785628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d7678af620 con 0x55d767b76cb0 2024-09-10T11:04:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.723+0000 7f53cdffb640 1 -- 172.21.15.59:0/3235785628 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e004d070 con 0x55d767b76cb0 2024-09-10T11:04:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53cdffb640 1 -- 172.21.15.59:0/3235785628 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f53e00304d0 con 0x55d767b76cb0 2024-09-10T11:04:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53efcdc740 10 client.15453 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53efcdc740 10 client.15453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53efcdc740 20 client.15453 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d767b86ab0 0x55d767b88ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53efcdc740 4 client.15453 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53efcdc740 1 -- 172.21.15.59:0/3235785628 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d767adda20 con 0x55d767b86ab0 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53e659c640 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d767b86ab0 0x55d767b88ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53cdffb640 10 client.15453 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.724+0000 7f53e659c640 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d767b86ab0 0x55d767b88ea0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dda5689eb65d0ece server_cookie=d6f0889fb774cb37 in_seq=0 out_seq=0 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53cdffb640 1 -- 172.21.15.59:0/3235785628 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d767adda20 con 0x55d767b86ab0 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53cdffb640 10 client.15453 handle_command_reply: tid=0 2024-09-10T11:04:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 client.15453 shutdown 2024-09-10T11:04:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 -- 172.21.15.59:0/3235785628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 msgr2=0x55d767b74640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b74640 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f53e002a990 tx=0x7f53e002f420 comp rx=0 tx=0).stop 2024-09-10T11:04:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 -- 172.21.15.59:0/3235785628 shutdown_connections 2024-09-10T11:04:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d767b86ab0 0x55d767b88ea0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b74640 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 0x55d767b74100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3235785628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 0x55d767b73bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53cdffb640 0 client.15453 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:03.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 -- 172.21.15.59:0/3235785628 >> 172.21.15.59:0/3235785628 conn(0x55d767b68060 msgr2=0x55d767b6ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 -- 172.21.15.59:0/3235785628 shutdown_connections 2024-09-10T11:04:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.725+0000 7f53efcdc740 1 -- 172.21.15.59:0/3235785628 wait complete. 2024-09-10T11:04:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.726+0000 7f53efcdc740 20 client.15453 trim_cache size 0 max 16384 2024-09-10T11:04:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53efcdc740 1 Processor -- start 2024-09-10T11:04:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53efcdc740 1 -- start start 2024-09-10T11:04:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 0x55d767b75ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 0x55d767b74470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b70e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53efcdc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53e81b2380 con 0x55d767b76cb0 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53efcdc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f53e81afc50 con 0x55d767b6baf0 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53efcdc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f53e81adaa0 con 0x55d767b6c410 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b70e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b70e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48726/0 (socket says 172.21.15.59:48726) 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3194998880 learned_addr learned my addr 172.21.15.59:0/3194998880 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53e659c640 1 --2- 172.21.15.59:0/3194998880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 0x55d767b75ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.740+0000 7f53e5d9b640 1 --2- 172.21.15.59:0/3194998880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 0x55d767b74470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3194998880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 msgr2=0x55d767b74470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3194998880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 0x55d767b74470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3194998880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 msgr2=0x55d767b75ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3194998880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 0x55d767b75ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53e6d9d640 1 -- 172.21.15.59:0/3194998880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d767b69110 con 0x55d767b76cb0 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3194998880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b70e00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f53e0002230 tx=0x7f53e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450ce8b290cfe886 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53cffff640 1 -- 172.21.15.59:0/3194998880 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0069070 con 0x55d767b76cb0 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53cffff640 1 -- 172.21.15.59:0/3194998880 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e004d040 con 0x55d767b76cb0 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53cffff640 1 -- 172.21.15.59:0/3194998880 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0058070 con 0x55d767b76cb0 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53efcdc740 1 -- 172.21.15.59:0/3194998880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 msgr2=0x55d767b70e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.741+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3194998880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b70e00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f53e0002230 tx=0x7f53e0004a40 comp rx=0 tx=0).stop 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 -- 172.21.15.59:0/3194998880 shutdown_connections 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3194998880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b76cb0 0x55d767b70e00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3194998880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6c410 0x55d767b74470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3194998880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b6baf0 0x55d767b75ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 -- 172.21.15.59:0/3194998880 >> 172.21.15.59:0/3194998880 conn(0x55d767b68060 msgr2=0x55d767b671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 -- 172.21.15.59:0/3194998880 shutdown_connections 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 -- 172.21.15.59:0/3194998880 wait complete. 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 -- start start 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 Processor -- start 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6baf0 0x55d767b8c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6c410 0x55d767b89900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b76cb0 0x55d767b89e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53e81ae110 con 0x55d767b6c410 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f53e81af580 con 0x55d767b76cb0 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f53e81ae7e0 con 0x55d767b6baf0 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53efcdc740 10 client.0 _ll_register_callbacks cb 0x7f53d800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53e5d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6c410 0x55d767b89900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53e5d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6c410 0x55d767b89900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48742/0 (socket says 172.21.15.59:48742) 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53e5d9b640 1 -- 172.21.15.59:0/3867812337 learned_addr learned my addr 172.21.15.59:0/3867812337 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.742+0000 7f53e659c640 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6baf0 0x55d767b8c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53e5d9b640 1 -- 172.21.15.59:0/3867812337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6baf0 msgr2=0x55d767b8c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53e6d9d640 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b76cb0 0x55d767b89e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53e5d9b640 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6baf0 0x55d767b8c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53e5d9b640 1 -- 172.21.15.59:0/3867812337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b76cb0 msgr2=0x55d767b89e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53e5d9b640 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b76cb0 0x55d767b89e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53e5d9b640 1 -- 172.21.15.59:0/3867812337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d767b632d0 con 0x55d767b6c410 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53e5d9b640 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6c410 0x55d767b89900 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f53dc09b450 tx=0x7f53dc06a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52ff6384ade8ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53cdffb640 1 -- 172.21.15.59:0/3867812337 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc020040 con 0x55d767b6c410 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53cdffb640 1 -- 172.21.15.59:0/3867812337 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f53dc0cc970 con 0x55d767b6c410 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53efcdc740 1 -- 172.21.15.59:0/3867812337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53e004d040 con 0x55d767b6c410 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53cdffb640 1 -- 172.21.15.59:0/3867812337 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f53dc0ccb70 con 0x55d767b6c410 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53efcdc740 10 client.15459 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53efcdc740 1 -- 172.21.15.59:0/3867812337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d767bf1250 con 0x55d767b6c410 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.743+0000 7f53cdffb640 1 -- 172.21.15.59:0/3867812337 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e004d040 con 0x55d767b6c410 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53cdffb640 1 -- 172.21.15.59:0/3867812337 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f53dc0a3ca0 con 0x55d767b6c410 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53efcdc740 10 client.15459 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53efcdc740 10 client.15459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53efcdc740 20 client.15459 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d767bf1aa0 0x55d767bf3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53efcdc740 4 client.15459 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:04:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53efcdc740 1 -- 172.21.15.59:0/3867812337 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d767ad7d70 con 0x55d767bf1aa0 2024-09-10T11:04:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53e659c640 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d767bf1aa0 0x55d767bf3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53cdffb640 10 client.15459 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.744+0000 7f53e659c640 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d767bf1aa0 0x55d767bf3ec0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3f7543bb59c2533 server_cookie=c5eb9b96c6bc5882 in_seq=0 out_seq=0 2024-09-10T11:04:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53cdffb640 1 -- 172.21.15.59:0/3867812337 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d767ad7d70 con 0x55d767bf1aa0 2024-09-10T11:04:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53cdffb640 10 client.15459 handle_command_reply: tid=0 2024-09-10T11:04:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 client.15459 shutdown 2024-09-10T11:04:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 -- 172.21.15.59:0/3867812337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6c410 msgr2=0x55d767b89900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6c410 0x55d767b89900 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f53dc09b450 tx=0x7f53dc06a3f0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 -- 172.21.15.59:0/3867812337 shutdown_connections 2024-09-10T11:04:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d767bf1aa0 0x55d767bf3ec0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d767b76cb0 0x55d767b89e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d767b6c410 0x55d767b89900 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 --2- 172.21.15.59:0/3867812337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d767b6baf0 0x55d767b8c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53cdffb640 0 client.15459 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 -- 172.21.15.59:0/3867812337 >> 172.21.15.59:0/3867812337 conn(0x55d767b68060 msgr2=0x55d767b669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 -- 172.21.15.59:0/3867812337 shutdown_connections 2024-09-10T11:04:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 1 -- 172.21.15.59:0/3867812337 wait complete. 2024-09-10T11:04:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.759+0000 7f53efcdc740 20 client.15459 trim_cache size 0 max 16384 2024-09-10T11:04:03.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:04:03.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:04:03.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:04:03.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 -- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53d00a2da0 msgr2=0x7f53d00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53d00a2da0 0x7f53d00a5260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53e004c000 tx=0x7f53e004a000 comp rx=0 tx=0).stop 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 -- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e81035e0 msgr2=0x7f53e8100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e81035e0 0x7f53e8100e50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00d740 tx=0x7f53dc00dc00 comp rx=0 tx=0).stop 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 -- 172.21.15.59:0/3567748166 shutdown_connections 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e810c110 0x7f53e8101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53e81035e0 0x7f53e8100e50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53d00a2da0 0x7f53d00a5260 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 --2- 172.21.15.59:0/3567748166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53e8102cc0 0x7f53e8100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 -- 172.21.15.59:0/3567748166 >> 172.21.15.59:0/3567748166 conn(0x7f53e80fc6b0 msgr2=0x7f53e80fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 -- 172.21.15.59:0/3567748166 shutdown_connections 2024-09-10T11:04:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:03.760+0000 7f53ecf42640 1 -- 172.21.15.59:0/3567748166 wait complete. 2024-09-10T11:04:03.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:03 smithi059 ceph-mon[30978]: pgmap v83: 97 pgs: 97 active+clean; 3.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:04:03.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:03 smithi181 ceph-mon[35409]: pgmap v83: 97 pgs: 97 active+clean; 3.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:04:03.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:03 smithi115 ceph-mon[34719]: pgmap v83: 97 pgs: 97 active+clean; 3.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-10T11:04:05.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:05 smithi059 ceph-mon[30978]: pgmap v84: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-10T11:04:05.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:05 smithi181 ceph-mon[35409]: pgmap v84: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-10T11:04:05.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:05 smithi115 ceph-mon[34719]: pgmap v84: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-10T11:04:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:07 smithi059 ceph-mon[30978]: pgmap v85: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-09-10T11:04:07.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:07 smithi181 ceph-mon[35409]: pgmap v85: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-09-10T11:04:07.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:07 smithi115 ceph-mon[34719]: pgmap v85: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 41 KiB/s wr, 24 op/s 2024-09-10T11:04:09.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:09 smithi059 ceph-mon[30978]: pgmap v86: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 KiB/s wr, 32 op/s 2024-09-10T11:04:09.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:09 smithi181 ceph-mon[35409]: pgmap v86: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 KiB/s wr, 32 op/s 2024-09-10T11:04:09.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:09 smithi115 ceph-mon[34719]: pgmap v86: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 KiB/s wr, 32 op/s 2024-09-10T11:04:11.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:11 smithi059 ceph-mon[30978]: pgmap v87: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-10T11:04:11.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:11 smithi181 ceph-mon[35409]: pgmap v87: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-10T11:04:11.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:11 smithi115 ceph-mon[34719]: pgmap v87: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-10T11:04:13.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:13 smithi059 ceph-mon[30978]: pgmap v88: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-10T11:04:13.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:13 smithi181 ceph-mon[35409]: pgmap v88: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-10T11:04:13.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:13 smithi115 ceph-mon[34719]: pgmap v88: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-10T11:04:15.893 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:15 smithi059 ceph-mon[30978]: pgmap v89: 97 pgs: 97 active+clean; 3.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 59 KiB/s wr, 32 op/s 2024-09-10T11:04:15.950 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:15 smithi181 ceph-mon[35409]: pgmap v89: 97 pgs: 97 active+clean; 3.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 59 KiB/s wr, 32 op/s 2024-09-10T11:04:15.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:15 smithi115 ceph-mon[34719]: pgmap v89: 97 pgs: 97 active+clean; 3.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 59 KiB/s wr, 32 op/s 2024-09-10T11:04:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.861+0000 7facac742640 1 -- 172.21.15.59:0/3947472608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 msgr2=0x7faca41030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.861+0000 7facac742640 1 --2- 172.21.15.59:0/3947472608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 0x7faca41030a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7faca0009900 tx=0x7faca002a480 comp rx=0 tx=0).stop 2024-09-10T11:04:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.861+0000 7facac742640 1 -- 172.21.15.59:0/3947472608 shutdown_connections 2024-09-10T11:04:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.861+0000 7facac742640 1 --2- 172.21.15.59:0/3947472608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca410c110 0x7faca410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.861+0000 7facac742640 1 --2- 172.21.15.59:0/3947472608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca41035e0 0x7faca410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.861+0000 7facac742640 1 --2- 172.21.15.59:0/3947472608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 0x7faca41030a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.861+0000 7facac742640 1 -- 172.21.15.59:0/3947472608 >> 172.21.15.59:0/3947472608 conn(0x7faca40fc6b0 msgr2=0x7faca40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.861+0000 7facac742640 1 -- 172.21.15.59:0/3947472608 shutdown_connections 2024-09-10T11:04:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.861+0000 7facac742640 1 -- 172.21.15.59:0/3947472608 wait complete. 2024-09-10T11:04:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facac742640 1 Processor -- start 2024-09-10T11:04:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facac742640 1 -- start start 2024-09-10T11:04:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facac742640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 0x7faca4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facac742640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca41035e0 0x7faca41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facac742640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca410c110 0x7faca419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facac742640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faca4111ef0 con 0x7faca4102cc0 2024-09-10T11:04:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facac742640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faca4111d70 con 0x7faca410c110 2024-09-10T11:04:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facac742640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faca4112070 con 0x7faca41035e0 2024-09-10T11:04:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facaa4de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 0x7faca4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facaa4de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 0x7faca4198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60752/0 (socket says 172.21.15.59:60752) 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facaa4de640 1 -- 172.21.15.59:0/848256353 learned_addr learned my addr 172.21.15.59:0/848256353 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7faca9cdd640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca41035e0 0x7faca41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facaacdf640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca410c110 0x7faca419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facaa4de640 1 -- 172.21.15.59:0/848256353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca41035e0 msgr2=0x7faca41988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facaa4de640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca41035e0 0x7faca41988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facaa4de640 1 -- 172.21.15.59:0/848256353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca410c110 msgr2=0x7faca419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.862+0000 7facaa4de640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca410c110 0x7faca419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.863+0000 7facaa4de640 1 -- 172.21.15.59:0/848256353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca419d350 con 0x7faca4102cc0 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.863+0000 7facaa4de640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 0x7faca4198360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7faca0006010 tx=0x7faca00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.863+0000 7fac977fe640 1 -- 172.21.15.59:0/848256353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca003f030 con 0x7faca4102cc0 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.863+0000 7fac977fe640 1 -- 172.21.15.59:0/848256353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca0003ce0 con 0x7faca4102cc0 2024-09-10T11:04:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.863+0000 7facac742640 1 -- 172.21.15.59:0/848256353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca419d5e0 con 0x7faca4102cc0 2024-09-10T11:04:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.863+0000 7fac977fe640 1 -- 172.21.15.59:0/848256353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0035070 con 0x7faca4102cc0 2024-09-10T11:04:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.863+0000 7facac742640 1 -- 172.21.15.59:0/848256353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca41a4ed0 con 0x7faca4102cc0 2024-09-10T11:04:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7fac977fe640 1 -- 172.21.15.59:0/848256353 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7faca0042030 con 0x7faca4102cc0 2024-09-10T11:04:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7facaf4db740 1 Processor -- start 2024-09-10T11:04:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7facaf4db740 1 -- start start 2024-09-10T11:04:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7facaf4db740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acf3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7facaf4db740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7facaf4db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad010a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7facaf4db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c28ac582f0 con 0x55c28acfecb0 2024-09-10T11:04:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7facaf4db740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c28ac00270 con 0x55c28acf4410 2024-09-10T11:04:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7facaf4db740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c28ac542b0 con 0x55c28acf3af0 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.866+0000 7faca9cdd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7faca9cdd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60766/0 (socket says 172.21.15.59:60766) 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7faca9cdd640 1 -- 172.21.15.59:0/967757540 learned_addr learned my addr 172.21.15.59:0/967757540 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7facaacdf640 1 --2- 172.21.15.59:0/967757540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acf3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7facaa4de640 1 --2- 172.21.15.59:0/967757540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7fac977fe640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fac900a2da0 0x7fac900a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7faca9cdd640 1 -- 172.21.15.59:0/967757540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 msgr2=0x55c28acf3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7faca9cdd640 1 --2- 172.21.15.59:0/967757540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acf3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7faca9cdd640 1 -- 172.21.15.59:0/967757540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 msgr2=0x55c28acfe770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7faca9cdd640 1 --2- 172.21.15.59:0/967757540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfe770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7faca9cdd640 1 -- 172.21.15.59:0/967757540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28abff340 con 0x55c28acfecb0 2024-09-10T11:04:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7facaacdf640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fac900a2da0 0x7fac900a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7fac977fe640 1 -- 172.21.15.59:0/848256353 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7faca00efb00 con 0x7faca4102cc0 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7faca9cdd640 1 --2- 172.21.15.59:0/967757540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad010a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fac98009c10 tx=0x7fac980117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2f8e62079f10ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7fac94ff9640 1 -- 172.21.15.59:0/967757540 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98012450 con 0x55c28acfecb0 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7fac94ff9640 1 -- 172.21.15.59:0/967757540 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac98012ad0 con 0x55c28acfecb0 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.867+0000 7fac94ff9640 1 -- 172.21.15.59:0/967757540 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9800fbf0 con 0x55c28acfecb0 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaf4db740 1 -- 172.21.15.59:0/967757540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 msgr2=0x55c28ad010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaacdf640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fac900a2da0 0x7fac900a5260 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fac9c005fd0 tx=0x7fac9c004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaf4db740 1 --2- 172.21.15.59:0/967757540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad010a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fac98009c10 tx=0x7fac980117b0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaf4db740 1 -- 172.21.15.59:0/967757540 shutdown_connections 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaf4db740 1 --2- 172.21.15.59:0/967757540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad010a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaf4db740 1 --2- 172.21.15.59:0/967757540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfe770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaf4db740 1 --2- 172.21.15.59:0/967757540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acf3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaf4db740 1 -- 172.21.15.59:0/967757540 >> 172.21.15.59:0/967757540 conn(0x55c28acf0060 msgr2=0x55c28acf0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaf4db740 1 -- 172.21.15.59:0/967757540 shutdown_connections 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.868+0000 7facaf4db740 1 -- 172.21.15.59:0/967757540 wait complete. 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaf4db740 1 -- start start 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaf4db740 1 Processor -- start 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaf4db740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acfbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaf4db740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaf4db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28acfc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaf4db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c28ad01880 con 0x55c28acfecb0 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaf4db740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c28abe1290 con 0x55c28acf4410 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaf4db740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c28ad01a00 con 0x55c28acf3af0 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaf4db740 10 client.0 _ll_register_callbacks cb 0x55c28ac12140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaacdf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28acfc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7faca9cdd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaacdf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28acfc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60768/0 (socket says 172.21.15.59:60768) 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaacdf640 1 -- 172.21.15.59:0/659625621 learned_addr learned my addr 172.21.15.59:0/659625621 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaa4de640 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acfbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaacdf640 1 -- 172.21.15.59:0/659625621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 msgr2=0x55c28acfbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaacdf640 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acfbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaacdf640 1 -- 172.21.15.59:0/659625621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 msgr2=0x55c28acfc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaacdf640 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.869+0000 7facaacdf640 1 -- 172.21.15.59:0/659625621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28a96b210 con 0x55c28acfecb0 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7facaacdf640 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28acfc560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fac9c012910 tx=0x7fac9c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60012c8b5a23abe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7fac8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7fac8dffb640 1 -- 172.21.15.59:0/659625621 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c023070 con 0x55c28acfecb0 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7fac8dffb640 1 -- 172.21.15.59:0/659625621 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fac9c011d70 con 0x55c28acfecb0 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7facaf4db740 1 -- 172.21.15.59:0/659625621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac98012ad0 con 0x55c28acfecb0 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7fac8dffb640 1 -- 172.21.15.59:0/659625621 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac9c01f420 con 0x55c28acfecb0 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7facaf4db740 10 client.15471 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7facaf4db740 1 -- 172.21.15.59:0/659625621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c28aa37620 con 0x55c28acfecb0 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7fac8dffb640 1 -- 172.21.15.59:0/659625621 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac98012ad0 con 0x55c28acfecb0 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.870+0000 7fac8dffb640 1 -- 172.21.15.59:0/659625621 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fac9c00f040 con 0x55c28acfecb0 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.871+0000 7facaf4db740 10 client.15471 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.871+0000 7facaf4db740 10 client.15471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.871+0000 7facaf4db740 20 client.15471 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.871+0000 7facaf4db740 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c28ad0eb50 0x55c28ad10f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.871+0000 7facaf4db740 4 client.15471 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:04:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.871+0000 7facaf4db740 1 -- 172.21.15.59:0/659625621 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c28ac65a20 con 0x55c28ad0eb50 2024-09-10T11:04:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.871+0000 7facaa4de640 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c28ad0eb50 0x55c28ad10f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.871+0000 7fac8dffb640 10 client.15471 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.871+0000 7facaa4de640 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c28ad0eb50 0x55c28ad10f80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5f56bbccf15f588 server_cookie=b2f8979c7173ad82 in_seq=0 out_seq=0 2024-09-10T11:04:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7fac8dffb640 1 -- 172.21.15.59:0/659625621 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c28ac65a20 con 0x55c28ad0eb50 2024-09-10T11:04:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7fac8dffb640 10 client.15471 handle_command_reply: tid=0 2024-09-10T11:04:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 client.15471 shutdown 2024-09-10T11:04:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 -- 172.21.15.59:0/659625621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 msgr2=0x55c28acfc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28acfc560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fac9c012910 tx=0x7fac9c004ab0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 -- 172.21.15.59:0/659625621 shutdown_connections 2024-09-10T11:04:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c28ad0eb50 0x55c28ad10f80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28acfc560 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7fac8dffb640 0 client.15471 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 --2- 172.21.15.59:0/659625621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acfbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 -- 172.21.15.59:0/659625621 >> 172.21.15.59:0/659625621 conn(0x55c28acf0060 msgr2=0x55c28acf5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 -- 172.21.15.59:0/659625621 shutdown_connections 2024-09-10T11:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 1 -- 172.21.15.59:0/659625621 wait complete. 2024-09-10T11:04:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.872+0000 7facaf4db740 20 client.15471 trim_cache size 0 max 16384 2024-09-10T11:04:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaf4db740 1 Processor -- start 2024-09-10T11:04:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaf4db740 1 -- start start 2024-09-10T11:04:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaf4db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acf3af0 0x55c28acfa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaf4db740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaf4db740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acfecb0 0x55c28ad168e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaf4db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faca41b01c0 con 0x55c28acf3af0 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaf4db740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faca41ada90 con 0x55c28acf4410 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaf4db740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faca41ab8e0 con 0x55c28acfecb0 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaa4de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acf3af0 0x55c28acfa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaa4de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acf3af0 0x55c28acfa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60772/0 (socket says 172.21.15.59:60772) 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.887+0000 7facaa4de640 1 -- 172.21.15.59:0/2326489244 learned_addr learned my addr 172.21.15.59:0/2326489244 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7facaacdf640 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acfecb0 0x55c28ad168e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7faca9cdd640 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7facaa4de640 1 -- 172.21.15.59:0/2326489244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acfecb0 msgr2=0x55c28ad168e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7facaa4de640 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acfecb0 0x55c28ad168e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7facaa4de640 1 -- 172.21.15.59:0/2326489244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 msgr2=0x55c28acfc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7facaa4de640 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7facaa4de640 1 -- 172.21.15.59:0/2326489244 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28acefe90 con 0x55c28acf3af0 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7faca9cdd640 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7facaa4de640 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acf3af0 0x55c28acfa390 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faca00ed830 tx=0x7faca003b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c55467853d1d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7fac8ffff640 1 -- 172.21.15.59:0/2326489244 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0049040 con 0x55c28acf3af0 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7fac8ffff640 1 -- 172.21.15.59:0/2326489244 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca00bc7c0 con 0x55c28acf3af0 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.888+0000 7fac8ffff640 1 -- 172.21.15.59:0/2326489244 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca00bc0c0 con 0x55c28acf3af0 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 -- 172.21.15.59:0/2326489244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acf3af0 msgr2=0x55c28acfa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acf3af0 0x55c28acfa390 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faca00ed830 tx=0x7faca003b5d0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 -- 172.21.15.59:0/2326489244 shutdown_connections 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acfecb0 0x55c28ad168e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28acfc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 --2- 172.21.15.59:0/2326489244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acf3af0 0x55c28acfa390 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 -- 172.21.15.59:0/2326489244 >> 172.21.15.59:0/2326489244 conn(0x55c28acf0060 msgr2=0x55c28acfdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 -- 172.21.15.59:0/2326489244 shutdown_connections 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 -- 172.21.15.59:0/2326489244 wait complete. 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 -- start start 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 Processor -- start 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28ad00350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad00890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faca41abf50 con 0x55c28acfecb0 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faca41ad3c0 con 0x55c28acf4410 2024-09-10T11:04:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faca41ac620 con 0x55c28acf3af0 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaf4db740 10 client.0 _ll_register_callbacks cb 0x7fac9c009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.889+0000 7facaacdf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad00890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaacdf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad00890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60774/0 (socket says 172.21.15.59:60774) 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaacdf640 1 -- 172.21.15.59:0/2758847836 learned_addr learned my addr 172.21.15.59:0/2758847836 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaa4de640 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7faca9cdd640 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28ad00350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaacdf640 1 -- 172.21.15.59:0/2758847836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 msgr2=0x55c28acffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaacdf640 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acffe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaacdf640 1 -- 172.21.15.59:0/2758847836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 msgr2=0x55c28ad00350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaacdf640 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28ad00350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaacdf640 1 -- 172.21.15.59:0/2758847836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28acf0cf0 con 0x55c28acfecb0 2024-09-10T11:04:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaacdf640 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad00890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fac9c01d780 tx=0x7fac9c009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db31b36a4b30cd9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7fac8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7fac8dffb640 1 -- 172.21.15.59:0/2758847836 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c023050 con 0x55c28acfecb0 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7fac8dffb640 1 -- 172.21.15.59:0/2758847836 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fac9c01d970 con 0x55c28acfecb0 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaf4db740 1 -- 172.21.15.59:0/2758847836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca00bc7c0 con 0x55c28acfecb0 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7fac8dffb640 1 -- 172.21.15.59:0/2758847836 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac9c0124d0 con 0x55c28acfecb0 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaf4db740 10 client.15477 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.890+0000 7facaf4db740 1 -- 172.21.15.59:0/2758847836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c28ad79970 con 0x55c28acfecb0 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7fac8dffb640 1 -- 172.21.15.59:0/2758847836 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca00bc7c0 con 0x55c28acfecb0 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7fac8dffb640 1 -- 172.21.15.59:0/2758847836 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fac9c028440 con 0x55c28acfecb0 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7facaf4db740 10 client.15477 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7facaf4db740 10 client.15477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7facaf4db740 20 client.15477 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7facaf4db740 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c28ad7a0b0 0x55c28ad7c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7facaf4db740 4 client.15477 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:04:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7facaf4db740 1 -- 172.21.15.59:0/2758847836 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c28ac5fd70 con 0x55c28ad7a0b0 2024-09-10T11:04:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7facaa4de640 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c28ad7a0b0 0x55c28ad7c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7facaa4de640 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c28ad7a0b0 0x55c28ad7c4d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f851afcc149605d1 server_cookie=d58f1fd578acdfc3 in_seq=0 out_seq=0 2024-09-10T11:04:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.891+0000 7fac8dffb640 10 client.15477 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7fac8dffb640 1 -- 172.21.15.59:0/2758847836 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c28ac5fd70 con 0x55c28ad7a0b0 2024-09-10T11:04:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7fac8dffb640 10 client.15477 handle_command_reply: tid=0 2024-09-10T11:04:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 client.15477 shutdown 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 -- 172.21.15.59:0/2758847836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 msgr2=0x55c28ad00890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad00890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fac9c01d780 tx=0x7fac9c009dd0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 -- 172.21.15.59:0/2758847836 shutdown_connections 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c28ad7a0b0 0x55c28ad7c4d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c28acfecb0 0x55c28ad00890 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c28acf4410 0x55c28ad00350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 --2- 172.21.15.59:0/2758847836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c28acf3af0 0x55c28acffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7fac8dffb640 0 client.15477 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 -- 172.21.15.59:0/2758847836 >> 172.21.15.59:0/2758847836 conn(0x55c28acf0060 msgr2=0x55c28acee9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 -- 172.21.15.59:0/2758847836 shutdown_connections 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.905+0000 7facaf4db740 1 -- 172.21.15.59:0/2758847836 wait complete. 2024-09-10T11:04:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facaf4db740 20 client.15477 trim_cache size 0 max 16384 2024-09-10T11:04:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:04:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:04:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:04:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:04:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 -- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fac900a2da0 msgr2=0x7fac900a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fac900a2da0 0x7fac900a5260 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fac9c005fd0 tx=0x7fac9c004a40 comp rx=0 tx=0).stop 2024-09-10T11:04:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 -- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 msgr2=0x7faca4198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 0x7faca4198360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7faca0006010 tx=0x7faca00042f0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 -- 172.21.15.59:0/848256353 shutdown_connections 2024-09-10T11:04:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca410c110 0x7faca419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fac900a2da0 0x7fac900a5260 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faca41035e0 0x7faca41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 --2- 172.21.15.59:0/848256353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4102cc0 0x7faca4198360 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 -- 172.21.15.59:0/848256353 >> 172.21.15.59:0/848256353 conn(0x7faca40fc6b0 msgr2=0x7faca40fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 -- 172.21.15.59:0/848256353 shutdown_connections 2024-09-10T11:04:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:16.906+0000 7facac742640 1 -- 172.21.15.59:0/848256353 wait complete. 2024-09-10T11:04:17.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:17 smithi059 ceph-mon[30978]: pgmap v90: 97 pgs: 97 active+clean; 3.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:17.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:17 smithi181 ceph-mon[35409]: pgmap v90: 97 pgs: 97 active+clean; 3.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:17.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:17 smithi115 ceph-mon[34719]: pgmap v90: 97 pgs: 97 active+clean; 3.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:19.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:19 smithi181 ceph-mon[35409]: pgmap v91: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-10T11:04:19.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:19 smithi115 ceph-mon[34719]: pgmap v91: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-10T11:04:20.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:19 smithi059 ceph-mon[30978]: pgmap v91: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-10T11:04:21.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:21 smithi181 ceph-mon[35409]: pgmap v92: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:21.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:21 smithi115 ceph-mon[34719]: pgmap v92: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:21 smithi059 ceph-mon[30978]: pgmap v92: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:23.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:23 smithi181 ceph-mon[35409]: pgmap v93: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:23.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:23 smithi115 ceph-mon[34719]: pgmap v93: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:23 smithi059 ceph-mon[30978]: pgmap v93: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:25.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:25 smithi181 ceph-mon[35409]: pgmap v94: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:04:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:25 smithi115 ceph-mon[34719]: pgmap v94: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:04:26.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:25 smithi059 ceph-mon[30978]: pgmap v94: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:04:27.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:27 smithi181 ceph-mon[35409]: pgmap v95: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:04:27.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:27 smithi115 ceph-mon[34719]: pgmap v95: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:04:28.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:27 smithi059 ceph-mon[30978]: pgmap v95: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:04:28.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:04:28.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:04:28.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:04:28.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:04:28.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:04:28.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:04:28.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:04:28.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:04:29.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:04:29.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:04:29.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:04:29.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:04:29.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:29 smithi181 ceph-mon[35409]: pgmap v96: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:04:29.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:29 smithi115 ceph-mon[34719]: pgmap v96: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:04:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 -- 172.21.15.59:0/3246578731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c102480 msgr2=0x7fbe8c10e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/3246578731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c102480 0x7fbe8c10e9b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009cd0 tx=0x7fbe8402a8e0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 -- 172.21.15.59:0/3246578731 shutdown_connections 2024-09-10T11:04:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/3246578731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c102480 0x7fbe8c10e9b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/3246578731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe8c101ae0 0x7fbe8c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/3246578731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c107b80 0x7fbe8c107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 -- 172.21.15.59:0/3246578731 >> 172.21.15.59:0/3246578731 conn(0x7fbe8c0fd7e0 msgr2=0x7fbe8c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 -- 172.21.15.59:0/3246578731 shutdown_connections 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 -- 172.21.15.59:0/3246578731 wait complete. 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.006+0000 7fbe91a5e640 1 Processor -- start 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe91a5e640 1 -- start start 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe91a5e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c101ae0 0x7fbe8c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe91a5e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe8c102480 0x7fbe8c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe91a5e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c107b80 0x7fbe8c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe91a5e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c111f30 con 0x7fbe8c101ae0 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe91a5e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c111db0 con 0x7fbe8c102480 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe91a5e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c1120b0 con 0x7fbe8c107b80 2024-09-10T11:04:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c101ae0 0x7fbe8c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c101ae0 0x7fbe8c1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58900/0 (socket says 172.21.15.59:58900) 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8affd640 1 -- 172.21.15.59:0/1722241403 learned_addr learned my addr 172.21.15.59:0/1722241403 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8a7fc640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe8c102480 0x7fbe8c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c107b80 0x7fbe8c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8affd640 1 -- 172.21.15.59:0/1722241403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c107b80 msgr2=0x7fbe8c19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8affd640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c107b80 0x7fbe8c19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8affd640 1 -- 172.21.15.59:0/1722241403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe8c102480 msgr2=0x7fbe8c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8affd640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe8c102480 0x7fbe8c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.007+0000 7fbe8affd640 1 -- 172.21.15.59:0/1722241403 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c19d2d0 con 0x7fbe8c101ae0 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.008+0000 7fbe8affd640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c101ae0 0x7fbe8c1982e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00d950 tx=0x7fbe7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.008+0000 7fbe90a5c640 1 -- 172.21.15.59:0/1722241403 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c017030 con 0x7fbe8c101ae0 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.008+0000 7fbe90a5c640 1 -- 172.21.15.59:0/1722241403 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe7c004020 con 0x7fbe8c101ae0 2024-09-10T11:04:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.008+0000 7fbe90a5c640 1 -- 172.21.15.59:0/1722241403 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0047a0 con 0x7fbe8c101ae0 2024-09-10T11:04:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.008+0000 7fbe91a5e640 1 -- 172.21.15.59:0/1722241403 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c19d5c0 con 0x7fbe8c101ae0 2024-09-10T11:04:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.008+0000 7fbe91a5e640 1 -- 172.21.15.59:0/1722241403 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c1a4e50 con 0x7fbe8c101ae0 2024-09-10T11:04:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.010+0000 7fbe90a5c640 1 -- 172.21.15.59:0/1722241403 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fbe7c0041d0 con 0x7fbe8c101ae0 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.010+0000 7fbe947f9740 1 Processor -- start 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.010+0000 7fbe947f9740 1 -- start start 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e319f0 0x5628d2e31dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 0x5628d2e40b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 0x5628d2e434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe947f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5628d2d962f0 con 0x5628d2e319f0 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe947f9740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5628d2d3e270 con 0x5628d2e410c0 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe947f9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5628d2d922b0 con 0x5628d2e32310 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e319f0 0x5628d2e31dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e319f0 0x5628d2e31dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58914/0 (socket says 172.21.15.59:58914) 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/3160994259 learned_addr learned my addr 172.21.15.59:0/3160994259 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe90a5c640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fbe740a2e20 0x7fbe740a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8affd640 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 0x5628d2e40b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8a7fc640 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 0x5628d2e434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fbe740a2e20 0x7fbe740a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe90a5c640 1 -- 172.21.15.59:0/1722241403 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fbe7c0ceda0 con 0x7fbe8c101ae0 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/3160994259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 msgr2=0x5628d2e40b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 0x5628d2e40b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/3160994259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 msgr2=0x5628d2e434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 0x5628d2e434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/3160994259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628d2d3d340 con 0x5628d2e319f0 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.011+0000 7fbe8affd640 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 0x5628d2e40b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.012+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e319f0 0x5628d2e31dd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbe84004af0 tx=0x7fbe840318c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464fd429aca5df37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.012+0000 7fbe71ffb640 1 -- 172.21.15.59:0/3160994259 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84031430 con 0x5628d2e319f0 2024-09-10T11:04:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.012+0000 7fbe71ffb640 1 -- 172.21.15.59:0/3160994259 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe84036040 con 0x5628d2e319f0 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.012+0000 7fbe71ffb640 1 -- 172.21.15.59:0/3160994259 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840305a0 con 0x5628d2e319f0 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.012+0000 7fbe947f9740 1 -- 172.21.15.59:0/3160994259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e319f0 msgr2=0x5628d2e31dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.012+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fbe740a2e20 0x7fbe740a52e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe8404d000 tx=0x7fbe8404b000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.012+0000 7fbe947f9740 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e319f0 0x5628d2e31dd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbe84004af0 tx=0x7fbe840318c0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 -- 172.21.15.59:0/3160994259 shutdown_connections 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 0x5628d2e434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 0x5628d2e40b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 --2- 172.21.15.59:0/3160994259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e319f0 0x5628d2e31dd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 -- 172.21.15.59:0/3160994259 >> 172.21.15.59:0/3160994259 conn(0x5628d2e2e060 msgr2=0x5628d2e2e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 -- 172.21.15.59:0/3160994259 shutdown_connections 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 -- 172.21.15.59:0/3160994259 wait complete. 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 -- start start 2024-09-10T11:04:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 Processor -- start 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 0x5628d2e3e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.013+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e32310 0x5628d2e3e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e3eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe947f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5628d2e43d20 con 0x5628d2e410c0 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe947f9740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5628d2d1f290 con 0x5628d2e32310 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe947f9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5628d2e43ea0 con 0x5628d2e319f0 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe947f9740 10 client.0 _ll_register_callbacks cb 0x5628d2d50140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e3eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e3eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58926/0 (socket says 172.21.15.59:58926) 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/2087981368 learned_addr learned my addr 172.21.15.59:0/2087981368 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8a7fc640 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e32310 0x5628d2e3e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8affd640 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 0x5628d2e3e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/2087981368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 msgr2=0x5628d2e3e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 0x5628d2e3e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/2087981368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e32310 msgr2=0x5628d2e3e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e32310 0x5628d2e3e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/2087981368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628d2aa9210 con 0x5628d2e410c0 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8affd640 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 0x5628d2e3e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8a7fc640 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e32310 0x5628d2e3e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e3eaf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbe8402a920 tx=0x7fbe840044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7375074dc292c539 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe6affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe6affd640 1 -- 172.21.15.59:0/2087981368 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84004b40 con 0x5628d2e410c0 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe6affd640 1 -- 172.21.15.59:0/2087981368 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fbe84004740 con 0x5628d2e410c0 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.014+0000 7fbe947f9740 1 -- 172.21.15.59:0/2087981368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe84036040 con 0x5628d2e410c0 2024-09-10T11:04:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe6affd640 1 -- 172.21.15.59:0/2087981368 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe84066050 con 0x5628d2e410c0 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe947f9740 10 client.15489 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe947f9740 1 -- 172.21.15.59:0/2087981368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5628d2b75620 con 0x5628d2e410c0 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe6affd640 1 -- 172.21.15.59:0/2087981368 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe84036040 con 0x5628d2e410c0 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe6affd640 1 -- 172.21.15.59:0/2087981368 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe84030070 con 0x5628d2e410c0 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe947f9740 10 client.15489 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe947f9740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe947f9740 20 client.15489 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe947f9740 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5628d2e51010 0x5628d2e53400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe947f9740 4 client.15489 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe947f9740 1 -- 172.21.15.59:0/2087981368 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628d2da3a20 con 0x5628d2e51010 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.015+0000 7fbe8affd640 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5628d2e51010 0x5628d2e53400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.016+0000 7fbe8affd640 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5628d2e51010 0x5628d2e53400 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc4270046a893b8 server_cookie=8648191935b16182 in_seq=0 out_seq=0 2024-09-10T11:04:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.016+0000 7fbe6affd640 10 client.15489 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.016+0000 7fbe6affd640 1 -- 172.21.15.59:0/2087981368 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628d2da3a20 con 0x5628d2e51010 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.016+0000 7fbe6affd640 10 client.15489 handle_command_reply: tid=0 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.016+0000 7fbe947f9740 1 client.15489 shutdown 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 -- 172.21.15.59:0/2087981368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 msgr2=0x5628d2e3eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e3eaf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbe8402a920 tx=0x7fbe840044f0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 -- 172.21.15.59:0/2087981368 shutdown_connections 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5628d2e51010 0x5628d2e53400 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e3eaf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e32310 0x5628d2e3e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe6affd640 0 client.15489 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 --2- 172.21.15.59:0/2087981368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 0x5628d2e3e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 -- 172.21.15.59:0/2087981368 >> 172.21.15.59:0/2087981368 conn(0x5628d2e2e060 msgr2=0x5628d2e33dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 -- 172.21.15.59:0/2087981368 shutdown_connections 2024-09-10T11:04:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 1 -- 172.21.15.59:0/2087981368 wait complete. 2024-09-10T11:04:30.026 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.017+0000 7fbe947f9740 20 client.15489 trim_cache size 0 max 16384 2024-09-10T11:04:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.031+0000 7fbe947f9740 1 Processor -- start 2024-09-10T11:04:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.031+0000 7fbe947f9740 1 -- start start 2024-09-10T11:04:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e319f0 0x5628d2e3e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 0x5628d2e58a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e58fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe947f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c1adee0 con 0x5628d2e410c0 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe947f9740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c1ab7b0 con 0x5628d2e319f0 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe947f9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c1a9620 con 0x5628d2e32310 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e58fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e58fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58938/0 (socket says 172.21.15.59:58938) 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/1608063718 learned_addr learned my addr 172.21.15.59:0/1608063718 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8a7fc640 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 0x5628d2e58a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8affd640 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e319f0 0x5628d2e3e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/1608063718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 msgr2=0x5628d2e58a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 0x5628d2e58a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/1608063718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e319f0 msgr2=0x5628d2e3e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e319f0 0x5628d2e3e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8b7fe640 1 -- 172.21.15.59:0/1608063718 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628d2e32140 con 0x5628d2e410c0 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8affd640 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e319f0 0x5628d2e3e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e58fc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbe8402ae00 tx=0x7fbe84009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed30c4e884f741d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.032+0000 7fbe717fa640 1 -- 172.21.15.59:0/1608063718 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840305a0 con 0x5628d2e410c0 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe717fa640 1 -- 172.21.15.59:0/1608063718 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe84036030 con 0x5628d2e410c0 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe717fa640 1 -- 172.21.15.59:0/1608063718 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84004e30 con 0x5628d2e410c0 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 -- 172.21.15.59:0/1608063718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 msgr2=0x5628d2e58fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e58fc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbe8402ae00 tx=0x7fbe84009540 comp rx=0 tx=0).stop 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 -- 172.21.15.59:0/1608063718 shutdown_connections 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e410c0 0x5628d2e58fc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e32310 0x5628d2e58a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 --2- 172.21.15.59:0/1608063718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e319f0 0x5628d2e3e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 -- 172.21.15.59:0/1608063718 >> 172.21.15.59:0/1608063718 conn(0x5628d2e2e060 msgr2=0x5628d2e3e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 -- 172.21.15.59:0/1608063718 shutdown_connections 2024-09-10T11:04:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 -- 172.21.15.59:0/1608063718 wait complete. 2024-09-10T11:04:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.033+0000 7fbe947f9740 1 -- start start 2024-09-10T11:04:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe947f9740 1 Processor -- start 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 0x5628d2e44e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e32310 0x5628d2e453b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe947f9740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 0x5628d2e458f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe947f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c1a9c70 con 0x5628d2e32310 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe947f9740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c1ab0e0 con 0x5628d2e410c0 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe947f9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c1aa340 con 0x5628d2e319f0 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe947f9740 10 client.0 _ll_register_callbacks cb 0x7fbe800097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e32310 0x5628d2e453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e32310 0x5628d2e453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58948/0 (socket says 172.21.15.59:58948) 2024-09-10T11:04:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8a7fc640 1 -- 172.21.15.59:0/463644136 learned_addr learned my addr 172.21.15.59:0/463644136 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8b7fe640 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 0x5628d2e458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8affd640 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 0x5628d2e44e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8a7fc640 1 -- 172.21.15.59:0/463644136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 msgr2=0x5628d2e44e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8a7fc640 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 0x5628d2e44e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8a7fc640 1 -- 172.21.15.59:0/463644136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 msgr2=0x5628d2e458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8a7fc640 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 0x5628d2e458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.034+0000 7fbe8a7fc640 1 -- 172.21.15.59:0/463644136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628d2ebaa50 con 0x5628d2e32310 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe8a7fc640 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e32310 0x5628d2e453b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbe800108f0 tx=0x7fbe80010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd85aaadcefdc39a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe6affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe6affd640 1 -- 172.21.15.59:0/463644136 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80022060 con 0x5628d2e32310 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe6affd640 1 -- 172.21.15.59:0/463644136 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fbe8000f920 con 0x5628d2e32310 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe947f9740 1 -- 172.21.15.59:0/463644136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe84036030 con 0x5628d2e32310 2024-09-10T11:04:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe6affd640 1 -- 172.21.15.59:0/463644136 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbe8000fb20 con 0x5628d2e32310 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe947f9740 10 client.15495 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe947f9740 1 -- 172.21.15.59:0/463644136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5628d2ebbd10 con 0x5628d2e32310 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe6affd640 1 -- 172.21.15.59:0/463644136 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe84036030 con 0x5628d2e32310 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe6affd640 1 -- 172.21.15.59:0/463644136 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbe800253d0 con 0x5628d2e32310 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe947f9740 10 client.15495 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe947f9740 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe947f9740 20 client.15495 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe947f9740 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5628d2ebc4f0 0x5628d2ebe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe947f9740 4 client.15495 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.035+0000 7fbe947f9740 1 -- 172.21.15.59:0/463644136 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5628d2d9dd70 con 0x5628d2ebc4f0 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.036+0000 7fbe8affd640 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5628d2ebc4f0 0x5628d2ebe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.036+0000 7fbe8affd640 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5628d2ebc4f0 0x5628d2ebe910 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=750b6f36af390b34 server_cookie=4cd2b264863253f3 in_seq=0 out_seq=0 2024-09-10T11:04:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.036+0000 7fbe6affd640 10 client.15495 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe6affd640 1 -- 172.21.15.59:0/463644136 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5628d2d9dd70 con 0x5628d2ebc4f0 2024-09-10T11:04:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe6affd640 10 client.15495 handle_command_reply: tid=0 2024-09-10T11:04:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 client.15495 shutdown 2024-09-10T11:04:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 -- 172.21.15.59:0/463644136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e32310 msgr2=0x5628d2e453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e32310 0x5628d2e453b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbe800108f0 tx=0x7fbe80010db0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 -- 172.21.15.59:0/463644136 shutdown_connections 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5628d2ebc4f0 0x5628d2ebe910 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5628d2e410c0 0x5628d2e458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628d2e32310 0x5628d2e453b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe6affd640 0 client.15495 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 --2- 172.21.15.59:0/463644136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5628d2e319f0 0x5628d2e44e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 -- 172.21.15.59:0/463644136 >> 172.21.15.59:0/463644136 conn(0x5628d2e2e060 msgr2=0x5628d2e400f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 -- 172.21.15.59:0/463644136 shutdown_connections 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 1 -- 172.21.15.59:0/463644136 wait complete. 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.050+0000 7fbe947f9740 20 client.15495 trim_cache size 0 max 16384 2024-09-10T11:04:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:04:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:04:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:04:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:04:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 -- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fbe740a2e20 msgr2=0x7fbe740a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fbe740a2e20 0x7fbe740a52e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe8404d000 tx=0x7fbe8404b000 comp rx=0 tx=0).stop 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 -- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c101ae0 msgr2=0x7fbe8c1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c101ae0 0x7fbe8c1982e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00d950 tx=0x7fbe7c00de10 comp rx=0 tx=0).stop 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 -- 172.21.15.59:0/1722241403 shutdown_connections 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fbe740a2e20 0x7fbe740a52e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe8c107b80 0x7fbe8c19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe8c102480 0x7fbe8c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 --2- 172.21.15.59:0/1722241403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c101ae0 0x7fbe8c1982e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 -- 172.21.15.59:0/1722241403 >> 172.21.15.59:0/1722241403 conn(0x7fbe8c0fd7e0 msgr2=0x7fbe8c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 -- 172.21.15.59:0/1722241403 shutdown_connections 2024-09-10T11:04:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:30.051+0000 7fbe91a5e640 1 -- 172.21.15.59:0/1722241403 wait complete. 2024-09-10T11:04:30.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:29 smithi059 ceph-mon[30978]: pgmap v96: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:04:31.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:31 smithi181 ceph-mon[35409]: pgmap v97: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-10T11:04:31.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:31 smithi115 ceph-mon[34719]: pgmap v97: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-10T11:04:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:31 smithi059 ceph-mon[30978]: pgmap v97: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-10T11:04:33.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:33 smithi181 ceph-mon[35409]: pgmap v98: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-10T11:04:33.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:33 smithi115 ceph-mon[34719]: pgmap v98: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-10T11:04:34.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:33 smithi059 ceph-mon[30978]: pgmap v98: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-10T11:04:35.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:35 smithi181 ceph-mon[35409]: pgmap v99: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:04:35.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:35 smithi115 ceph-mon[34719]: pgmap v99: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:04:36.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:35 smithi059 ceph-mon[30978]: pgmap v99: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:04:36.832 INFO:tasks.workunit.client.0.smithi059.stdout:64/600: open fd = 3 2024-09-10T11:04:36.832 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.832 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.832 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:65/600: open fd = 3 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:66/600: open fd = 3 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:67/600: open fd = 3 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.833 INFO:tasks.workunit.client.0.smithi059.stdout:68/600: open fd = 3 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:69/600: open fd = 3 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:70/600: open fd = 3 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:71/600: open fd = 3 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:72/600: open fd = 3 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:73/600: open fd = 3 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:74/600: open fd = 3 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.835 INFO:tasks.workunit.client.0.smithi059.stdout:75/600: open fd = 3 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:76/600: open fd = 3 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:77/600: open fd = 3 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:78/600: open fd = 3 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:79/600: open fd = 3 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:80/600: open fd = 3 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:81/600: open fd = 3 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:82/600: open fd = 3 2024-09-10T11:04:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:83/600: open fd = 3 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:84/600: open fd = 3 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:85/600: open fd = 3 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.838 INFO:tasks.workunit.client.0.smithi059.stdout:86/600: open fd = 3 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:87/600: open fd = 3 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:88/600: open fd = 3 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:89/600: open fd = 3 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:90/600: open fd = 3 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:91/600: open fd = 3 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:92/600: open fd = 3 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:93/600: open fd = 3 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:94/600: open fd = 3 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:95/600: open fd = 3 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:96/600: open fd = 3 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:97/600: open fd = 3 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:98/600: open fd = 3 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:99/600: open fd = 3 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:100/600: open fd = 3 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:101/600: open fd = 3 2024-09-10T11:04:36.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:102/600: open fd = 3 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:103/600: open fd = 3 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:104/600: open fd = 3 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:105/600: open fd = 3 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:106/600: open fd = 3 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:107/600: open fd = 3 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:108/600: open fd = 3 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:109/600: open fd = 3 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:110/600: open fd = 3 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:111/600: open fd = 3 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.845 INFO:tasks.workunit.client.0.smithi059.stdout:112/600: open fd = 3 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:113/600: open fd = 3 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:114/600: open fd = 3 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:115/600: open fd = 3 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.846 INFO:tasks.workunit.client.0.smithi059.stdout:116/600: open fd = 3 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:117/600: open fd = 3 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:118/600: open fd = 3 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:119/600: open fd = 3 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:120/600: open fd = 3 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:121/600: open fd = 3 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:122/600: open fd = 3 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.848 INFO:tasks.workunit.client.0.smithi059.stdout:123/600: open fd = 3 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:124/600: open fd = 3 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:125/600: open fd = 3 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:126/600: open fd = 3 2024-09-10T11:04:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:04:37.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:37 smithi181 ceph-mon[35409]: pgmap v100: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:37.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:37 smithi115 ceph-mon[34719]: pgmap v100: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:38.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:37 smithi059 ceph-mon[30978]: pgmap v100: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:39.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:39 smithi181 ceph-mon[35409]: pgmap v101: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 17 op/s 2024-09-10T11:04:39.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:39 smithi115 ceph-mon[34719]: pgmap v101: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 17 op/s 2024-09-10T11:04:40.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:39 smithi059 ceph-mon[30978]: pgmap v101: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 17 op/s 2024-09-10T11:04:41.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:41 smithi181 ceph-mon[35409]: pgmap v102: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:41.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:41 smithi115 ceph-mon[34719]: pgmap v102: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:42.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:41 smithi059 ceph-mon[30978]: pgmap v102: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.153+0000 7f472b08c640 1 -- 172.21.15.59:0/3330862286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241080f0 msgr2=0x7f472410ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.153+0000 7f472b08c640 1 --2- 172.21.15.59:0/3330862286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241080f0 0x7f472410ea10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f471c009ca0 tx=0x7f471c02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.153+0000 7f472b08c640 1 -- 172.21.15.59:0/3330862286 shutdown_connections 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.153+0000 7f472b08c640 1 --2- 172.21.15.59:0/3330862286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241080f0 0x7f472410ea10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.153+0000 7f472b08c640 1 --2- 172.21.15.59:0/3330862286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4724101250 0x7f4724107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.153+0000 7f472b08c640 1 --2- 172.21.15.59:0/3330862286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47241008a0 0x7f4724100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.153+0000 7f472b08c640 1 -- 172.21.15.59:0/3330862286 >> 172.21.15.59:0/3330862286 conn(0x7f4724075ef0 msgr2=0x7f4724076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.153+0000 7f472b08c640 1 -- 172.21.15.59:0/3330862286 shutdown_connections 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.153+0000 7f472b08c640 1 -- 172.21.15.59:0/3330862286 wait complete. 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f472b08c640 1 Processor -- start 2024-09-10T11:04:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f472b08c640 1 -- start start 2024-09-10T11:04:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f472b08c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241008a0 0x7f4724198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f472b08c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47241080f0 0x7f4724198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f472b08c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f472419cad0 0x7f472419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f472b08c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4724111f20 con 0x7f47241008a0 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f472b08c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4724111da0 con 0x7f472419cad0 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f472b08c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47241120a0 con 0x7f47241080f0 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f4728e28640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241008a0 0x7f4724198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f4728e28640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241008a0 0x7f4724198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38830/0 (socket says 172.21.15.59:38830) 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.154+0000 7f4728e28640 1 -- 172.21.15.59:0/1049381575 learned_addr learned my addr 172.21.15.59:0/1049381575 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4729629640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f472419cad0 0x7f472419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4723fff640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47241080f0 0x7f4724198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4728e28640 1 -- 172.21.15.59:0/1049381575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47241080f0 msgr2=0x7f4724198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4728e28640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47241080f0 0x7f4724198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4728e28640 1 -- 172.21.15.59:0/1049381575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f472419cad0 msgr2=0x7f472419cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4728e28640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f472419cad0 0x7f472419cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4728e28640 1 -- 172.21.15.59:0/1049381575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472419d5c0 con 0x7f47241008a0 2024-09-10T11:04:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4723fff640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47241080f0 0x7f4724198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:04:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4728e28640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241008a0 0x7f4724198210 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f471800c920 tx=0x7f471800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4721ffb640 1 -- 172.21.15.59:0/1049381575 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718007c70 con 0x7f47241008a0 2024-09-10T11:04:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4721ffb640 1 -- 172.21.15.59:0/1049381575 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4718007e10 con 0x7f47241008a0 2024-09-10T11:04:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f472b08c640 1 -- 172.21.15.59:0/1049381575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472419d8b0 con 0x7f47241008a0 2024-09-10T11:04:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.155+0000 7f4721ffb640 1 -- 172.21.15.59:0/1049381575 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718018890 con 0x7f47241008a0 2024-09-10T11:04:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.156+0000 7f472b08c640 1 -- 172.21.15.59:0/1049381575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47241a50a0 con 0x7f47241008a0 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f4721ffb640 1 -- 172.21.15.59:0/1049381575 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4718018a70 con 0x7f47241008a0 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f472de25740 1 Processor -- start 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f472de25740 1 -- start start 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f472de25740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 0x55cc845c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f4721ffb640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f47140a2da0 0x7f47140a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f472de25740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c32f0 0x55cc845d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f472de25740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 0x55cc845d44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f472de25740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cc845272f0 con 0x55cc845c32f0 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f472de25740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55cc844cf270 con 0x55cc845c29d0 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.158+0000 7f472de25740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cc845232b0 con 0x55cc845d20c0 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4723fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c32f0 0x55cc845d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4728e28640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f47140a2da0 0x7f47140a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4721ffb640 1 -- 172.21.15.59:0/1049381575 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f47180cf690 con 0x7f47241008a0 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4723fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c32f0 0x55cc845d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38846/0 (socket says 172.21.15.59:38846) 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4723fff640 1 -- 172.21.15.59:0/2842957007 learned_addr learned my addr 172.21.15.59:0/2842957007 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4729629640 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 0x55cc845c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4729629640 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 0x55cc845d44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4723fff640 1 -- 172.21.15.59:0/2842957007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 msgr2=0x55cc845d44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4723fff640 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 0x55cc845d44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4723fff640 1 -- 172.21.15.59:0/2842957007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 msgr2=0x55cc845c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4723fff640 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 0x55cc845c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4723fff640 1 -- 172.21.15.59:0/2842957007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc844ce340 con 0x55cc845c32f0 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4729629640 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 0x55cc845c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4728e28640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f47140a2da0 0x7f47140a5260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f471809bb00 tx=0x7f4718013720 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f4723fff640 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c32f0 0x55cc845d1b80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f471000cc40 tx=0x7f471000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8064d26ab4d3a187 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f470effd640 1 -- 172.21.15.59:0/2842957007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710014070 con 0x55cc845c32f0 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f470effd640 1 -- 172.21.15.59:0/2842957007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47100047a0 con 0x55cc845c32f0 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.159+0000 7f470effd640 1 -- 172.21.15.59:0/2842957007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710010690 con 0x55cc845c32f0 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.160+0000 7f472de25740 1 -- 172.21.15.59:0/2842957007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c32f0 msgr2=0x55cc845d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.160+0000 7f472de25740 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c32f0 0x55cc845d1b80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f471000cc40 tx=0x7f471000e720 comp rx=0 tx=0).stop 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.160+0000 7f472de25740 1 -- 172.21.15.59:0/2842957007 shutdown_connections 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.160+0000 7f472de25740 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 0x55cc845d44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.160+0000 7f472de25740 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c32f0 0x55cc845d1b80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.160+0000 7f472de25740 1 --2- 172.21.15.59:0/2842957007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 0x55cc845c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.160+0000 7f472de25740 1 -- 172.21.15.59:0/2842957007 >> 172.21.15.59:0/2842957007 conn(0x55cc845bf060 msgr2=0x55cc845bf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.160+0000 7f472de25740 1 -- 172.21.15.59:0/2842957007 shutdown_connections 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.160+0000 7f472de25740 1 -- 172.21.15.59:0/2842957007 wait complete. 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f472de25740 1 -- start start 2024-09-10T11:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f472de25740 1 Processor -- start 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f472de25740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 0x55cc845d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f472de25740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c32f0 0x55cc845ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f472de25740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f472de25740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cc845d4cf0 con 0x55cc845d20c0 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f472de25740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55cc844b0290 con 0x55cc845c29d0 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f472de25740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cc845d4e70 con 0x55cc845c32f0 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f472de25740 10 client.0 _ll_register_callbacks cb 0x55cc844e1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f4729629640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f4729629640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38862/0 (socket says 172.21.15.59:38862) 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f4729629640 1 -- 172.21.15.59:0/4282181973 learned_addr learned my addr 172.21.15.59:0/4282181973 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.161+0000 7f4723fff640 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c32f0 0x55cc845ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4729629640 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 0x55cc845d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4729629640 1 -- 172.21.15.59:0/4282181973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c32f0 msgr2=0x55cc845ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4729629640 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c32f0 0x55cc845ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4729629640 1 -- 172.21.15.59:0/4282181973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 msgr2=0x55cc845d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4729629640 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 0x55cc845d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4729629640 1 -- 172.21.15.59:0/4282181973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc8423a210 con 0x55cc845d20c0 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4729629640 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cf530 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f471c035000 tx=0x7f471c03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec88ae965110898 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4703fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4703fff640 1 -- 172.21.15.59:0/4282181973 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c02f610 con 0x55cc845d20c0 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4703fff640 1 -- 172.21.15.59:0/4282181973 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f471c02f7b0 con 0x55cc845d20c0 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f472de25740 1 -- 172.21.15.59:0/4282181973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47100047a0 con 0x55cc845d20c0 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4703fff640 1 -- 172.21.15.59:0/4282181973 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f471c02f9b0 con 0x55cc845d20c0 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f472de25740 10 client.15507 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f472de25740 1 -- 172.21.15.59:0/4282181973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc84306620 con 0x55cc845d20c0 2024-09-10T11:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.162+0000 7f4703fff640 1 -- 172.21.15.59:0/4282181973 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47100047a0 con 0x55cc845d20c0 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.163+0000 7f4703fff640 1 -- 172.21.15.59:0/4282181973 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f471c04d4a0 con 0x55cc845d20c0 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.163+0000 7f472de25740 10 client.15507 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.163+0000 7f472de25740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.163+0000 7f472de25740 20 client.15507 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.163+0000 7f472de25740 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55cc845e64c0 0x55cc845e88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.163+0000 7f472de25740 4 client.15507 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.163+0000 7f472de25740 1 -- 172.21.15.59:0/4282181973 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc84534a20 con 0x55cc845e64c0 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.163+0000 7f4723fff640 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55cc845e64c0 0x55cc845e88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f4703fff640 10 client.15507 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f4723fff640 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55cc845e64c0 0x55cc845e88b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ca70024fd59bb35 server_cookie=9fc7d9a374260333 in_seq=0 out_seq=0 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f4703fff640 1 -- 172.21.15.59:0/4282181973 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc84534a20 con 0x55cc845e64c0 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f4703fff640 10 client.15507 handle_command_reply: tid=0 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f472de25740 1 client.15507 shutdown 2024-09-10T11:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f472de25740 1 -- 172.21.15.59:0/4282181973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 msgr2=0x55cc845cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f472de25740 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cf530 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f471c035000 tx=0x7f471c03f040 comp rx=0 tx=0).stop 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f472de25740 1 -- 172.21.15.59:0/4282181973 shutdown_connections 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f472de25740 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55cc845e64c0 0x55cc845e88b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f472de25740 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cf530 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f472de25740 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c32f0 0x55cc845ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f4703fff640 0 client.15507 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f472de25740 1 --2- 172.21.15.59:0/4282181973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c29d0 0x55cc845d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.164+0000 7f472de25740 1 -- 172.21.15.59:0/4282181973 >> 172.21.15.59:0/4282181973 conn(0x55cc845bf060 msgr2=0x55cc845c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.165+0000 7f472de25740 1 -- 172.21.15.59:0/4282181973 shutdown_connections 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.165+0000 7f472de25740 1 -- 172.21.15.59:0/4282181973 wait complete. 2024-09-10T11:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.165+0000 7f472de25740 20 client.15507 trim_cache size 0 max 16384 2024-09-10T11:04:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.179+0000 7f472de25740 1 Processor -- start 2024-09-10T11:04:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.179+0000 7f472de25740 1 -- start start 2024-09-10T11:04:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f472de25740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c29d0 0x55cc845c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f472de25740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 0x55cc845ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f472de25740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 0x55cc845ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f472de25740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47241ade30 con 0x55cc845c29d0 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f472de25740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f47241ab700 con 0x55cc845c32f0 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f472de25740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47241a9550 con 0x55cc845d20c0 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c29d0 0x55cc845c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c29d0 0x55cc845c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38870/0 (socket says 172.21.15.59:38870) 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 -- 172.21.15.59:0/776498958 learned_addr learned my addr 172.21.15.59:0/776498958 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4723fff640 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 0x55cc845ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 0x55cc845ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 -- 172.21.15.59:0/776498958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 msgr2=0x55cc845ee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 0x55cc845ee6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 -- 172.21.15.59:0/776498958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 msgr2=0x55cc845ee1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 0x55cc845ee1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 -- 172.21.15.59:0/776498958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc845c3120 con 0x55cc845c29d0 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4723fff640 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 0x55cc845ee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f4729629640 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c29d0 0x55cc845c7e30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f471c009a60 tx=0x7f471c0099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a957b664d5c930e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f470e7fc640 1 -- 172.21.15.59:0/776498958 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c056030 con 0x55cc845c29d0 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.180+0000 7f470e7fc640 1 -- 172.21.15.59:0/776498958 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f471c036040 con 0x55cc845c29d0 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f470e7fc640 1 -- 172.21.15.59:0/776498958 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c003970 con 0x55cc845c29d0 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 -- 172.21.15.59:0/776498958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c29d0 msgr2=0x55cc845c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c29d0 0x55cc845c7e30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f471c009a60 tx=0x7f471c0099f0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 -- 172.21.15.59:0/776498958 shutdown_connections 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845d20c0 0x55cc845ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 0x55cc845ee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 --2- 172.21.15.59:0/776498958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845c29d0 0x55cc845c7e30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 -- 172.21.15.59:0/776498958 >> 172.21.15.59:0/776498958 conn(0x55cc845bf060 msgr2=0x55cc845c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 -- 172.21.15.59:0/776498958 shutdown_connections 2024-09-10T11:04:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 -- 172.21.15.59:0/776498958 wait complete. 2024-09-10T11:04:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.181+0000 7f472de25740 1 -- start start 2024-09-10T11:04:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f472de25740 1 Processor -- start 2024-09-10T11:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f472de25740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c29d0 0x55cc845e3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f472de25740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 0x55cc845cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f472de25740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f472de25740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47241a9bc0 con 0x55cc845d20c0 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f472de25740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f47241ab030 con 0x55cc845c32f0 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f472de25740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47241aa290 con 0x55cc845c29d0 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f472de25740 10 client.0 _ll_register_callbacks cb 0x7f471c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f4729629640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f4729629640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38884/0 (socket says 172.21.15.59:38884) 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f4729629640 1 -- 172.21.15.59:0/3790787677 learned_addr learned my addr 172.21.15.59:0/3790787677 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f4723fff640 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 0x55cc845cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.182+0000 7f4729629640 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c29d0 0x55cc845e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4729629640 1 -- 172.21.15.59:0/3790787677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c29d0 msgr2=0x55cc845e3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4729629640 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c29d0 0x55cc845e3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4729629640 1 -- 172.21.15.59:0/3790787677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 msgr2=0x55cc845cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4729629640 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 0x55cc845cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4729629640 1 -- 172.21.15.59:0/3790787677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc845cccb0 con 0x55cc845d20c0 2024-09-10T11:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4729629640 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cc480 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f471c009950 tx=0x7f471c03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf54c3ff0ef870d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4703fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4703fff640 1 -- 172.21.15.59:0/3790787677 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c05f070 con 0x55cc845d20c0 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4703fff640 1 -- 172.21.15.59:0/3790787677 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f471c02fd50 con 0x55cc845d20c0 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f472de25740 1 -- 172.21.15.59:0/3790787677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f471c036040 con 0x55cc845d20c0 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4703fff640 1 -- 172.21.15.59:0/3790787677 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f471c056040 con 0x55cc845d20c0 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f472de25740 10 client.15513 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f472de25740 1 -- 172.21.15.59:0/3790787677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc84651190 con 0x55cc845d20c0 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4703fff640 1 -- 172.21.15.59:0/3790787677 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f471c036040 con 0x55cc845d20c0 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f4703fff640 1 -- 172.21.15.59:0/3790787677 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f471c0305c0 con 0x55cc845d20c0 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f472de25740 10 client.15513 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f472de25740 10 client.15513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f472de25740 20 client.15513 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f472de25740 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55cc846517a0 0x55cc84653b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f472de25740 4 client.15513 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:04:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.183+0000 7f472de25740 1 -- 172.21.15.59:0/3790787677 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cc8452ed70 con 0x55cc846517a0 2024-09-10T11:04:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.184+0000 7f4723fff640 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55cc846517a0 0x55cc84653b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.184+0000 7f4723fff640 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55cc846517a0 0x55cc84653b90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95449d8ec2781cfe server_cookie=e5bfdd4297b2ba86 in_seq=0 out_seq=0 2024-09-10T11:04:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.184+0000 7f4703fff640 10 client.15513 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.198+0000 7f4703fff640 1 -- 172.21.15.59:0/3790787677 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cc8452ed70 con 0x55cc846517a0 2024-09-10T11:04:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.198+0000 7f4703fff640 10 client.15513 handle_command_reply: tid=0 2024-09-10T11:04:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.198+0000 7f472de25740 1 client.15513 shutdown 2024-09-10T11:04:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 -- 172.21.15.59:0/3790787677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 msgr2=0x55cc845cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cc480 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f471c009950 tx=0x7f471c03f040 comp rx=0 tx=0).stop 2024-09-10T11:04:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 -- 172.21.15.59:0/3790787677 shutdown_connections 2024-09-10T11:04:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55cc846517a0 0x55cc84653b90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc845d20c0 0x55cc845cc480 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc845c32f0 0x55cc845cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 --2- 172.21.15.59:0/3790787677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cc845c29d0 0x55cc845e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f4703fff640 0 client.15513 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 -- 172.21.15.59:0/3790787677 >> 172.21.15.59:0/3790787677 conn(0x55cc845bf060 msgr2=0x55cc845c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 -- 172.21.15.59:0/3790787677 shutdown_connections 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 1 -- 172.21.15.59:0/3790787677 wait complete. 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.199+0000 7f472de25740 20 client.15513 trim_cache size 0 max 16384 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:04:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:04:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 -- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f47140a2da0 msgr2=0x7f47140a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f47140a2da0 0x7f47140a5260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f471809bb00 tx=0x7f4718013720 comp rx=0 tx=0).stop 2024-09-10T11:04:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 -- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241008a0 msgr2=0x7f4724198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241008a0 0x7f4724198210 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f471800c920 tx=0x7f471800cde0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 -- 172.21.15.59:0/1049381575 shutdown_connections 2024-09-10T11:04:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f472419cad0 0x7f472419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f47140a2da0 0x7f47140a5260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47241080f0 0x7f4724198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 --2- 172.21.15.59:0/1049381575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47241008a0 0x7f4724198210 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 -- 172.21.15.59:0/1049381575 >> 172.21.15.59:0/1049381575 conn(0x7f4724075ef0 msgr2=0x7f47240ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 -- 172.21.15.59:0/1049381575 shutdown_connections 2024-09-10T11:04:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:43.200+0000 7f472b08c640 1 -- 172.21.15.59:0/1049381575 wait complete. 2024-09-10T11:04:43.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:43 smithi181 ceph-mon[35409]: pgmap v103: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:43.939 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:43 smithi059 ceph-mon[30978]: pgmap v103: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:43.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:43 smithi115 ceph-mon[34719]: pgmap v103: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:45.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:45 smithi181 ceph-mon[35409]: pgmap v104: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 43 KiB/s wr, 20 op/s 2024-09-10T11:04:45.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:45 smithi115 ceph-mon[34719]: pgmap v104: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 43 KiB/s wr, 20 op/s 2024-09-10T11:04:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:45 smithi059 ceph-mon[30978]: pgmap v104: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 43 KiB/s wr, 20 op/s 2024-09-10T11:04:47.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:47 smithi115 ceph-mon[34719]: pgmap v105: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:48.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:47 smithi059 ceph-mon[30978]: pgmap v105: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:48.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:47 smithi181 ceph-mon[35409]: pgmap v105: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-10T11:04:49.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:49 smithi115 ceph-mon[34719]: pgmap v106: 97 pgs: 97 active+clean; 4.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-10T11:04:50.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:49 smithi059 ceph-mon[30978]: pgmap v106: 97 pgs: 97 active+clean; 4.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-10T11:04:50.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:49 smithi181 ceph-mon[35409]: pgmap v106: 97 pgs: 97 active+clean; 4.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-10T11:04:51.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:51 smithi115 ceph-mon[34719]: pgmap v107: 97 pgs: 97 active+clean; 4.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:04:51.988 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:51 smithi181 ceph-mon[35409]: pgmap v107: 97 pgs: 97 active+clean; 4.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:04:52.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:51 smithi059 ceph-mon[30978]: pgmap v107: 97 pgs: 97 active+clean; 4.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:04:53.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:53 smithi115 ceph-mon[34719]: pgmap v108: 97 pgs: 97 active+clean; 4.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:04:54.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:53 smithi059 ceph-mon[30978]: pgmap v108: 97 pgs: 97 active+clean; 4.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:04:54.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:53 smithi181 ceph-mon[35409]: pgmap v108: 97 pgs: 97 active+clean; 4.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:04:55.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:55 smithi115 ceph-mon[34719]: pgmap v109: 97 pgs: 97 active+clean; 4.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-10T11:04:56.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:55 smithi059 ceph-mon[30978]: pgmap v109: 97 pgs: 97 active+clean; 4.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-10T11:04:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:55 smithi181 ceph-mon[35409]: pgmap v109: 97 pgs: 97 active+clean; 4.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-10T11:04:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.301+0000 7fe1322e6640 1 -- 172.21.15.59:0/2508938565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c102ce0 msgr2=0x7fe12c1030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.301+0000 7fe1322e6640 1 --2- 172.21.15.59:0/2508938565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c102ce0 0x7fe12c1030c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009900 tx=0x7fe11c02a480 comp rx=0 tx=0).stop 2024-09-10T11:04:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.301+0000 7fe1322e6640 1 -- 172.21.15.59:0/2508938565 shutdown_connections 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.301+0000 7fe1322e6640 1 --2- 172.21.15.59:0/2508938565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe12c10c0b0 0x7fe12c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.301+0000 7fe1322e6640 1 --2- 172.21.15.59:0/2508938565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe12c103600 0x7fe12c10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.301+0000 7fe1322e6640 1 --2- 172.21.15.59:0/2508938565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c102ce0 0x7fe12c1030c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.301+0000 7fe1322e6640 1 -- 172.21.15.59:0/2508938565 >> 172.21.15.59:0/2508938565 conn(0x7fe12c077990 msgr2=0x7fe12c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.301+0000 7fe1322e6640 1 -- 172.21.15.59:0/2508938565 shutdown_connections 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.301+0000 7fe1322e6640 1 -- 172.21.15.59:0/2508938565 wait complete. 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe1322e6640 1 Processor -- start 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe1322e6640 1 -- start start 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe1322e6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe12c102ce0 0x7fe12c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe1322e6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe12c103600 0x7fe12c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe1322e6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c10c0b0 0x7fe12c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe1322e6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c111eb0 con 0x7fe12c10c0b0 2024-09-10T11:04:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe1322e6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c111d30 con 0x7fe12c102ce0 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe1322e6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c112030 con 0x7fe12c103600 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c10c0b0 0x7fe12c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe12bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe12c102ce0 0x7fe12c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe12bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe12c102ce0 0x7fe12c198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.59:48750/0 (socket says 172.21.15.59:48750) 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c10c0b0 0x7fe12c19cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56270/0 (socket says 172.21.15.59:56270) 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe12bfff640 1 -- 172.21.15.59:0/3092998116 learned_addr learned my addr 172.21.15.59:0/3092998116 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.302+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe12c103600 0x7fe12c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe12bfff640 1 -- 172.21.15.59:0/3092998116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe12c103600 msgr2=0x7fe12c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe12bfff640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe12c103600 0x7fe12c198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe12bfff640 1 -- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c10c0b0 msgr2=0x7fe12c19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe12bfff640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c10c0b0 0x7fe12c19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe12bfff640 1 -- 172.21.15.59:0/3092998116 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12c19d2f0 con 0x7fe12c102ce0 2024-09-10T11:04:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe130883640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c10c0b0 0x7fe12c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:04:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe12bfff640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe12c102ce0 0x7fe12c198300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe11c006010 tx=0x7fe11c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe1297fa640 1 -- 172.21.15.59:0/3092998116 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c03f030 con 0x7fe12c102ce0 2024-09-10T11:04:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe1322e6640 1 -- 172.21.15.59:0/3092998116 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe12c19d580 con 0x7fe12c102ce0 2024-09-10T11:04:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe1297fa640 1 -- 172.21.15.59:0/3092998116 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe11c003ce0 con 0x7fe12c102ce0 2024-09-10T11:04:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe1297fa640 1 -- 172.21.15.59:0/3092998116 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c049060 con 0x7fe12c102ce0 2024-09-10T11:04:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.303+0000 7fe1322e6640 1 -- 172.21.15.59:0/3092998116 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe12c1a4e70 con 0x7fe12c102ce0 2024-09-10T11:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe1297fa640 1 -- 172.21.15.59:0/3092998116 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe11c042030 con 0x7fe12c102ce0 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe135076740 1 Processor -- start 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe135076740 1 -- start start 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe135076740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a667ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe135076740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a668410 0x55f96a672770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe135076740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a672cb0 0x55f96a6750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe135076740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f96a5cc2f0 con 0x55f96a667af0 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe135076740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f96a574270 con 0x55f96a668410 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe135076740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f96a5c82b0 con 0x55f96a672cb0 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a667ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a667ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56284/0 (socket says 172.21.15.59:56284) 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.306+0000 7fe130883640 1 -- 172.21.15.59:0/276616444 learned_addr learned my addr 172.21.15.59:0/276616444 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe12bfff640 1 --2- 172.21.15.59:0/276616444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a668410 0x55f96a672770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/276616444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a672cb0 0x55f96a6750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe130883640 1 -- 172.21.15.59:0/276616444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a672cb0 msgr2=0x55f96a6750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe130883640 1 --2- 172.21.15.59:0/276616444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a672cb0 0x55f96a6750a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe130883640 1 -- 172.21.15.59:0/276616444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a668410 msgr2=0x55f96a672770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe130883640 1 --2- 172.21.15.59:0/276616444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a668410 0x55f96a672770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe130883640 1 -- 172.21.15.59:0/276616444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96a573340 con 0x55f96a667af0 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe1297fa640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe1140a2da0 0x7fe1140a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe12bfff640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe1140a2da0 0x7fe1140a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe130883640 1 --2- 172.21.15.59:0/276616444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a667ed0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe124010710 tx=0x7fe124010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d38bb417a5d6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe1297fa640 1 -- 172.21.15.59:0/3092998116 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fe11c0efcf0 con 0x7fe12c102ce0 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe1127fc640 1 -- 172.21.15.59:0/276616444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12400e8d0 con 0x55f96a667af0 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe1127fc640 1 -- 172.21.15.59:0/276616444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe124012450 con 0x55f96a667af0 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.307+0000 7fe1127fc640 1 -- 172.21.15.59:0/276616444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12401c670 con 0x55f96a667af0 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 -- 172.21.15.59:0/276616444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 msgr2=0x55f96a667ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe12bfff640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe1140a2da0 0x7fe1140a5260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55f96a664ec0 tx=0x7fe11c0f37a0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 --2- 172.21.15.59:0/276616444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a667ed0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe124010710 tx=0x7fe124010bd0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 -- 172.21.15.59:0/276616444 shutdown_connections 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 --2- 172.21.15.59:0/276616444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a672cb0 0x55f96a6750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 --2- 172.21.15.59:0/276616444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a668410 0x55f96a672770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 --2- 172.21.15.59:0/276616444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a667ed0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 -- 172.21.15.59:0/276616444 >> 172.21.15.59:0/276616444 conn(0x55f96a664060 msgr2=0x55f96a664440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 -- 172.21.15.59:0/276616444 shutdown_connections 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 -- 172.21.15.59:0/276616444 wait complete. 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.308+0000 7fe135076740 1 -- start start 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe135076740 1 Processor -- start 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe135076740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 0x55f96a66fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe135076740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a6700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe135076740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a670610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe135076740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f96a675880 con 0x55f96a672cb0 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe135076740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f96a555290 con 0x55f96a667af0 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe135076740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f96a675a00 con 0x55f96a668410 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe135076740 10 client.0 _ll_register_callbacks cb 0x55f96a586140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a670610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a670610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56294/0 (socket says 172.21.15.59:56294) 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe130883640 1 -- 172.21.15.59:0/3157220109 learned_addr learned my addr 172.21.15.59:0/3157220109 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe130883640 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 0x55f96a66fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.309+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a6700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe130883640 1 -- 172.21.15.59:0/3157220109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 msgr2=0x55f96a6700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe130883640 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a6700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe130883640 1 -- 172.21.15.59:0/3157220109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 msgr2=0x55f96a66fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe130883640 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 0x55f96a66fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe130883640 1 -- 172.21.15.59:0/3157220109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96a2df210 con 0x55f96a672cb0 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a6700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe130883640 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a670610 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe124010460 tx=0x7fe124012e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8454a3df94292d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:56.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe10b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe10b7fe640 1 -- 172.21.15.59:0/3157220109 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124020030 con 0x55f96a672cb0 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe10b7fe640 1 -- 172.21.15.59:0/3157220109 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fe124010dc0 con 0x55f96a672cb0 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe135076740 1 -- 172.21.15.59:0/3157220109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe124012450 con 0x55f96a672cb0 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe10b7fe640 1 -- 172.21.15.59:0/3157220109 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe12400eb80 con 0x55f96a672cb0 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe135076740 10 client.15525 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe135076740 1 -- 172.21.15.59:0/3157220109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f96a3ab620 con 0x55f96a672cb0 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.310+0000 7fe10b7fe640 1 -- 172.21.15.59:0/3157220109 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe124012450 con 0x55f96a672cb0 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe10b7fe640 1 -- 172.21.15.59:0/3157220109 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe12400f040 con 0x55f96a672cb0 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe135076740 10 client.15525 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe135076740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe135076740 20 client.15525 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:56.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe135076740 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f96a682b70 0x55f96a684f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe135076740 4 client.15525 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe135076740 1 -- 172.21.15.59:0/3157220109 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f96a5d9a20 con 0x55f96a682b70 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f96a682b70 0x55f96a684f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe10b7fe640 10 client.15525 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.311+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f96a682b70 0x55f96a684f60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52283a56557c7b60 server_cookie=84608688a8c11049 in_seq=0 out_seq=0 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe10b7fe640 1 -- 172.21.15.59:0/3157220109 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f96a5d9a20 con 0x55f96a682b70 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe10b7fe640 10 client.15525 handle_command_reply: tid=0 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 client.15525 shutdown 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 -- 172.21.15.59:0/3157220109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 msgr2=0x55f96a670610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a670610 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe124010460 tx=0x7fe124012e70 comp rx=0 tx=0).stop 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 -- 172.21.15.59:0/3157220109 shutdown_connections 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f96a682b70 0x55f96a684f60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a670610 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe10b7fe640 0 client.15525 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a6700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 --2- 172.21.15.59:0/3157220109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 0x55f96a66fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 -- 172.21.15.59:0/3157220109 >> 172.21.15.59:0/3157220109 conn(0x55f96a664060 msgr2=0x55f96a669dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 -- 172.21.15.59:0/3157220109 shutdown_connections 2024-09-10T11:04:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.312+0000 7fe135076740 1 -- 172.21.15.59:0/3157220109 wait complete. 2024-09-10T11:04:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.313+0000 7fe135076740 20 client.15525 trim_cache size 0 max 16384 2024-09-10T11:04:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.327+0000 7fe135076740 1 Processor -- start 2024-09-10T11:04:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.327+0000 7fe135076740 1 -- start start 2024-09-10T11:04:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.327+0000 7fe135076740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 0x55f96a671ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.327+0000 7fe135076740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a670440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.327+0000 7fe135076740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a68a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.327+0000 7fe135076740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c1b00f0 con 0x55f96a672cb0 2024-09-10T11:04:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.327+0000 7fe135076740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c1ad9c0 con 0x55f96a667af0 2024-09-10T11:04:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.327+0000 7fe135076740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c1ab810 con 0x55f96a668410 2024-09-10T11:04:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a68a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a68a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56302/0 (socket says 172.21.15.59:56302) 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 -- 172.21.15.59:0/1410339166 learned_addr learned my addr 172.21.15.59:0/1410339166 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/1410339166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a670440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 --2- 172.21.15.59:0/1410339166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 0x55f96a671ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 -- 172.21.15.59:0/1410339166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 msgr2=0x55f96a670440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 --2- 172.21.15.59:0/1410339166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a670440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 -- 172.21.15.59:0/1410339166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 msgr2=0x55f96a671ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 --2- 172.21.15.59:0/1410339166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 0x55f96a671ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 -- 172.21.15.59:0/1410339166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96a664cf0 con 0x55f96a672cb0 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe130883640 1 --2- 172.21.15.59:0/1410339166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a68a530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe12402d630 tx=0x7fe124009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97526168e5e5805 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe111ffb640 1 -- 172.21.15.59:0/1410339166 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124020040 con 0x55f96a672cb0 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe111ffb640 1 -- 172.21.15.59:0/1410339166 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe124012450 con 0x55f96a672cb0 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.328+0000 7fe111ffb640 1 -- 172.21.15.59:0/1410339166 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12402d080 con 0x55f96a672cb0 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 -- 172.21.15.59:0/1410339166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 msgr2=0x55f96a68a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 --2- 172.21.15.59:0/1410339166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a68a530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe12402d630 tx=0x7fe124009600 comp rx=0 tx=0).stop 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 -- 172.21.15.59:0/1410339166 shutdown_connections 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 --2- 172.21.15.59:0/1410339166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a672cb0 0x55f96a68a530 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 --2- 172.21.15.59:0/1410339166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a670440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 --2- 172.21.15.59:0/1410339166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a667af0 0x55f96a671ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 -- 172.21.15.59:0/1410339166 >> 172.21.15.59:0/1410339166 conn(0x55f96a664060 msgr2=0x55f96a669d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 -- 172.21.15.59:0/1410339166 shutdown_connections 2024-09-10T11:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 -- 172.21.15.59:0/1410339166 wait complete. 2024-09-10T11:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.329+0000 7fe135076740 1 -- start start 2024-09-10T11:04:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe135076740 1 Processor -- start 2024-09-10T11:04:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe135076740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a67b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe135076740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a676650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe135076740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a672cb0 0x55f96a676b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe135076740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c1abe80 con 0x55f96a667af0 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe135076740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c1ad2f0 con 0x55f96a672cb0 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe135076740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c1ac550 con 0x55f96a668410 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe135076740 10 client.0 _ll_register_callbacks cb 0x7fe124016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a67b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe130883640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a67b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56308/0 (socket says 172.21.15.59:56308) 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe130883640 1 -- 172.21.15.59:0/802409918 learned_addr learned my addr 172.21.15.59:0/802409918 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a676650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe130883640 1 -- 172.21.15.59:0/802409918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 msgr2=0x55f96a676650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe130883640 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a676650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe130883640 1 -- 172.21.15.59:0/802409918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a672cb0 msgr2=0x55f96a676b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe130883640 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a672cb0 0x55f96a676b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.330+0000 7fe130883640 1 -- 172.21.15.59:0/802409918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96a6773c0 con 0x55f96a667af0 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe130883640 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a67b330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe124000f80 tx=0x7fe12402d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1409a0f0b859c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe10b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe10b7fe640 1 -- 172.21.15.59:0/802409918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124020040 con 0x55f96a667af0 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe10b7fe640 1 -- 172.21.15.59:0/802409918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fe12402d0c0 con 0x55f96a667af0 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe135076740 1 -- 172.21.15.59:0/802409918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe124012450 con 0x55f96a667af0 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe10b7fe640 1 -- 172.21.15.59:0/802409918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe124012d10 con 0x55f96a667af0 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe135076740 10 client.15531 fetch_fsmap learned FSMap version 25 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe135076740 1 -- 172.21.15.59:0/802409918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f96a6ed440 con 0x55f96a667af0 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe10b7fe640 1 -- 172.21.15.59:0/802409918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe124012450 con 0x55f96a667af0 2024-09-10T11:04:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe10b7fe640 1 -- 172.21.15.59:0/802409918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe124005040 con 0x55f96a667af0 2024-09-10T11:04:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe135076740 10 client.15531 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:04:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe135076740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:04:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe135076740 20 client.15531 populate_metadata read hostname 'smithi059' 2024-09-10T11:04:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe135076740 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f96a6edaa0 0x55f96a6efec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:04:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe135076740 4 client.15531 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:04:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.331+0000 7fe135076740 1 -- 172.21.15.59:0/802409918 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f96a5d3d70 con 0x55f96a6edaa0 2024-09-10T11:04:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.332+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f96a6edaa0 0x55f96a6efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:04:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.332+0000 7fe12b7fe640 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f96a6edaa0 0x55f96a6efec0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ea47b39669b6263 server_cookie=225276571e6560a7 in_seq=0 out_seq=0 2024-09-10T11:04:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.332+0000 7fe10b7fe640 10 client.15531 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.346+0000 7fe10b7fe640 1 -- 172.21.15.59:0/802409918 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f96a5d3d70 con 0x55f96a6edaa0 2024-09-10T11:04:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.346+0000 7fe10b7fe640 10 client.15531 handle_command_reply: tid=0 2024-09-10T11:04:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.346+0000 7fe135076740 1 client.15531 shutdown 2024-09-10T11:04:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 -- 172.21.15.59:0/802409918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 msgr2=0x55f96a67b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a67b330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe124000f80 tx=0x7fe12402d660 comp rx=0 tx=0).stop 2024-09-10T11:04:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 -- 172.21.15.59:0/802409918 shutdown_connections 2024-09-10T11:04:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f96a6edaa0 0x55f96a6efec0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f96a672cb0 0x55f96a676b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f96a668410 0x55f96a676650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe10b7fe640 0 client.15531 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 --2- 172.21.15.59:0/802409918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f96a667af0 0x55f96a67b330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 -- 172.21.15.59:0/802409918 >> 172.21.15.59:0/802409918 conn(0x55f96a664060 msgr2=0x55f96a67db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 -- 172.21.15.59:0/802409918 shutdown_connections 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 1 -- 172.21.15.59:0/802409918 wait complete. 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe135076740 20 client.15531 trim_cache size 0 max 16384 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:04:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:04:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:04:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe1322e6640 1 -- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe1140a2da0 msgr2=0x7fe1140a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe1322e6640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe1140a2da0 0x7fe1140a5260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55f96a664ec0 tx=0x7fe11c0f37a0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe1322e6640 1 -- 172.21.15.59:0/3092998116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe12c102ce0 msgr2=0x7fe12c198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.347+0000 7fe1322e6640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe12c102ce0 0x7fe12c198300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe11c006010 tx=0x7fe11c0042f0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.348+0000 7fe1322e6640 1 -- 172.21.15.59:0/3092998116 shutdown_connections 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.348+0000 7fe1322e6640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c10c0b0 0x7fe12c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.348+0000 7fe1322e6640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe1140a2da0 0x7fe1140a5260 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.348+0000 7fe1322e6640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe12c103600 0x7fe12c198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.348+0000 7fe1322e6640 1 --2- 172.21.15.59:0/3092998116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe12c102ce0 0x7fe12c198300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.348+0000 7fe1322e6640 1 -- 172.21.15.59:0/3092998116 >> 172.21.15.59:0/3092998116 conn(0x7fe12c077990 msgr2=0x7fe12c0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.348+0000 7fe1322e6640 1 -- 172.21.15.59:0/3092998116 shutdown_connections 2024-09-10T11:04:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:04:56.348+0000 7fe1322e6640 1 -- 172.21.15.59:0/3092998116 wait complete. 2024-09-10T11:04:57.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:57 smithi115 ceph-mon[34719]: pgmap v110: 97 pgs: 97 active+clean; 4.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-10T11:04:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:57 smithi059 ceph-mon[30978]: pgmap v110: 97 pgs: 97 active+clean; 4.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-10T11:04:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:57 smithi181 ceph-mon[35409]: pgmap v110: 97 pgs: 97 active+clean; 4.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-10T11:05:00.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:04:59 smithi059 ceph-mon[30978]: pgmap v111: 97 pgs: 97 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:05:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:04:59 smithi181 ceph-mon[35409]: pgmap v111: 97 pgs: 97 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:05:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:04:59 smithi115 ceph-mon[34719]: pgmap v111: 97 pgs: 97 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-10T11:05:02.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:01 smithi059 ceph-mon[30978]: pgmap v112: 97 pgs: 97 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:05:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:01 smithi181 ceph-mon[35409]: pgmap v112: 97 pgs: 97 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:05:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:01 smithi115 ceph-mon[34719]: pgmap v112: 97 pgs: 97 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:05:04.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:03 smithi059 ceph-mon[30978]: pgmap v113: 97 pgs: 97 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:05:04.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:03 smithi181 ceph-mon[35409]: pgmap v113: 97 pgs: 97 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:05:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:03 smithi115 ceph-mon[34719]: pgmap v113: 97 pgs: 97 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-10T11:05:06.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:05 smithi059 ceph-mon[30978]: pgmap v114: 97 pgs: 97 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 61 KiB/s wr, 32 op/s 2024-09-10T11:05:06.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:05 smithi181 ceph-mon[35409]: pgmap v114: 97 pgs: 97 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 61 KiB/s wr, 32 op/s 2024-09-10T11:05:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:05 smithi115 ceph-mon[34719]: pgmap v114: 97 pgs: 97 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 61 KiB/s wr, 32 op/s 2024-09-10T11:05:08.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:07 smithi059 ceph-mon[30978]: pgmap v115: 97 pgs: 97 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 27 op/s 2024-09-10T11:05:08.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:07 smithi181 ceph-mon[35409]: pgmap v115: 97 pgs: 97 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 27 op/s 2024-09-10T11:05:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:07 smithi115 ceph-mon[34719]: pgmap v115: 97 pgs: 97 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 27 op/s 2024-09-10T11:05:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.448+0000 7f738c986640 1 -- 172.21.15.59:0/325528973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73881035e0 msgr2=0x7f738810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.448+0000 7f738c986640 1 --2- 172.21.15.59:0/325528973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73881035e0 0x7f738810bac0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f737c009ca0 tx=0x7f737c02a950 comp rx=0 tx=0).stop 2024-09-10T11:05:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.448+0000 7f738c986640 1 -- 172.21.15.59:0/325528973 shutdown_connections 2024-09-10T11:05:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.448+0000 7f738c986640 1 --2- 172.21.15.59:0/325528973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f738810c110 0x7f738810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.448+0000 7f738c986640 1 --2- 172.21.15.59:0/325528973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73881035e0 0x7f738810bac0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.448+0000 7f738c986640 1 --2- 172.21.15.59:0/325528973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7388102cc0 0x7f73881030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.448+0000 7f738c986640 1 -- 172.21.15.59:0/325528973 >> 172.21.15.59:0/325528973 conn(0x7f73880fc6b0 msgr2=0x7f73880fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.448+0000 7f738c986640 1 -- 172.21.15.59:0/325528973 shutdown_connections 2024-09-10T11:05:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.448+0000 7f738c986640 1 -- 172.21.15.59:0/325528973 wait complete. 2024-09-10T11:05:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f738c986640 1 Processor -- start 2024-09-10T11:05:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f738c986640 1 -- start start 2024-09-10T11:05:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f738c986640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7388102cc0 0x7f73881983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f738c986640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73881035e0 0x7f7388198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f738c986640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738810c110 0x7f738819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f738c986640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7388111ef0 con 0x7f738810c110 2024-09-10T11:05:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f738c986640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7388111d70 con 0x7f73881035e0 2024-09-10T11:05:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f738c986640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7388112070 con 0x7f7388102cc0 2024-09-10T11:05:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f7386d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738810c110 0x7f738819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f7386d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738810c110 0x7f738819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55460/0 (socket says 172.21.15.59:55460) 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f7386d9d640 1 -- 172.21.15.59:0/4233613801 learned_addr learned my addr 172.21.15.59:0/4233613801 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f738659c640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7388102cc0 0x7f73881983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.449+0000 7f7385d9b640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73881035e0 0x7f7388198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f7386d9d640 1 -- 172.21.15.59:0/4233613801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7388102cc0 msgr2=0x7f73881983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f7386d9d640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7388102cc0 0x7f73881983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f7386d9d640 1 -- 172.21.15.59:0/4233613801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73881035e0 msgr2=0x7f7388198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f7386d9d640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73881035e0 0x7f7388198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f7386d9d640 1 -- 172.21.15.59:0/4233613801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738819d3b0 con 0x7f738810c110 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f7386d9d640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738810c110 0x7f738819cc80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f738000d750 tx=0x7f738000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f73777fe640 1 -- 172.21.15.59:0/4233613801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380017070 con 0x7f738810c110 2024-09-10T11:05:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f73777fe640 1 -- 172.21.15.59:0/4233613801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7380005500 con 0x7f738810c110 2024-09-10T11:05:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f73777fe640 1 -- 172.21.15.59:0/4233613801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380004d90 con 0x7f738810c110 2024-09-10T11:05:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f738c986640 1 -- 172.21.15.59:0/4233613801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738819d6a0 con 0x7f738810c110 2024-09-10T11:05:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.450+0000 7f738c986640 1 -- 172.21.15.59:0/4233613801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73881a4f30 con 0x7f738810c110 2024-09-10T11:05:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f73777fe640 1 -- 172.21.15.59:0/4233613801 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7380004f30 con 0x7f738810c110 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f738f7f7740 1 Processor -- start 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f738f7f7740 1 -- start start 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bec770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 0x55d5b2bef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f738f7f7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2b462f0 con 0x55d5b2be1af0 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f738f7f7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2aee270 con 0x55d5b2be2410 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f738f7f7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2b422b0 con 0x55d5b2beccb0 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f7385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f7385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55466/0 (socket says 172.21.15.59:55466) 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.453+0000 7f7385d9b640 1 -- 172.21.15.59:0/174678137 learned_addr learned my addr 172.21.15.59:0/174678137 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f73777fe640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73700a2e20 0x7f73700a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f738659c640 1 --2- 172.21.15.59:0/174678137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7385d9b640 1 --2- 172.21.15.59:0/174678137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 0x55d5b2bef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7386d9d640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73700a2e20 0x7f73700a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7385d9b640 1 -- 172.21.15.59:0/174678137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 msgr2=0x55d5b2bef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7385d9b640 1 --2- 172.21.15.59:0/174678137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 0x55d5b2bef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7385d9b640 1 -- 172.21.15.59:0/174678137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 msgr2=0x55d5b2bec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7385d9b640 1 --2- 172.21.15.59:0/174678137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bec770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7385d9b640 1 -- 172.21.15.59:0/174678137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b2aed340 con 0x55d5b2be1af0 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f73777fe640 1 -- 172.21.15.59:0/4233613801 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f73800cecb0 con 0x7f738810c110 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7385d9b640 1 --2- 172.21.15.59:0/174678137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be1ed0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f737c004ad0 tx=0x7f737c009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cd17576c3b3e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7374ff9640 1 -- 172.21.15.59:0/174678137 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c034040 con 0x55d5b2be1af0 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7374ff9640 1 -- 172.21.15.59:0/174678137 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f737c044040 con 0x55d5b2be1af0 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.454+0000 7f7374ff9640 1 -- 172.21.15.59:0/174678137 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c004590 con 0x55d5b2be1af0 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f738f7f7740 1 -- 172.21.15.59:0/174678137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 msgr2=0x55d5b2be1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f7386d9d640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73700a2e20 0x7f73700a52e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f738000d720 tx=0x7f738006d220 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f738f7f7740 1 --2- 172.21.15.59:0/174678137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be1ed0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f737c004ad0 tx=0x7f737c009380 comp rx=0 tx=0).stop 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f738f7f7740 1 -- 172.21.15.59:0/174678137 shutdown_connections 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f738f7f7740 1 --2- 172.21.15.59:0/174678137 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 0x55d5b2bef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f738f7f7740 1 --2- 172.21.15.59:0/174678137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f738f7f7740 1 --2- 172.21.15.59:0/174678137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be1ed0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f738f7f7740 1 -- 172.21.15.59:0/174678137 >> 172.21.15.59:0/174678137 conn(0x55d5b2bde060 msgr2=0x55d5b2bde440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f738f7f7740 1 -- 172.21.15.59:0/174678137 shutdown_connections 2024-09-10T11:05:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.455+0000 7f738f7f7740 1 -- 172.21.15.59:0/174678137 wait complete. 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738f7f7740 1 -- start start 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738f7f7740 1 Processor -- start 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 0x55d5b2bea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738f7f7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2bef880 con 0x55d5b2be1af0 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738f7f7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2acf290 con 0x55d5b2be2410 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738f7f7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2befa00 con 0x55d5b2beccb0 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738f7f7740 10 client.0 _ll_register_callbacks cb 0x55d5b2b00140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f7385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f7385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55480/0 (socket says 172.21.15.59:55480) 2024-09-10T11:05:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f7385d9b640 1 -- 172.21.15.59:0/3075754800 learned_addr learned my addr 172.21.15.59:0/3075754800 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f7385d9b640 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 0x55d5b2bea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f738659c640 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f7385d9b640 1 -- 172.21.15.59:0/3075754800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 msgr2=0x55d5b2bea610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f7385d9b640 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 0x55d5b2bea610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.456+0000 7f7385d9b640 1 -- 172.21.15.59:0/3075754800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 msgr2=0x55d5b2bea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f7385d9b640 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f7385d9b640 1 -- 172.21.15.59:0/3075754800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5b2859210 con 0x55d5b2be1af0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f738659c640 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f7385d9b640 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be9b90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f737c02f8e0 tx=0x7f737c004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba442f50bbf17d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f736dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f736dffb640 1 -- 172.21.15.59:0/3075754800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c034070 con 0x55d5b2be1af0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f736dffb640 1 -- 172.21.15.59:0/3075754800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f737c003970 con 0x55d5b2be1af0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f738f7f7740 1 -- 172.21.15.59:0/3075754800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f737c044040 con 0x55d5b2be1af0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f736dffb640 1 -- 172.21.15.59:0/3075754800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f737c003b70 con 0x55d5b2be1af0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f738f7f7740 10 client.15543 fetch_fsmap learned FSMap version 25 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f738f7f7740 1 -- 172.21.15.59:0/3075754800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d5b2925620 con 0x55d5b2be1af0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f736dffb640 1 -- 172.21.15.59:0/3075754800 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f737c044040 con 0x55d5b2be1af0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.457+0000 7f736dffb640 1 -- 172.21.15.59:0/3075754800 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f737c030b70 con 0x55d5b2be1af0 2024-09-10T11:05:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.458+0000 7f738f7f7740 10 client.15543 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:05:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.458+0000 7f738f7f7740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:05:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.458+0000 7f738f7f7740 20 client.15543 populate_metadata read hostname 'smithi059' 2024-09-10T11:05:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.458+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d5b2bfcae0 0x55d5b2bfeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.458+0000 7f738f7f7740 4 client.15543 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:05:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.458+0000 7f738f7f7740 1 -- 172.21.15.59:0/3075754800 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5b2b53a20 con 0x55d5b2bfcae0 2024-09-10T11:05:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.458+0000 7f738659c640 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d5b2bfcae0 0x55d5b2bfeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.458+0000 7f738659c640 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d5b2bfcae0 0x55d5b2bfeed0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec3f1b75154e9349 server_cookie=f24089910d10c18a in_seq=0 out_seq=0 2024-09-10T11:05:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.458+0000 7f736dffb640 10 client.15543 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f736dffb640 1 -- 172.21.15.59:0/3075754800 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5b2b53a20 con 0x55d5b2bfcae0 2024-09-10T11:05:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f736dffb640 10 client.15543 handle_command_reply: tid=0 2024-09-10T11:05:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 client.15543 shutdown 2024-09-10T11:05:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 -- 172.21.15.59:0/3075754800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 msgr2=0x55d5b2be9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be9b90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f737c02f8e0 tx=0x7f737c004a60 comp rx=0 tx=0).stop 2024-09-10T11:05:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 -- 172.21.15.59:0/3075754800 shutdown_connections 2024-09-10T11:05:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d5b2bfcae0 0x55d5b2bfeed0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2beccb0 0x55d5b2bea610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f736dffb640 0 client.15543 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3075754800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be9b90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 -- 172.21.15.59:0/3075754800 >> 172.21.15.59:0/3075754800 conn(0x55d5b2bde060 msgr2=0x55d5b2be3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 -- 172.21.15.59:0/3075754800 shutdown_connections 2024-09-10T11:05:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.459+0000 7f738f7f7740 1 -- 172.21.15.59:0/3075754800 wait complete. 2024-09-10T11:05:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.460+0000 7f738f7f7740 20 client.15543 trim_cache size 0 max 16384 2024-09-10T11:05:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738f7f7740 1 Processor -- start 2024-09-10T11:05:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738f7f7740 1 -- start start 2024-09-10T11:05:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be2410 0x55d5b2bea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2beccb0 0x55d5b2c01ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738f7f7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73881b0100 con 0x55d5b2be1af0 2024-09-10T11:05:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738f7f7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f73881ad9d0 con 0x55d5b2beccb0 2024-09-10T11:05:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738f7f7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f73881ab820 con 0x55d5b2be2410 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f7385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f7385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55484/0 (socket says 172.21.15.59:55484) 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f7385d9b640 1 -- 172.21.15.59:0/2639135557 learned_addr learned my addr 172.21.15.59:0/2639135557 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738659c640 1 --2- 172.21.15.59:0/2639135557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be2410 0x55d5b2bea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f7385d9b640 1 -- 172.21.15.59:0/2639135557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be2410 msgr2=0x55d5b2bea440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f7385d9b640 1 --2- 172.21.15.59:0/2639135557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be2410 0x55d5b2bea440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f7385d9b640 1 -- 172.21.15.59:0/2639135557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2beccb0 msgr2=0x55d5b2c01ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f7385d9b640 1 --2- 172.21.15.59:0/2639135557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2beccb0 0x55d5b2c01ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f7385d9b640 1 -- 172.21.15.59:0/2639135557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b2bec6e0 con 0x55d5b2be1af0 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.475+0000 7f738659c640 1 --2- 172.21.15.59:0/2639135557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be2410 0x55d5b2bea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:05:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f7385d9b640 1 --2- 172.21.15.59:0/2639135557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be4560 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f737c009ba0 tx=0x7f737c02f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b27c862550b038a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f736ffff640 1 -- 172.21.15.59:0/2639135557 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c05d070 con 0x55d5b2be1af0 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f736ffff640 1 -- 172.21.15.59:0/2639135557 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f737c009540 con 0x55d5b2be1af0 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f736ffff640 1 -- 172.21.15.59:0/2639135557 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c034070 con 0x55d5b2be1af0 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f738f7f7740 1 -- 172.21.15.59:0/2639135557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 msgr2=0x55d5b2be4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f738f7f7740 1 --2- 172.21.15.59:0/2639135557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be4560 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f737c009ba0 tx=0x7f737c02f870 comp rx=0 tx=0).stop 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f738f7f7740 1 -- 172.21.15.59:0/2639135557 shutdown_connections 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f738f7f7740 1 --2- 172.21.15.59:0/2639135557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2beccb0 0x55d5b2c01ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f738f7f7740 1 --2- 172.21.15.59:0/2639135557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be2410 0x55d5b2bea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f738f7f7740 1 --2- 172.21.15.59:0/2639135557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2be1af0 0x55d5b2be4560 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f738f7f7740 1 -- 172.21.15.59:0/2639135557 >> 172.21.15.59:0/2639135557 conn(0x55d5b2bde060 msgr2=0x55d5b2bebc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.476+0000 7f738f7f7740 1 -- 172.21.15.59:0/2639135557 shutdown_connections 2024-09-10T11:05:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 1 -- 172.21.15.59:0/2639135557 wait complete. 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 1 -- start start 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 1 Processor -- start 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be1af0 0x55d5b2c02750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bffa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2beccb0 0x55d5b2c00060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73881abe90 con 0x55d5b2beccb0 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f73881ad300 con 0x55d5b2be2410 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f73881ac560 con 0x55d5b2be1af0 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738f7f7740 10 client.0 _ll_register_callbacks cb 0x7f737800b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f7385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2beccb0 0x55d5b2c00060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f7385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2beccb0 0x55d5b2c00060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55490/0 (socket says 172.21.15.59:55490) 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f7385d9b640 1 -- 172.21.15.59:0/3428538209 learned_addr learned my addr 172.21.15.59:0/3428538209 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f7385d9b640 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be1af0 0x55d5b2c02750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.477+0000 7f738659c640 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f7385d9b640 1 -- 172.21.15.59:0/3428538209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be1af0 msgr2=0x55d5b2c02750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f7385d9b640 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be1af0 0x55d5b2c02750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f7385d9b640 1 -- 172.21.15.59:0/3428538209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 msgr2=0x55d5b2bffa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f7385d9b640 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bffa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f7385d9b640 1 -- 172.21.15.59:0/3428538209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5b2c00890 con 0x55d5b2beccb0 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f7385d9b640 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2beccb0 0x55d5b2c00060 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f737c009430 tx=0x7f737c004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd3ded80049c151 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f736dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f736dffb640 1 -- 172.21.15.59:0/3428538209 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c067060 con 0x55d5b2beccb0 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f736dffb640 1 -- 172.21.15.59:0/3428538209 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f737c003d10 con 0x55d5b2beccb0 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f738f7f7740 1 -- 172.21.15.59:0/3428538209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f737c009540 con 0x55d5b2beccb0 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f736dffb640 1 -- 172.21.15.59:0/3428538209 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f737c034040 con 0x55d5b2beccb0 2024-09-10T11:05:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f738f7f7740 10 client.15549 fetch_fsmap learned FSMap version 25 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f738f7f7740 1 -- 172.21.15.59:0/3428538209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d5b2c674a0 con 0x55d5b2beccb0 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f736dffb640 1 -- 172.21.15.59:0/3428538209 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f737c009540 con 0x55d5b2beccb0 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.478+0000 7f736dffb640 1 -- 172.21.15.59:0/3428538209 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f737c030920 con 0x55d5b2beccb0 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.479+0000 7f738f7f7740 10 client.15549 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.479+0000 7f738f7f7740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.479+0000 7f738f7f7740 20 client.15549 populate_metadata read hostname 'smithi059' 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.479+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d5b2c67790 0x55d5b2c69b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.479+0000 7f738f7f7740 4 client.15549 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.479+0000 7f738f7f7740 1 -- 172.21.15.59:0/3428538209 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d5b2b4dd70 con 0x55d5b2c67790 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.479+0000 7f738659c640 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d5b2c67790 0x55d5b2c69b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.479+0000 7f738659c640 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d5b2c67790 0x55d5b2c69b80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d4d3d745ec8bda9 server_cookie=77ff55055852276c in_seq=0 out_seq=0 2024-09-10T11:05:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.479+0000 7f736dffb640 10 client.15549 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f736dffb640 1 -- 172.21.15.59:0/3428538209 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d5b2b4dd70 con 0x55d5b2c67790 2024-09-10T11:05:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f736dffb640 10 client.15549 handle_command_reply: tid=0 2024-09-10T11:05:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 client.15549 shutdown 2024-09-10T11:05:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 -- 172.21.15.59:0/3428538209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2beccb0 msgr2=0x55d5b2c00060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2beccb0 0x55d5b2c00060 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f737c009430 tx=0x7f737c004890 comp rx=0 tx=0).stop 2024-09-10T11:05:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 -- 172.21.15.59:0/3428538209 shutdown_connections 2024-09-10T11:05:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d5b2c67790 0x55d5b2c69b80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5b2beccb0 0x55d5b2c00060 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f736dffb640 0 client.15549 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d5b2be2410 0x55d5b2bffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 --2- 172.21.15.59:0/3428538209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d5b2be1af0 0x55d5b2c02750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 -- 172.21.15.59:0/3428538209 >> 172.21.15.59:0/3428538209 conn(0x55d5b2bde060 msgr2=0x55d5b2bdc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 -- 172.21.15.59:0/3428538209 shutdown_connections 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 1 -- 172.21.15.59:0/3428538209 wait complete. 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738f7f7740 20 client.15549 trim_cache size 0 max 16384 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:05:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:05:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 -- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73700a2e20 msgr2=0x7f73700a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73700a2e20 0x7f73700a52e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f738000d720 tx=0x7f738006d220 comp rx=0 tx=0).stop 2024-09-10T11:05:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 -- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738810c110 msgr2=0x7f738819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738810c110 0x7f738819cc80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f738000d750 tx=0x7f738000dc10 comp rx=0 tx=0).stop 2024-09-10T11:05:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 -- 172.21.15.59:0/4233613801 shutdown_connections 2024-09-10T11:05:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738810c110 0x7f738819cc80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73881035e0 0x7f7388198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73700a2e20 0x7f73700a52e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 --2- 172.21.15.59:0/4233613801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7388102cc0 0x7f73881983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 -- 172.21.15.59:0/4233613801 >> 172.21.15.59:0/4233613801 conn(0x7f73880fc6b0 msgr2=0x7f73880fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 -- 172.21.15.59:0/4233613801 shutdown_connections 2024-09-10T11:05:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:09.495+0000 7f738c986640 1 -- 172.21.15.59:0/4233613801 wait complete. 2024-09-10T11:05:10.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:09 smithi059 ceph-mon[30978]: pgmap v116: 97 pgs: 97 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-09-10T11:05:10.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:09 smithi181 ceph-mon[35409]: pgmap v116: 97 pgs: 97 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-09-10T11:05:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:09 smithi115 ceph-mon[34719]: pgmap v116: 97 pgs: 97 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 63 KiB/s wr, 32 op/s 2024-09-10T11:05:12.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:11 smithi059 ceph-mon[30978]: pgmap v117: 97 pgs: 97 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 24 op/s 2024-09-10T11:05:12.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:11 smithi181 ceph-mon[35409]: pgmap v117: 97 pgs: 97 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 24 op/s 2024-09-10T11:05:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:11 smithi115 ceph-mon[34719]: pgmap v117: 97 pgs: 97 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 24 op/s 2024-09-10T11:05:14.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:13 smithi059 ceph-mon[30978]: pgmap v118: 97 pgs: 97 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 24 op/s 2024-09-10T11:05:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:13 smithi181 ceph-mon[35409]: pgmap v118: 97 pgs: 97 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 24 op/s 2024-09-10T11:05:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:13 smithi115 ceph-mon[34719]: pgmap v118: 97 pgs: 97 active+clean; 4.8 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 24 op/s 2024-09-10T11:05:16.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:15 smithi059 ceph-mon[30978]: pgmap v119: 97 pgs: 97 active+clean; 5.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 66 KiB/s wr, 32 op/s 2024-09-10T11:05:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:15 smithi181 ceph-mon[35409]: pgmap v119: 97 pgs: 97 active+clean; 5.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 66 KiB/s wr, 32 op/s 2024-09-10T11:05:16.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:15 smithi115 ceph-mon[34719]: pgmap v119: 97 pgs: 97 active+clean; 5.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 66 KiB/s wr, 32 op/s 2024-09-10T11:05:18.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:17 smithi059 ceph-mon[30978]: pgmap v120: 97 pgs: 97 active+clean; 5.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-10T11:05:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:17 smithi181 ceph-mon[35409]: pgmap v120: 97 pgs: 97 active+clean; 5.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-10T11:05:18.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:17 smithi115 ceph-mon[34719]: pgmap v120: 97 pgs: 97 active+clean; 5.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-10T11:05:20.010 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:19 smithi115 ceph-mon[34719]: pgmap v121: 97 pgs: 97 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 17 op/s 2024-09-10T11:05:20.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:19 smithi059 ceph-mon[30978]: pgmap v121: 97 pgs: 97 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 17 op/s 2024-09-10T11:05:20.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:19 smithi181 ceph-mon[35409]: pgmap v121: 97 pgs: 97 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 17 op/s 2024-09-10T11:05:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:21 smithi059 ceph-mon[30978]: pgmap v122: 97 pgs: 97 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-10T11:05:22.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:21 smithi181 ceph-mon[35409]: pgmap v122: 97 pgs: 97 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-10T11:05:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:21 smithi115 ceph-mon[34719]: pgmap v122: 97 pgs: 97 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-10T11:05:22.598 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.597+0000 7fa69ea5e640 1 -- 172.21.15.59:0/1605370837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 msgr2=0x7fa69810e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.597+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/1605370837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 0x7fa69810e9a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa690009cd0 tx=0x7fa69002a8e0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.597+0000 7fa69ea5e640 1 -- 172.21.15.59:0/1605370837 shutdown_connections 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.597+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/1605370837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 0x7fa69810e9a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.597+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/1605370837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa698101ad0 0x7fa698101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.597+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/1605370837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698107b70 0x7fa698107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.597+0000 7fa69ea5e640 1 -- 172.21.15.59:0/1605370837 >> 172.21.15.59:0/1605370837 conn(0x7fa6980fd7d0 msgr2=0x7fa6980ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.597+0000 7fa69ea5e640 1 -- 172.21.15.59:0/1605370837 shutdown_connections 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.597+0000 7fa69ea5e640 1 -- 172.21.15.59:0/1605370837 wait complete. 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.598+0000 7fa69ea5e640 1 Processor -- start 2024-09-10T11:05:22.599 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.598+0000 7fa69ea5e640 1 -- start start 2024-09-10T11:05:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.598+0000 7fa69ea5e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698101ad0 0x7fa6980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.598+0000 7fa69ea5e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 0x7fa698074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.598+0000 7fa69ea5e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa698107b70 0x7fa698074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.598+0000 7fa69ea5e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa698111ee0 con 0x7fa698102470 2024-09-10T11:05:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.598+0000 7fa69ea5e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa698111d60 con 0x7fa698107b70 2024-09-10T11:05:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.598+0000 7fa69ea5e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa698112060 con 0x7fa698101ad0 2024-09-10T11:05:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 0x7fa698074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 0x7fa698074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58846/0 (socket says 172.21.15.59:58846) 2024-09-10T11:05:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6977fe640 1 -- 172.21.15.59:0/4199233898 learned_addr learned my addr 172.21.15.59:0/4199233898 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa697fff640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698101ad0 0x7fa6980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa69cffb640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa698107b70 0x7fa698074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6977fe640 1 -- 172.21.15.59:0/4199233898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698101ad0 msgr2=0x7fa6980744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:22.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6977fe640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698101ad0 0x7fa6980744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6977fe640 1 -- 172.21.15.59:0/4199233898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa698107b70 msgr2=0x7fa698074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6977fe640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa698107b70 0x7fa698074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6977fe640 1 -- 172.21.15.59:0/4199233898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6981a6810 con 0x7fa698102470 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa69cffb640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa698107b70 0x7fa698074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6977fe640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 0x7fa698074a30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00d950 tx=0x7fa68c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6957fa640 1 -- 172.21.15.59:0/4199233898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c017070 con 0x7fa698102470 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6957fa640 1 -- 172.21.15.59:0/4199233898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa68c009c30 con 0x7fa698102470 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa69ea5e640 1 -- 172.21.15.59:0/4199233898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6981a6b00 con 0x7fa698102470 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa6957fa640 1 -- 172.21.15.59:0/4199233898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c00f6b0 con 0x7fa698102470 2024-09-10T11:05:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.599+0000 7fa69ea5e640 1 -- 172.21.15.59:0/4199233898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6981a7050 con 0x7fa698102470 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.602+0000 7fa6957fa640 1 -- 172.21.15.59:0/4199233898 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa68c0109d0 con 0x7fa698102470 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.602+0000 7fa6a17f6740 1 Processor -- start 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.602+0000 7fa6a17f6740 1 -- start start 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.602+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd44ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 0x5619cd458770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd45b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5619cd3b22f0 con 0x5619cd44daf0 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5619cd35a270 con 0x5619cd458cb0 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5619cd3ae2b0 con 0x5619cd44e410 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd44ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd44ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58860/0 (socket says 172.21.15.59:58860) 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 -- 172.21.15.59:0/652909479 learned_addr learned my addr 172.21.15.59:0/652909479 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa697fff640 1 --2- 172.21.15.59:0/652909479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 0x5619cd458770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa6957fa640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa6800a2da0 0x7fa6800a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa6977fe640 1 --2- 172.21.15.59:0/652909479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd45b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 -- 172.21.15.59:0/652909479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 msgr2=0x5619cd458770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 --2- 172.21.15.59:0/652909479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 0x5619cd458770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 -- 172.21.15.59:0/652909479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 msgr2=0x5619cd45b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 --2- 172.21.15.59:0/652909479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd45b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 -- 172.21.15.59:0/652909479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619cd359340 con 0x5619cd44daf0 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa6957fa640 1 -- 172.21.15.59:0/4199233898 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fa68c0cf120 con 0x7fa698102470 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa6800a2da0 0x7fa6800a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.603+0000 7fa69cffb640 1 --2- 172.21.15.59:0/652909479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd44ded0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa690009430 tx=0x7fa690005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698bc9008a451027 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa67e7fc640 1 -- 172.21.15.59:0/652909479 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa690031ba0 con 0x5619cd44daf0 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa67e7fc640 1 -- 172.21.15.59:0/652909479 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa690036040 con 0x5619cd44daf0 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa67e7fc640 1 -- 172.21.15.59:0/652909479 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa690030800 con 0x5619cd44daf0 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa6a17f6740 1 -- 172.21.15.59:0/652909479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 msgr2=0x5619cd44ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa69cffb640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa6800a2da0 0x7fa6800a5260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa69004b000 tx=0x7fa690048000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/652909479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd44ded0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa690009430 tx=0x7fa690005fa0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa6a17f6740 1 -- 172.21.15.59:0/652909479 shutdown_connections 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/652909479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd45b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/652909479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 0x5619cd458770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/652909479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd44ded0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa6a17f6740 1 -- 172.21.15.59:0/652909479 >> 172.21.15.59:0/652909479 conn(0x5619cd44a060 msgr2=0x5619cd44a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa6a17f6740 1 -- 172.21.15.59:0/652909479 shutdown_connections 2024-09-10T11:05:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.604+0000 7fa6a17f6740 1 -- 172.21.15.59:0/652909479 wait complete. 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.605+0000 7fa6a17f6740 1 -- start start 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.605+0000 7fa6a17f6740 1 Processor -- start 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.605+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd44daf0 0x5619cd455b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.605+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd456050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.605+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd458cb0 0x5619cd456590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.605+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5619cd45b880 con 0x5619cd44e410 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.605+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5619cd33b290 con 0x5619cd44daf0 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.605+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5619cd45ba00 con 0x5619cd458cb0 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.605+0000 7fa6a17f6740 10 client.0 _ll_register_callbacks cb 0x5619cd36c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd456050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd456050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58872/0 (socket says 172.21.15.59:58872) 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6977fe640 1 -- 172.21.15.59:0/451927821 learned_addr learned my addr 172.21.15.59:0/451927821 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa69cffb640 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd458cb0 0x5619cd456590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa697fff640 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd44daf0 0x5619cd455b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6977fe640 1 -- 172.21.15.59:0/451927821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd458cb0 msgr2=0x5619cd456590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6977fe640 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd458cb0 0x5619cd456590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6977fe640 1 -- 172.21.15.59:0/451927821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd44daf0 msgr2=0x5619cd455b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6977fe640 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd44daf0 0x5619cd455b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6977fe640 1 -- 172.21.15.59:0/451927821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619cd0c5210 con 0x5619cd44e410 2024-09-10T11:05:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6977fe640 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd456050 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa68c097f90 tx=0x7fa68c09b100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bef29c035815a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:22.614 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6777fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:05:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6777fe640 1 -- 172.21.15.59:0/451927821 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c020070 con 0x5619cd44e410 2024-09-10T11:05:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6777fe640 1 -- 172.21.15.59:0/451927821 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fa68c0cca70 con 0x5619cd44e410 2024-09-10T11:05:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.606+0000 7fa6a17f6740 1 -- 172.21.15.59:0/451927821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa690036040 con 0x5619cd44e410 2024-09-10T11:05:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6777fe640 1 -- 172.21.15.59:0/451927821 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa68c0ccc70 con 0x5619cd44e410 2024-09-10T11:05:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6a17f6740 10 client.15561 fetch_fsmap learned FSMap version 25 2024-09-10T11:05:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6a17f6740 1 -- 172.21.15.59:0/451927821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5619cd191620 con 0x5619cd44e410 2024-09-10T11:05:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6777fe640 1 -- 172.21.15.59:0/451927821 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa690036040 con 0x5619cd44e410 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6777fe640 1 -- 172.21.15.59:0/451927821 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa68c0d10c0 con 0x5619cd44e410 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6a17f6740 10 client.15561 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6a17f6740 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6a17f6740 20 client.15561 populate_metadata read hostname 'smithi059' 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5619cd468b70 0x5619cd46afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6a17f6740 4 client.15561 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa6a17f6740 1 -- 172.21.15.59:0/451927821 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619cd3bfa20 con 0x5619cd468b70 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.607+0000 7fa697fff640 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5619cd468b70 0x5619cd46afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.608+0000 7fa697fff640 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5619cd468b70 0x5619cd46afc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42851e4ad8fc2bdd server_cookie=5be827015d126fce in_seq=0 out_seq=0 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.608+0000 7fa6777fe640 10 client.15561 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.608+0000 7fa6777fe640 1 -- 172.21.15.59:0/451927821 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5619cd3bfa20 con 0x5619cd468b70 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.608+0000 7fa6777fe640 10 client.15561 handle_command_reply: tid=0 2024-09-10T11:05:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.608+0000 7fa6a17f6740 1 client.15561 shutdown 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 -- 172.21.15.59:0/451927821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 msgr2=0x5619cd456050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd456050 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa68c097f90 tx=0x7fa68c09b100 comp rx=0 tx=0).stop 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 -- 172.21.15.59:0/451927821 shutdown_connections 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5619cd468b70 0x5619cd46afc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd458cb0 0x5619cd456590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6777fe640 0 client.15561 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd456050 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/451927821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd44daf0 0x5619cd455b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 -- 172.21.15.59:0/451927821 >> 172.21.15.59:0/451927821 conn(0x5619cd44a060 msgr2=0x5619cd4491c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 -- 172.21.15.59:0/451927821 shutdown_connections 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 1 -- 172.21.15.59:0/451927821 wait complete. 2024-09-10T11:05:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.609+0000 7fa6a17f6740 20 client.15561 trim_cache size 0 max 16384 2024-09-10T11:05:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.623+0000 7fa6a17f6740 1 Processor -- start 2024-09-10T11:05:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa6a17f6740 1 -- start start 2024-09-10T11:05:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd4563c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 0x5619cd457a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd4708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa6981b2330 con 0x5619cd44daf0 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa6981afc00 con 0x5619cd458cb0 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa6981ada50 con 0x5619cd44e410 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa697fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd4563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa697fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd4563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58874/0 (socket says 172.21.15.59:58874) 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa697fff640 1 -- 172.21.15.59:0/1135564313 learned_addr learned my addr 172.21.15.59:0/1135564313 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa69cffb640 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd4708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa697fff640 1 -- 172.21.15.59:0/1135564313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 msgr2=0x5619cd457a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa6977fe640 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 0x5619cd457a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa697fff640 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 0x5619cd457a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa697fff640 1 -- 172.21.15.59:0/1135564313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 msgr2=0x5619cd4708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa697fff640 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd4708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa697fff640 1 -- 172.21.15.59:0/1135564313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619cd46b640 con 0x5619cd44daf0 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa69cffb640 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd4708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa6977fe640 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 0x5619cd457a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa697fff640 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd4563c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa688005940 tx=0x7fa68800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6287f4d60dd4389 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.624+0000 7fa67dffb640 1 -- 172.21.15.59:0/1135564313 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688004220 con 0x5619cd44daf0 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa67dffb640 1 -- 172.21.15.59:0/1135564313 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6880043c0 con 0x5619cd44daf0 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa67dffb640 1 -- 172.21.15.59:0/1135564313 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6880035f0 con 0x5619cd44daf0 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 -- 172.21.15.59:0/1135564313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 msgr2=0x5619cd4563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd4563c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa688005940 tx=0x7fa68800b410 comp rx=0 tx=0).stop 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 -- 172.21.15.59:0/1135564313 shutdown_connections 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd4708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44e410 0x5619cd457a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/1135564313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44daf0 0x5619cd4563c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 -- 172.21.15.59:0/1135564313 >> 172.21.15.59:0/1135564313 conn(0x5619cd44a060 msgr2=0x5619cd457370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 -- 172.21.15.59:0/1135564313 shutdown_connections 2024-09-10T11:05:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 -- 172.21.15.59:0/1135564313 wait complete. 2024-09-10T11:05:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.625+0000 7fa6a17f6740 1 -- start start 2024-09-10T11:05:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6a17f6740 1 Processor -- start 2024-09-10T11:05:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44daf0 0x5619cd4610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd4524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6a17f6740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd452a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa6981ae0c0 con 0x5619cd44e410 2024-09-10T11:05:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa6981af530 con 0x5619cd458cb0 2024-09-10T11:05:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6a17f6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa6981ae790 con 0x5619cd44daf0 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6a17f6740 10 client.0 _ll_register_callbacks cb 0x7fa68c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd4524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd4524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58884/0 (socket says 172.21.15.59:58884) 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6977fe640 1 -- 172.21.15.59:0/662089198 learned_addr learned my addr 172.21.15.59:0/662089198 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa697fff640 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44daf0 0x5619cd4610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa69cffb640 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd452a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6977fe640 1 -- 172.21.15.59:0/662089198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44daf0 msgr2=0x5619cd4610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6977fe640 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44daf0 0x5619cd4610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6977fe640 1 -- 172.21.15.59:0/662089198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 msgr2=0x5619cd452a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6977fe640 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd452a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa6977fe640 1 -- 172.21.15.59:0/662089198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619cd452f60 con 0x5619cd44e410 2024-09-10T11:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.626+0000 7fa69cffb640 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd452a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6977fe640 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd4524e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa68c086130 tx=0x7fa68c09b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61da27eaebb723e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6777fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6777fe640 1 -- 172.21.15.59:0/662089198 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c014070 con 0x5619cd44e410 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6777fe640 1 -- 172.21.15.59:0/662089198 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fa68c084b00 con 0x5619cd44e410 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6a17f6740 1 -- 172.21.15.59:0/662089198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6880043c0 con 0x5619cd44e410 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6777fe640 1 -- 172.21.15.59:0/662089198 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa68c09af20 con 0x5619cd44e410 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6a17f6740 10 client.15567 fetch_fsmap learned FSMap version 25 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6a17f6740 1 -- 172.21.15.59:0/662089198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5619cd4d34f0 con 0x5619cd44e410 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6777fe640 1 -- 172.21.15.59:0/662089198 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6880043c0 con 0x5619cd44e410 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6777fe640 1 -- 172.21.15.59:0/662089198 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa68c0afae0 con 0x5619cd44e410 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6a17f6740 10 client.15567 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6a17f6740 10 client.15567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6a17f6740 20 client.15567 populate_metadata read hostname 'smithi059' 2024-09-10T11:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5619cd4d3aa0 0x5619cd4d5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6a17f6740 4 client.15567 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:05:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.627+0000 7fa6a17f6740 1 -- 172.21.15.59:0/662089198 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5619cd3b9d70 con 0x5619cd4d3aa0 2024-09-10T11:05:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.628+0000 7fa697fff640 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5619cd4d3aa0 0x5619cd4d5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.628+0000 7fa697fff640 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5619cd4d3aa0 0x5619cd4d5ec0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e831517e5d5744 server_cookie=3669d7a1e3f0f5f1 in_seq=0 out_seq=0 2024-09-10T11:05:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.628+0000 7fa6777fe640 10 client.15567 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.644+0000 7fa6777fe640 1 -- 172.21.15.59:0/662089198 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5619cd3b9d70 con 0x5619cd4d3aa0 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.644+0000 7fa6777fe640 10 client.15567 handle_command_reply: tid=0 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.644+0000 7fa6a17f6740 1 client.15567 shutdown 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 -- 172.21.15.59:0/662089198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 msgr2=0x5619cd4524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd4524e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa68c086130 tx=0x7fa68c09b230 comp rx=0 tx=0).stop 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 -- 172.21.15.59:0/662089198 shutdown_connections 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5619cd4d3aa0 0x5619cd4d5ec0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5619cd458cb0 0x5619cd452a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5619cd44e410 0x5619cd4524e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6777fe640 0 client.15567 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:22.647 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 --2- 172.21.15.59:0/662089198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5619cd44daf0 0x5619cd4610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.647 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 -- 172.21.15.59:0/662089198 >> 172.21.15.59:0/662089198 conn(0x5619cd44a060 msgr2=0x5619cd44fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:22.647 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 -- 172.21.15.59:0/662089198 shutdown_connections 2024-09-10T11:05:22.647 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 1 -- 172.21.15.59:0/662089198 wait complete. 2024-09-10T11:05:22.647 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa6a17f6740 20 client.15567 trim_cache size 0 max 16384 2024-09-10T11:05:22.647 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:05:22.647 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:05:22.647 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:05:22.647 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:05:22.648 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa69ea5e640 1 -- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa6800a2da0 msgr2=0x7fa6800a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:22.648 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa6800a2da0 0x7fa6800a5260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa69004b000 tx=0x7fa690048000 comp rx=0 tx=0).stop 2024-09-10T11:05:22.648 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa69ea5e640 1 -- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 msgr2=0x7fa698074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:22.649 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.645+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 0x7fa698074a30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00d950 tx=0x7fa68c00de10 comp rx=0 tx=0).stop 2024-09-10T11:05:22.649 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.646+0000 7fa69ea5e640 1 -- 172.21.15.59:0/4199233898 shutdown_connections 2024-09-10T11:05:22.649 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.646+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa698107b70 0x7fa698074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.649 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.646+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa698102470 0x7fa698074a30 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.649 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.646+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa6800a2da0 0x7fa6800a5260 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.649 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.646+0000 7fa69ea5e640 1 --2- 172.21.15.59:0/4199233898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa698101ad0 0x7fa6980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:22.649 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.646+0000 7fa69ea5e640 1 -- 172.21.15.59:0/4199233898 >> 172.21.15.59:0/4199233898 conn(0x7fa6980fd7d0 msgr2=0x7fa6980fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:22.649 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.646+0000 7fa69ea5e640 1 -- 172.21.15.59:0/4199233898 shutdown_connections 2024-09-10T11:05:22.649 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:22.646+0000 7fa69ea5e640 1 -- 172.21.15.59:0/4199233898 wait complete. 2024-09-10T11:05:23.436 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:05:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c[66006]: ignoring --setuser ceph since I am not root 2024-09-10T11:05:23.437 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:05:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c[66006]: ignoring --setgroup ceph since I am not root 2024-09-10T11:05:23.437 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:05:22 smithi181 ceph-mds[66010]: -- 172.21.15.181:0/648603613 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0ecc53c20 con 0x55e0ecc30800 2024-09-10T11:05:23.437 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:05:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c[66006]: starting mds.c at 2024-09-10T11:05:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:23 smithi059 ceph-mon[30978]: pgmap v123: 97 pgs: 97 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-10T11:05:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:23 smithi059 ceph-mon[30978]: daemon mds.c restarted 2024-09-10T11:05:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:23 smithi059 ceph-mon[30978]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T11:05:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:23 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.181:6836/332556001,v1:172.21.15.181:6837/332556001] up:boot 2024-09-10T11:05:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:23 smithi059 ceph-mon[30978]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T11:05:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:23 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:05:24.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:23 smithi181 ceph-mon[35409]: pgmap v123: 97 pgs: 97 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-10T11:05:24.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:23 smithi181 ceph-mon[35409]: daemon mds.c restarted 2024-09-10T11:05:24.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:23 smithi181 ceph-mon[35409]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T11:05:24.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:23 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.181:6836/332556001,v1:172.21.15.181:6837/332556001] up:boot 2024-09-10T11:05:24.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:23 smithi181 ceph-mon[35409]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T11:05:24.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:23 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:05:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:23 smithi115 ceph-mon[34719]: pgmap v123: 97 pgs: 97 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-10T11:05:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:23 smithi115 ceph-mon[34719]: daemon mds.c restarted 2024-09-10T11:05:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:23 smithi115 ceph-mon[34719]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T11:05:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:23 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.181:6836/332556001,v1:172.21.15.181:6837/332556001] up:boot 2024-09-10T11:05:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:23 smithi115 ceph-mon[34719]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T11:05:24.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:23 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:05:26.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:25 smithi059 ceph-mon[30978]: pgmap v125: 97 pgs: 97 active+clean; 1.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-10T11:05:26.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:25 smithi181 ceph-mon[35409]: pgmap v125: 97 pgs: 97 active+clean; 1.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-10T11:05:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:25 smithi115 ceph-mon[34719]: pgmap v125: 97 pgs: 97 active+clean; 1.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-10T11:05:28.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:27 smithi059 ceph-mon[30978]: pgmap v126: 97 pgs: 97 active+clean; 1.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-10T11:05:28.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:27 smithi181 ceph-mon[35409]: pgmap v126: 97 pgs: 97 active+clean; 1.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-10T11:05:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:27 smithi115 ceph-mon[34719]: pgmap v126: 97 pgs: 97 active+clean; 1.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-10T11:05:29.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:28 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:05:29.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:28 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:05:29.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:28 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:05:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:29 smithi059 ceph-mon[30978]: pgmap v127: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-10T11:05:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:05:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:05:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:05:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:29 smithi181 ceph-mon[35409]: pgmap v127: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-10T11:05:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:05:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:05:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:05:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:29 smithi115 ceph-mon[34719]: pgmap v127: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-10T11:05:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:05:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:05:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:05:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:31 smithi059 ceph-mon[30978]: pgmap v128: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-10T11:05:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:31 smithi181 ceph-mon[35409]: pgmap v128: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-10T11:05:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:31 smithi115 ceph-mon[34719]: pgmap v128: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-10T11:05:34.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:33 smithi059 ceph-mon[30978]: pgmap v129: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-10T11:05:34.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:33 smithi181 ceph-mon[35409]: pgmap v129: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-10T11:05:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:33 smithi115 ceph-mon[34719]: pgmap v129: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-10T11:05:35.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.746+0000 7fe3214f1640 1 -- 172.21.15.59:0/3904907373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c101350 msgr2=0x7fe31c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.746+0000 7fe3214f1640 1 --2- 172.21.15.59:0/3904907373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c101350 0x7fe31c10d880 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe314009cd0 tx=0x7fe31402a8e0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.746+0000 7fe3214f1640 1 -- 172.21.15.59:0/3904907373 shutdown_connections 2024-09-10T11:05:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.746+0000 7fe3214f1640 1 --2- 172.21.15.59:0/3904907373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c101350 0x7fe31c10d880 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.746+0000 7fe3214f1640 1 --2- 172.21.15.59:0/3904907373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c1009b0 0x7fe31c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.746+0000 7fe3214f1640 1 --2- 172.21.15.59:0/3904907373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31c1069c0 0x7fe31c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.746+0000 7fe3214f1640 1 -- 172.21.15.59:0/3904907373 >> 172.21.15.59:0/3904907373 conn(0x7fe31c077990 msgr2=0x7fe31c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.746+0000 7fe3214f1640 1 -- 172.21.15.59:0/3904907373 shutdown_connections 2024-09-10T11:05:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.746+0000 7fe3214f1640 1 -- 172.21.15.59:0/3904907373 wait complete. 2024-09-10T11:05:35.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.747+0000 7fe3214f1640 1 Processor -- start 2024-09-10T11:05:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.747+0000 7fe3214f1640 1 -- start start 2024-09-10T11:05:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.747+0000 7fe3214f1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c1009b0 0x7fe31c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.747+0000 7fe3214f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31c101350 0x7fe31c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.747+0000 7fe3214f1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c1069c0 0x7fe31c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.747+0000 7fe3214f1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c110e50 con 0x7fe31c1069c0 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.747+0000 7fe3214f1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c110cd0 con 0x7fe31c1009b0 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.747+0000 7fe3214f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c110fd0 con 0x7fe31c101350 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c1069c0 0x7fe31c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c1069c0 0x7fe31c19cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51794/0 (socket says 172.21.15.59:51794) 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31b7fe640 1 -- 172.21.15.59:0/1215256485 learned_addr learned my addr 172.21.15.59:0/1215256485 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31c101350 0x7fe31c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31affd640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c1009b0 0x7fe31c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31b7fe640 1 -- 172.21.15.59:0/1215256485 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31c101350 msgr2=0x7fe31c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31b7fe640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31c101350 0x7fe31c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31b7fe640 1 -- 172.21.15.59:0/1215256485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c1009b0 msgr2=0x7fe31c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31b7fe640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c1009b0 0x7fe31c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31b7fe640 1 -- 172.21.15.59:0/1215256485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c19d320 con 0x7fe31c1069c0 2024-09-10T11:05:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe31b7fe640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c1069c0 0x7fe31c19cbf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe314033040 tx=0x7fe314031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe303fff640 1 -- 172.21.15.59:0/1215256485 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314004040 con 0x7fe31c1069c0 2024-09-10T11:05:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe303fff640 1 -- 172.21.15.59:0/1215256485 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3140046c0 con 0x7fe31c1069c0 2024-09-10T11:05:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe3214f1640 1 -- 172.21.15.59:0/1215256485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c19d5b0 con 0x7fe31c1069c0 2024-09-10T11:05:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe303fff640 1 -- 172.21.15.59:0/1215256485 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314046480 con 0x7fe31c1069c0 2024-09-10T11:05:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.748+0000 7fe3214f1640 1 -- 172.21.15.59:0/1215256485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c1a4ea0 con 0x7fe31c1069c0 2024-09-10T11:05:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.751+0000 7fe303fff640 1 -- 172.21.15.59:0/1215256485 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe3140305a0 con 0x7fe31c1069c0 2024-09-10T11:05:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.751+0000 7fe32428b740 1 Processor -- start 2024-09-10T11:05:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.751+0000 7fe32428b740 1 -- start start 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.751+0000 7fe32428b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166d9f0 0x5653a166ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.751+0000 7fe32428b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 0x5653a167cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.751+0000 7fe32428b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a167d0c0 0x5653a167f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.751+0000 7fe32428b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5653a15d22f0 con 0x5653a166d9f0 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.751+0000 7fe32428b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5653a157a270 con 0x5653a167d0c0 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.751+0000 7fe32428b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5653a15ce2b0 con 0x5653a166e310 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166d9f0 0x5653a166ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe303fff640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe3040a2da0 0x7fe3040a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166d9f0 0x5653a166ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51804/0 (socket says 172.21.15.59:51804) 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 -- 172.21.15.59:0/2118521068 learned_addr learned my addr 172.21.15.59:0/2118521068 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31affd640 1 --2- 172.21.15.59:0/2118521068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 0x5653a167cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31b7fe640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe3040a2da0 0x7fe3040a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2118521068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a167d0c0 0x5653a167f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe303fff640 1 -- 172.21.15.59:0/1215256485 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fe31402e030 con 0x7fe31c1069c0 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 -- 172.21.15.59:0/2118521068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 msgr2=0x5653a167cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2118521068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 0x5653a167cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 -- 172.21.15.59:0/2118521068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a167d0c0 msgr2=0x5653a167f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2118521068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a167d0c0 0x5653a167f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 -- 172.21.15.59:0/2118521068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653a1579340 con 0x5653a166d9f0 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2118521068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166d9f0 0x5653a166ddd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe310005bc0 tx=0x7fe310009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea5be38ac408891 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe31b7fe640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe3040a2da0 0x7fe3040a5260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe3140bccb0 tx=0x7fe3140dd040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.752+0000 7fe3017fa640 1 -- 172.21.15.59:0/2118521068 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310004030 con 0x5653a166d9f0 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe3017fa640 1 -- 172.21.15.59:0/2118521068 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3100041d0 con 0x5653a166d9f0 2024-09-10T11:05:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe3017fa640 1 -- 172.21.15.59:0/2118521068 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100107b0 con 0x5653a166d9f0 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe32428b740 1 -- 172.21.15.59:0/2118521068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166d9f0 msgr2=0x5653a166ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe32428b740 1 --2- 172.21.15.59:0/2118521068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166d9f0 0x5653a166ddd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe310005bc0 tx=0x7fe310009850 comp rx=0 tx=0).stop 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe32428b740 1 -- 172.21.15.59:0/2118521068 shutdown_connections 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe32428b740 1 --2- 172.21.15.59:0/2118521068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a167d0c0 0x5653a167f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe32428b740 1 --2- 172.21.15.59:0/2118521068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 0x5653a167cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe32428b740 1 --2- 172.21.15.59:0/2118521068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166d9f0 0x5653a166ddd0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe32428b740 1 -- 172.21.15.59:0/2118521068 >> 172.21.15.59:0/2118521068 conn(0x5653a166a060 msgr2=0x5653a166a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe32428b740 1 -- 172.21.15.59:0/2118521068 shutdown_connections 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.753+0000 7fe32428b740 1 -- 172.21.15.59:0/2118521068 wait complete. 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe32428b740 1 -- start start 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe32428b740 1 Processor -- start 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe32428b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166d9f0 0x5653a1679f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.761 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe32428b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 0x5653a167a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe32428b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a167a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe32428b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5653a167fd20 con 0x5653a167d0c0 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe32428b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5653a155b290 con 0x5653a166d9f0 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe32428b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5653a167fea0 con 0x5653a166e310 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe32428b740 10 client.0 _ll_register_callbacks cb 0x5653a158c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a167a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a167a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51806/0 (socket says 172.21.15.59:51806) 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe31a7fc640 1 -- 172.21.15.59:0/3451119347 learned_addr learned my addr 172.21.15.59:0/3451119347 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166d9f0 0x5653a1679f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.754+0000 7fe31affd640 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 0x5653a167a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe31a7fc640 1 -- 172.21.15.59:0/3451119347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 msgr2=0x5653a167a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 0x5653a167a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe31a7fc640 1 -- 172.21.15.59:0/3451119347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166d9f0 msgr2=0x5653a1679f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166d9f0 0x5653a1679f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe31a7fc640 1 -- 172.21.15.59:0/3451119347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653a12e5210 con 0x5653a167d0c0 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a167a9b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe310003b70 tx=0x7fe310003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8879aecbb8177b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe2feff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe2feff5640 1 -- 172.21.15.59:0/3451119347 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310021070 con 0x5653a167d0c0 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe2feff5640 1 -- 172.21.15.59:0/3451119347 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fe310004440 con 0x5653a167d0c0 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe32428b740 1 -- 172.21.15.59:0/3451119347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3100041d0 con 0x5653a167d0c0 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe2feff5640 1 -- 172.21.15.59:0/3451119347 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe310032050 con 0x5653a167d0c0 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe32428b740 10 client.15585 fetch_fsmap learned FSMap version 26 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe32428b740 1 -- 172.21.15.59:0/3451119347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5653a13b1620 con 0x5653a167d0c0 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe2feff5640 1 -- 172.21.15.59:0/3451119347 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3100041d0 con 0x5653a167d0c0 2024-09-10T11:05:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.755+0000 7fe2feff5640 1 -- 172.21.15.59:0/3451119347 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe31002c020 con 0x5653a167d0c0 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.756+0000 7fe32428b740 10 client.15585 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.756+0000 7fe32428b740 10 client.15585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.756+0000 7fe32428b740 20 client.15585 populate_metadata read hostname 'smithi059' 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.756+0000 7fe32428b740 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5653a168d020 0x5653a168f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.756+0000 7fe32428b740 4 client.15585 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.756+0000 7fe32428b740 1 -- 172.21.15.59:0/3451119347 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653a15dfa20 con 0x5653a168d020 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.756+0000 7fe31affd640 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5653a168d020 0x5653a168f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.756+0000 7fe2feff5640 10 client.15585 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.756+0000 7fe31affd640 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5653a168d020 0x5653a168f410 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c85b5920a91874b server_cookie=eb3bc3ab146ad3db in_seq=0 out_seq=0 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe2feff5640 1 -- 172.21.15.59:0/3451119347 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653a15dfa20 con 0x5653a168d020 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe2feff5640 10 client.15585 handle_command_reply: tid=0 2024-09-10T11:05:35.764 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe32428b740 1 client.15585 shutdown 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe32428b740 1 -- 172.21.15.59:0/3451119347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 msgr2=0x5653a167a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe32428b740 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a167a9b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe310003b70 tx=0x7fe310003f10 comp rx=0 tx=0).stop 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe32428b740 1 -- 172.21.15.59:0/3451119347 shutdown_connections 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe32428b740 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5653a168d020 0x5653a168f410 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe32428b740 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a167a9b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe2feff5640 0 client.15585 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe32428b740 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166e310 0x5653a167a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe32428b740 1 --2- 172.21.15.59:0/3451119347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166d9f0 0x5653a1679f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.757+0000 7fe32428b740 1 -- 172.21.15.59:0/3451119347 >> 172.21.15.59:0/3451119347 conn(0x5653a166a060 msgr2=0x5653a166fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.758+0000 7fe32428b740 1 -- 172.21.15.59:0/3451119347 shutdown_connections 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.758+0000 7fe32428b740 1 -- 172.21.15.59:0/3451119347 wait complete. 2024-09-10T11:05:35.765 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.758+0000 7fe32428b740 20 client.15585 trim_cache size 0 max 16384 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe32428b740 1 Processor -- start 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe32428b740 1 -- start start 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe32428b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 0x5653a1694b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe32428b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166e310 0x5653a16950c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe32428b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a167d0c0 0x5653a1677170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe32428b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c1ade70 con 0x5653a166e310 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe32428b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c1ab740 con 0x5653a167d0c0 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe32428b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c1a9590 con 0x5653a166d9f0 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe31affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166e310 0x5653a16950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe31affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166e310 0x5653a16950c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51812/0 (socket says 172.21.15.59:51812) 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.772+0000 7fe31affd640 1 -- 172.21.15.59:0/2316286817 learned_addr learned my addr 172.21.15.59:0/2316286817 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2316286817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 0x5653a1694b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe31affd640 1 -- 172.21.15.59:0/2316286817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 msgr2=0x5653a1694b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe31affd640 1 --2- 172.21.15.59:0/2316286817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 0x5653a1694b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe31affd640 1 -- 172.21.15.59:0/2316286817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a167d0c0 msgr2=0x5653a1677170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe31affd640 1 --2- 172.21.15.59:0/2316286817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a167d0c0 0x5653a1677170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe31affd640 1 -- 172.21.15.59:0/2316286817 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653a1669e90 con 0x5653a166e310 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2316286817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 0x5653a1694b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe31affd640 1 --2- 172.21.15.59:0/2316286817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166e310 0x5653a16950c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00b760 tx=0x7fe30c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74f3c60e8d0d671 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe300ff9640 1 -- 172.21.15.59:0/2316286817 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c003d80 con 0x5653a166e310 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe300ff9640 1 -- 172.21.15.59:0/2316286817 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe30c011920 con 0x5653a166e310 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.773+0000 7fe300ff9640 1 -- 172.21.15.59:0/2316286817 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c01d950 con 0x5653a166e310 2024-09-10T11:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 -- 172.21.15.59:0/2316286817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166e310 msgr2=0x5653a16950c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 --2- 172.21.15.59:0/2316286817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166e310 0x5653a16950c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00b760 tx=0x7fe30c00b390 comp rx=0 tx=0).stop 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 -- 172.21.15.59:0/2316286817 shutdown_connections 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 --2- 172.21.15.59:0/2316286817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a167d0c0 0x5653a1677170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 --2- 172.21.15.59:0/2316286817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a166e310 0x5653a16950c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 --2- 172.21.15.59:0/2316286817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 0x5653a1694b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 -- 172.21.15.59:0/2316286817 >> 172.21.15.59:0/2316286817 conn(0x5653a166a060 msgr2=0x5653a167bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 -- 172.21.15.59:0/2316286817 shutdown_connections 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 -- 172.21.15.59:0/2316286817 wait complete. 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 -- start start 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 Processor -- start 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 0x5653a1681150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166e310 0x5653a1681690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a1681bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c1a9c00 con 0x5653a167d0c0 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c1ab070 con 0x5653a166e310 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c1aa2d0 con 0x5653a166d9f0 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe32428b740 10 client.0 _ll_register_callbacks cb 0x7fe30c00b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.774+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a1681bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a1681bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51814/0 (socket says 172.21.15.59:51814) 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31a7fc640 1 -- 172.21.15.59:0/2981946412 learned_addr learned my addr 172.21.15.59:0/2981946412 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 0x5653a1681150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31affd640 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166e310 0x5653a1681690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31a7fc640 1 -- 172.21.15.59:0/2981946412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 msgr2=0x5653a1681150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 0x5653a1681150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31a7fc640 1 -- 172.21.15.59:0/2981946412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166e310 msgr2=0x5653a1681690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166e310 0x5653a1681690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31a7fc640 1 -- 172.21.15.59:0/2981946412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653a1674d50 con 0x5653a167d0c0 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31affd640 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166e310 0x5653a1681690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe31a7fc640 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a1681bd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe310013d40 tx=0x7fe310009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386c8f0f5c970628 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe2feff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe2feff5640 1 -- 172.21.15.59:0/2981946412 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310021040 con 0x5653a167d0c0 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe2feff5640 1 -- 172.21.15.59:0/2981946412 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fe31001dbe0 con 0x5653a167d0c0 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe32428b740 1 -- 172.21.15.59:0/2981946412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe30c011920 con 0x5653a167d0c0 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe2feff5640 1 -- 172.21.15.59:0/2981946412 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe310009a80 con 0x5653a167d0c0 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe32428b740 10 client.15591 fetch_fsmap learned FSMap version 26 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.775+0000 7fe32428b740 1 -- 172.21.15.59:0/2981946412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5653a166eac0 con 0x5653a167d0c0 2024-09-10T11:05:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.776+0000 7fe2feff5640 1 -- 172.21.15.59:0/2981946412 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe30c011920 con 0x5653a167d0c0 2024-09-10T11:05:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.776+0000 7fe2feff5640 1 -- 172.21.15.59:0/2981946412 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe31002c050 con 0x5653a167d0c0 2024-09-10T11:05:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.776+0000 7fe32428b740 10 client.15591 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:05:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.776+0000 7fe32428b740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:05:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.776+0000 7fe32428b740 20 client.15591 populate_metadata read hostname 'smithi059' 2024-09-10T11:05:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.776+0000 7fe32428b740 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5653a16f82e0 0x5653a16fa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.776+0000 7fe32428b740 4 client.15591 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:05:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.776+0000 7fe32428b740 1 -- 172.21.15.59:0/2981946412 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5653a15d9d70 con 0x5653a16f82e0 2024-09-10T11:05:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.776+0000 7fe31affd640 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5653a16f82e0 0x5653a16fa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.777+0000 7fe31affd640 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5653a16f82e0 0x5653a16fa6d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f44619687b4dc60 server_cookie=c158293080931055 in_seq=0 out_seq=0 2024-09-10T11:05:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.777+0000 7fe2feff5640 10 client.15591 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe2feff5640 1 -- 172.21.15.59:0/2981946412 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5653a15d9d70 con 0x5653a16f82e0 2024-09-10T11:05:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe2feff5640 10 client.15591 handle_command_reply: tid=0 2024-09-10T11:05:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 client.15591 shutdown 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 -- 172.21.15.59:0/2981946412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 msgr2=0x5653a1681bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a1681bd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe310013d40 tx=0x7fe310009f90 comp rx=0 tx=0).stop 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 -- 172.21.15.59:0/2981946412 shutdown_connections 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5653a16f82e0 0x5653a16fa6d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653a167d0c0 0x5653a1681bd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653a166e310 0x5653a1681690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe2feff5640 0 client.15591 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 --2- 172.21.15.59:0/2981946412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653a166d9f0 0x5653a1681150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 -- 172.21.15.59:0/2981946412 >> 172.21.15.59:0/2981946412 conn(0x5653a166a060 msgr2=0x5653a1679ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 -- 172.21.15.59:0/2981946412 shutdown_connections 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 1 -- 172.21.15.59:0/2981946412 wait complete. 2024-09-10T11:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.791+0000 7fe32428b740 20 client.15591 trim_cache size 0 max 16384 2024-09-10T11:05:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:05:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:05:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:05:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 -- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe3040a2da0 msgr2=0x7fe3040a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe3040a2da0 0x7fe3040a5260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe3140bccb0 tx=0x7fe3140dd040 comp rx=0 tx=0).stop 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 -- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c1069c0 msgr2=0x7fe31c19cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c1069c0 0x7fe31c19cbf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe314033040 tx=0x7fe314031e60 comp rx=0 tx=0).stop 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 -- 172.21.15.59:0/1215256485 shutdown_connections 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c1069c0 0x7fe31c19cbf0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe3040a2da0 0x7fe3040a5260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe31c101350 0x7fe31c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 --2- 172.21.15.59:0/1215256485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31c1009b0 0x7fe31c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 -- 172.21.15.59:0/1215256485 >> 172.21.15.59:0/1215256485 conn(0x7fe31c077990 msgr2=0x7fe31c0699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 -- 172.21.15.59:0/1215256485 shutdown_connections 2024-09-10T11:05:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:35.792+0000 7fe3214f1640 1 -- 172.21.15.59:0/1215256485 wait complete. 2024-09-10T11:05:36.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:35 smithi059 ceph-mon[30978]: pgmap v130: 97 pgs: 97 active+clean; 1.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-10T11:05:36.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:35 smithi181 ceph-mon[35409]: pgmap v130: 97 pgs: 97 active+clean; 1.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-10T11:05:36.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:35 smithi115 ceph-mon[34719]: pgmap v130: 97 pgs: 97 active+clean; 1.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-10T11:05:38.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:37 smithi059 ceph-mon[30978]: pgmap v131: 97 pgs: 97 active+clean; 1.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-10T11:05:38.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:37 smithi181 ceph-mon[35409]: pgmap v131: 97 pgs: 97 active+clean; 1.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-10T11:05:38.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:37 smithi115 ceph-mon[34719]: pgmap v131: 97 pgs: 97 active+clean; 1.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-10T11:05:39.317 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.317 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.317 INFO:tasks.workunit.client.0.smithi059.stdout:127/600: open fd = 3 2024-09-10T11:05:39.317 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.317 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.317 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:128/600: open fd = 3 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:129/600: open fd = 3 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:130/600: open fd = 3 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.318 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:131/600: open fd = 3 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:132/600: open fd = 3 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:133/600: open fd = 3 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.319 INFO:tasks.workunit.client.0.smithi059.stdout:134/600: open fd = 3 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:135/600: open fd = 3 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:136/600: open fd = 3 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:137/600: open fd = 3 2024-09-10T11:05:39.320 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:138/600: open fd = 3 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:139/600: open fd = 3 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:140/600: open fd = 3 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.321 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:141/600: open fd = 3 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:142/600: open fd = 3 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:143/600: open fd = 3 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:144/600: open fd = 3 2024-09-10T11:05:39.322 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:145/600: open fd = 3 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:146/600: open fd = 3 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:147/600: open fd = 3 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.323 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:148/600: open fd = 3 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:149/600: open fd = 3 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:150/600: open fd = 3 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.324 INFO:tasks.workunit.client.0.smithi059.stdout:151/600: open fd = 3 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:152/600: open fd = 3 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:153/600: open fd = 3 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:154/600: open fd = 3 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.325 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:155/600: open fd = 3 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:156/600: open fd = 3 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:157/600: open fd = 3 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.326 INFO:tasks.workunit.client.0.smithi059.stdout:158/600: open fd = 3 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:159/600: open fd = 3 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:160/600: open fd = 3 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:161/600: open fd = 3 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.327 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:162/600: open fd = 3 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:163/600: open fd = 3 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:164/600: open fd = 3 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.328 INFO:tasks.workunit.client.0.smithi059.stdout:165/600: open fd = 3 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:166/600: open fd = 3 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:167/600: open fd = 3 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:168/600: open fd = 3 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:169/600: open fd = 3 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:170/600: open fd = 3 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:171/600: open fd = 3 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.330 INFO:tasks.workunit.client.0.smithi059.stdout:172/600: open fd = 3 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:173/600: open fd = 3 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:174/600: open fd = 3 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:175/600: open fd = 3 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.331 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:176/600: open fd = 3 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:177/600: open fd = 3 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:178/600: open fd = 3 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.332 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:179/600: open fd = 3 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:180/600: open fd = 3 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:181/600: open fd = 3 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:182/600: open fd = 3 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:183/600: open fd = 3 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:184/600: open fd = 3 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:185/600: open fd = 3 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:186/600: open fd = 3 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:187/600: open fd = 3 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:05:39.335 INFO:tasks.workunit.client.0.smithi059.stdout:188/600: open fd = 3 2024-09-10T11:05:39.336 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:39.336 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:05:40.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:39 smithi059 ceph-mon[30978]: pgmap v132: 97 pgs: 97 active+clean; 1.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-10T11:05:40.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:39 smithi181 ceph-mon[35409]: pgmap v132: 97 pgs: 97 active+clean; 1.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-10T11:05:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:39 smithi115 ceph-mon[34719]: pgmap v132: 97 pgs: 97 active+clean; 1.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-10T11:05:42.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:41 smithi059 ceph-mon[30978]: pgmap v133: 97 pgs: 97 active+clean; 1.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-10T11:05:42.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:41 smithi181 ceph-mon[35409]: pgmap v133: 97 pgs: 97 active+clean; 1.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-10T11:05:42.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:41 smithi115 ceph-mon[34719]: pgmap v133: 97 pgs: 97 active+clean; 1.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-10T11:05:43.942 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:43 smithi059 ceph-mon[30978]: pgmap v134: 97 pgs: 97 active+clean; 1.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-10T11:05:44.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:43 smithi181 ceph-mon[35409]: pgmap v134: 97 pgs: 97 active+clean; 1.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-10T11:05:44.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:43 smithi115 ceph-mon[34719]: pgmap v134: 97 pgs: 97 active+clean; 1.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-10T11:05:46.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:45 smithi059 ceph-mon[30978]: pgmap v135: 97 pgs: 97 active+clean; 1.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-09-10T11:05:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:45 smithi181 ceph-mon[35409]: pgmap v135: 97 pgs: 97 active+clean; 1.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-09-10T11:05:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:45 smithi115 ceph-mon[34719]: pgmap v135: 97 pgs: 97 active+clean; 1.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-09-10T11:05:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:47 smithi059 ceph-mon[30978]: pgmap v136: 97 pgs: 97 active+clean; 1.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-10T11:05:48.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:47 smithi181 ceph-mon[35409]: pgmap v136: 97 pgs: 97 active+clean; 1.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-10T11:05:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:47 smithi115 ceph-mon[34719]: pgmap v136: 97 pgs: 97 active+clean; 1.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-10T11:05:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.891+0000 7f0739931640 1 -- 172.21.15.59:0/2154809479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07341048f0 msgr2=0x7f0734108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.891+0000 7f0739931640 1 --2- 172.21.15.59:0/2154809479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07341048f0 0x7f0734108930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0728009900 tx=0x7f072802a410 comp rx=0 tx=0).stop 2024-09-10T11:05:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.891+0000 7f0739931640 1 -- 172.21.15.59:0/2154809479 shutdown_connections 2024-09-10T11:05:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.891+0000 7f0739931640 1 --2- 172.21.15.59:0/2154809479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0734109090 0x7f0734110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.891+0000 7f0739931640 1 --2- 172.21.15.59:0/2154809479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07341048f0 0x7f0734108930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.891+0000 7f0739931640 1 --2- 172.21.15.59:0/2154809479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0734103f40 0x7f0734104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.891+0000 7f0739931640 1 -- 172.21.15.59:0/2154809479 >> 172.21.15.59:0/2154809479 conn(0x7f07340ff9b0 msgr2=0x7f0734101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.891+0000 7f0739931640 1 -- 172.21.15.59:0/2154809479 shutdown_connections 2024-09-10T11:05:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.891+0000 7f0739931640 1 -- 172.21.15.59:0/2154809479 wait complete. 2024-09-10T11:05:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0739931640 1 Processor -- start 2024-09-10T11:05:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0739931640 1 -- start start 2024-09-10T11:05:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0739931640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0734103f40 0x7f073419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0739931640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0734109090 0x7f073419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0739931640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f073419ee30 0x7f073419f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0739931640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f07341140b0 con 0x7f0734103f40 2024-09-10T11:05:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0739931640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0734113f30 con 0x7f073419ee30 2024-09-10T11:05:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0739931640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0734114230 con 0x7f0734109090 2024-09-10T11:05:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0734103f40 0x7f073419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0734103f40 0x7f073419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40290/0 (socket says 172.21.15.59:40290) 2024-09-10T11:05:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.892+0000 7f0732ffd640 1 -- 172.21.15.59:0/4184829944 learned_addr learned my addr 172.21.15.59:0/4184829944 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f07327fc640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0734109090 0x7f073419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f07337fe640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f073419ee30 0x7f073419f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f0732ffd640 1 -- 172.21.15.59:0/4184829944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0734109090 msgr2=0x7f073419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f0732ffd640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0734109090 0x7f073419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f0732ffd640 1 -- 172.21.15.59:0/4184829944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f073419ee30 msgr2=0x7f073419f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f0732ffd640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f073419ee30 0x7f073419f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f0732ffd640 1 -- 172.21.15.59:0/4184829944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073419f920 con 0x7f0734103f40 2024-09-10T11:05:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f07337fe640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f073419ee30 0x7f073419f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:05:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f0732ffd640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0734103f40 0x7f073419a570 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f072400d950 tx=0x7f072400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f073892f640 1 -- 172.21.15.59:0/4184829944 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724017030 con 0x7f0734103f40 2024-09-10T11:05:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f073892f640 1 -- 172.21.15.59:0/4184829944 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0724004020 con 0x7f0734103f40 2024-09-10T11:05:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f073892f640 1 -- 172.21.15.59:0/4184829944 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07240047a0 con 0x7f0734103f40 2024-09-10T11:05:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f0739931640 1 -- 172.21.15.59:0/4184829944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073419fc10 con 0x7f0734103f40 2024-09-10T11:05:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.893+0000 7f0739931640 1 -- 172.21.15.59:0/4184829944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07341a7420 con 0x7f0734103f40 2024-09-10T11:05:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.895+0000 7f073892f640 1 -- 172.21.15.59:0/4184829944 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f07240041d0 con 0x7f0734103f40 2024-09-10T11:05:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f073c6d2740 1 Processor -- start 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f073c6d2740 1 -- start start 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4228af0 0x55eff4228ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4229410 0x55eff4233770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 0x55eff42360a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f073c6d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eff418d2f0 con 0x55eff4228af0 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f073c6d2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eff4135270 con 0x55eff4229410 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f073c6d2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eff41892b0 con 0x55eff4233cb0 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f07337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4228af0 0x55eff4228ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f07337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4228af0 0x55eff4228ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40292/0 (socket says 172.21.15.59:40292) 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f07337fe640 1 -- 172.21.15.59:0/711858595 learned_addr learned my addr 172.21.15.59:0/711858595 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f07327fc640 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 0x55eff42360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f0732ffd640 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4229410 0x55eff4233770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.896+0000 7f073892f640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f071c0a2e20 0x7f071c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f07337fe640 1 -- 172.21.15.59:0/711858595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 msgr2=0x55eff42360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f07337fe640 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 0x55eff42360a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f07337fe640 1 -- 172.21.15.59:0/711858595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4229410 msgr2=0x55eff4233770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f07337fe640 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4229410 0x55eff4233770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f07337fe640 1 -- 172.21.15.59:0/711858595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff4134340 con 0x55eff4228af0 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f0732ffd640 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4229410 0x55eff4233770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f07337fe640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f071c0a2e20 0x7f071c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f073892f640 1 -- 172.21.15.59:0/4184829944 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f07240ceef0 con 0x7f0734103f40 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f07337fe640 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4228af0 0x55eff4228ed0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f072c00f3e0 tx=0x7f072c00f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70ee7cccaf05558 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f0719ffb640 1 -- 172.21.15.59:0/711858595 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c01c400 con 0x55eff4228af0 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f0719ffb640 1 -- 172.21.15.59:0/711858595 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f072c01ca80 con 0x55eff4228af0 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.897+0000 7f0719ffb640 1 -- 172.21.15.59:0/711858595 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c01b800 con 0x55eff4228af0 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 -- 172.21.15.59:0/711858595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4228af0 msgr2=0x55eff4228ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f07337fe640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f071c0a2e20 0x7f071c0a52e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f072c020000 tx=0x7f072c01d000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4228af0 0x55eff4228ed0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f072c00f3e0 tx=0x7f072c00f7e0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 -- 172.21.15.59:0/711858595 shutdown_connections 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 0x55eff42360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4229410 0x55eff4233770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 --2- 172.21.15.59:0/711858595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4228af0 0x55eff4228ed0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 -- 172.21.15.59:0/711858595 >> 172.21.15.59:0/711858595 conn(0x55eff4225060 msgr2=0x55eff4225440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 -- 172.21.15.59:0/711858595 shutdown_connections 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 -- 172.21.15.59:0/711858595 wait complete. 2024-09-10T11:05:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.898+0000 7f073c6d2740 1 -- start start 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f073c6d2740 1 Processor -- start 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4228af0 0x55eff4230b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff42310c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4233cb0 0x55eff4231600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f073c6d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eff4236880 con 0x55eff4229410 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f073c6d2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eff4116290 con 0x55eff4233cb0 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f073c6d2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eff4236a00 con 0x55eff4228af0 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f073c6d2740 10 client.0 _ll_register_callbacks cb 0x55eff4147140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07327fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff42310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07327fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff42310c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40294/0 (socket says 172.21.15.59:40294) 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07327fc640 1 -- 172.21.15.59:0/3170170021 learned_addr learned my addr 172.21.15.59:0/3170170021 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07337fe640 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4233cb0 0x55eff4231600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f0732ffd640 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4228af0 0x55eff4230b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07327fc640 1 -- 172.21.15.59:0/3170170021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4228af0 msgr2=0x55eff4230b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07327fc640 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4228af0 0x55eff4230b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07327fc640 1 -- 172.21.15.59:0/3170170021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4233cb0 msgr2=0x55eff4231600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07327fc640 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4233cb0 0x55eff4231600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07327fc640 1 -- 172.21.15.59:0/3170170021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff3ea0210 con 0x55eff4229410 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f0732ffd640 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4228af0 0x55eff4230b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.899+0000 7f07337fe640 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4233cb0 0x55eff4231600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f07327fc640 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff42310c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0728009900 tx=0x7f07280317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e101049b8faaa062 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f0712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f0712ffd640 1 -- 172.21.15.59:0/3170170021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728035040 con 0x55eff4229410 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f073c6d2740 1 -- 172.21.15.59:0/3170170021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f072c01ca80 con 0x55eff4229410 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f0712ffd640 1 -- 172.21.15.59:0/3170170021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f0728004460 con 0x55eff4229410 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f0712ffd640 1 -- 172.21.15.59:0/3170170021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0728005030 con 0x55eff4229410 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f073c6d2740 10 client.15603 fetch_fsmap learned FSMap version 26 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f073c6d2740 1 -- 172.21.15.59:0/3170170021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eff3f6c620 con 0x55eff4229410 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f0712ffd640 1 -- 172.21.15.59:0/3170170021 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f072c01ca80 con 0x55eff4229410 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f0712ffd640 1 -- 172.21.15.59:0/3170170021 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f07280035f0 con 0x55eff4229410 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f073c6d2740 10 client.15603 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f073c6d2740 10 client.15603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f073c6d2740 20 client.15603 populate_metadata read hostname 'smithi059' 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f073c6d2740 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eff4243c60 0x55eff4246050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f073c6d2740 4 client.15603 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.900+0000 7f073c6d2740 1 -- 172.21.15.59:0/3170170021 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eff419aa20 con 0x55eff4243c60 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.901+0000 7f0732ffd640 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eff4243c60 0x55eff4246050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.901+0000 7f0712ffd640 10 client.15603 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.901+0000 7f0732ffd640 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eff4243c60 0x55eff4246050 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e340fdfef2c6624e server_cookie=b6c0f05e8ec89f77 in_seq=0 out_seq=0 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f0712ffd640 1 -- 172.21.15.59:0/3170170021 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eff419aa20 con 0x55eff4243c60 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f0712ffd640 10 client.15603 handle_command_reply: tid=0 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 client.15603 shutdown 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 -- 172.21.15.59:0/3170170021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 msgr2=0x55eff42310c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff42310c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0728009900 tx=0x7f07280317e0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 -- 172.21.15.59:0/3170170021 shutdown_connections 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eff4243c60 0x55eff4246050 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4233cb0 0x55eff4231600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f0712ffd640 0 client.15603 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff42310c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 --2- 172.21.15.59:0/3170170021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4228af0 0x55eff4230b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 -- 172.21.15.59:0/3170170021 >> 172.21.15.59:0/3170170021 conn(0x55eff4225060 msgr2=0x55eff422adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 -- 172.21.15.59:0/3170170021 shutdown_connections 2024-09-10T11:05:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 1 -- 172.21.15.59:0/3170170021 wait complete. 2024-09-10T11:05:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.902+0000 7f073c6d2740 20 client.15603 trim_cache size 0 max 16384 2024-09-10T11:05:48.920 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f073c6d2740 1 Processor -- start 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f073c6d2740 1 -- start start 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 0x55eff422b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4229410 0x55eff4231430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4233cb0 0x55eff424b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f073c6d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f07341b2460 con 0x55eff4233cb0 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f073c6d2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f07341afd30 con 0x55eff4228af0 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f073c6d2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f07341adb80 con 0x55eff4229410 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f07337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4233cb0 0x55eff424b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f07337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4233cb0 0x55eff424b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40300/0 (socket says 172.21.15.59:40300) 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f07337fe640 1 -- 172.21.15.59:0/1185981651 learned_addr learned my addr 172.21.15.59:0/1185981651 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f0732ffd640 1 --2- 172.21.15.59:0/1185981651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 0x55eff422b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f07327fc640 1 --2- 172.21.15.59:0/1185981651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4229410 0x55eff4231430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f07337fe640 1 -- 172.21.15.59:0/1185981651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4229410 msgr2=0x55eff4231430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f07337fe640 1 --2- 172.21.15.59:0/1185981651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4229410 0x55eff4231430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f07337fe640 1 -- 172.21.15.59:0/1185981651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 msgr2=0x55eff422b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f07337fe640 1 --2- 172.21.15.59:0/1185981651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 0x55eff422b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.917+0000 7f07337fe640 1 -- 172.21.15.59:0/1185981651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff4228920 con 0x55eff4233cb0 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f07337fe640 1 --2- 172.21.15.59:0/1185981651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4233cb0 0x55eff424b9b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f072c00f380 tx=0x7f072c027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a66ffd236e40bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f07197fa640 1 -- 172.21.15.59:0/1185981651 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c01bb20 con 0x55eff4233cb0 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f07197fa640 1 -- 172.21.15.59:0/1185981651 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f072c035070 con 0x55eff4233cb0 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f07197fa640 1 -- 172.21.15.59:0/1185981651 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c01b7c0 con 0x55eff4233cb0 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f073c6d2740 1 -- 172.21.15.59:0/1185981651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4233cb0 msgr2=0x55eff424b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f073c6d2740 1 --2- 172.21.15.59:0/1185981651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4233cb0 0x55eff424b9b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f072c00f380 tx=0x7f072c027000 comp rx=0 tx=0).stop 2024-09-10T11:05:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f073c6d2740 1 -- 172.21.15.59:0/1185981651 shutdown_connections 2024-09-10T11:05:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f073c6d2740 1 --2- 172.21.15.59:0/1185981651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4233cb0 0x55eff424b9b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f073c6d2740 1 --2- 172.21.15.59:0/1185981651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4229410 0x55eff4231430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f073c6d2740 1 --2- 172.21.15.59:0/1185981651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 0x55eff422b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.918+0000 7f073c6d2740 1 -- 172.21.15.59:0/1185981651 >> 172.21.15.59:0/1185981651 conn(0x55eff4225060 msgr2=0x55eff4232c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 -- 172.21.15.59:0/1185981651 shutdown_connections 2024-09-10T11:05:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 -- 172.21.15.59:0/1185981651 wait complete. 2024-09-10T11:05:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 -- start start 2024-09-10T11:05:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 Processor -- start 2024-09-10T11:05:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 0x55eff423be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff423c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 0x55eff422d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f07341ae1f0 con 0x55eff4229410 2024-09-10T11:05:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f07341af660 con 0x55eff4228af0 2024-09-10T11:05:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f07341ae8c0 con 0x55eff4233cb0 2024-09-10T11:05:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.919+0000 7f073c6d2740 10 client.0 _ll_register_callbacks cb 0x7f0728009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:05:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07327fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff423c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07327fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff423c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40310/0 (socket says 172.21.15.59:40310) 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07327fc640 1 -- 172.21.15.59:0/546398190 learned_addr learned my addr 172.21.15.59:0/546398190 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f0732ffd640 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 0x55eff423be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07337fe640 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 0x55eff422d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07327fc640 1 -- 172.21.15.59:0/546398190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 msgr2=0x55eff422d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07327fc640 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 0x55eff422d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07327fc640 1 -- 172.21.15.59:0/546398190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 msgr2=0x55eff423be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07327fc640 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 0x55eff423be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07327fc640 1 -- 172.21.15.59:0/546398190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff42202d0 con 0x55eff4229410 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07337fe640 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 0x55eff422d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f0732ffd640 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 0x55eff423be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f07327fc640 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff423c3c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0728000c00 tx=0x7f0728004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc6fd68633418bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:05:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f0712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f0712ffd640 1 -- 172.21.15.59:0/546398190 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728035030 con 0x55eff4229410 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f0712ffd640 1 -- 172.21.15.59:0/546398190 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f0728003e30 con 0x55eff4229410 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f073c6d2740 1 -- 172.21.15.59:0/546398190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f072c035070 con 0x55eff4229410 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f0712ffd640 1 -- 172.21.15.59:0/546398190 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0728051070 con 0x55eff4229410 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f073c6d2740 10 client.15609 fetch_fsmap learned FSMap version 26 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.920+0000 7f073c6d2740 1 -- 172.21.15.59:0/546398190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eff42ae2b0 con 0x55eff4229410 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f0712ffd640 1 -- 172.21.15.59:0/546398190 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f072c035070 con 0x55eff4229410 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f0712ffd640 1 -- 172.21.15.59:0/546398190 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f07280053f0 con 0x55eff4229410 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f073c6d2740 10 client.15609 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f073c6d2740 10 client.15609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f073c6d2740 20 client.15609 populate_metadata read hostname 'smithi059' 2024-09-10T11:05:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f073c6d2740 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eff42aea20 0x55eff42b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:05:48.929 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f073c6d2740 4 client.15609 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:05:48.929 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f073c6d2740 1 -- 172.21.15.59:0/546398190 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eff4194d70 con 0x55eff42aea20 2024-09-10T11:05:48.929 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f0732ffd640 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eff42aea20 0x55eff42b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:05:48.929 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f0712ffd640 10 client.15609 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:48.929 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.921+0000 7f0732ffd640 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eff42aea20 0x55eff42b0e40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d54d9afc5ee17be server_cookie=8808771327637b92 in_seq=0 out_seq=0 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.935+0000 7f0712ffd640 1 -- 172.21.15.59:0/546398190 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eff4194d70 con 0x55eff42aea20 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.935+0000 7f0712ffd640 10 client.15609 handle_command_reply: tid=0 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.935+0000 7f073c6d2740 1 client.15609 shutdown 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.935+0000 7f073c6d2740 1 -- 172.21.15.59:0/546398190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 msgr2=0x55eff423c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.935+0000 7f073c6d2740 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff423c3c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0728000c00 tx=0x7f0728004fb0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f073c6d2740 1 -- 172.21.15.59:0/546398190 shutdown_connections 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f073c6d2740 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eff42aea20 0x55eff42b0e40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f073c6d2740 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eff4233cb0 0x55eff422d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f073c6d2740 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eff4229410 0x55eff423c3c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0712ffd640 0 client.15609 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f073c6d2740 1 --2- 172.21.15.59:0/546398190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eff4228af0 0x55eff423be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f073c6d2740 1 -- 172.21.15.59:0/546398190 >> 172.21.15.59:0/546398190 conn(0x55eff4225060 msgr2=0x55eff423eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f073c6d2740 1 -- 172.21.15.59:0/546398190 shutdown_connections 2024-09-10T11:05:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f073c6d2740 1 -- 172.21.15.59:0/546398190 wait complete. 2024-09-10T11:05:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f073c6d2740 20 client.15609 trim_cache size 0 max 16384 2024-09-10T11:05:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:05:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:05:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:05:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:05:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 -- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f071c0a2e20 msgr2=0x7f071c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f071c0a2e20 0x7f071c0a52e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f072c020000 tx=0x7f072c01d000 comp rx=0 tx=0).stop 2024-09-10T11:05:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 -- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0734103f40 msgr2=0x7f073419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:05:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0734103f40 0x7f073419a570 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f072400d950 tx=0x7f072400de10 comp rx=0 tx=0).stop 2024-09-10T11:05:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 -- 172.21.15.59:0/4184829944 shutdown_connections 2024-09-10T11:05:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f073419ee30 0x7f073419f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f071c0a2e20 0x7f071c0a52e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0734109090 0x7f073419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 --2- 172.21.15.59:0/4184829944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0734103f40 0x7f073419a570 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:05:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.936+0000 7f0739931640 1 -- 172.21.15.59:0/4184829944 >> 172.21.15.59:0/4184829944 conn(0x7f07340ff9b0 msgr2=0x7f0734100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:05:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.937+0000 7f0739931640 1 -- 172.21.15.59:0/4184829944 shutdown_connections 2024-09-10T11:05:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:05:48.937+0000 7f0739931640 1 -- 172.21.15.59:0/4184829944 wait complete. 2024-09-10T11:05:50.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:49 smithi059 ceph-mon[30978]: pgmap v137: 97 pgs: 97 active+clean; 2.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-09-10T11:05:50.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:49 smithi181 ceph-mon[35409]: pgmap v137: 97 pgs: 97 active+clean; 2.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-09-10T11:05:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:49 smithi115 ceph-mon[34719]: pgmap v137: 97 pgs: 97 active+clean; 2.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-09-10T11:05:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:51 smithi059 ceph-mon[30978]: pgmap v138: 97 pgs: 97 active+clean; 2.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-09-10T11:05:52.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:51 smithi181 ceph-mon[35409]: pgmap v138: 97 pgs: 97 active+clean; 2.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-09-10T11:05:52.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:51 smithi115 ceph-mon[34719]: pgmap v138: 97 pgs: 97 active+clean; 2.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-09-10T11:05:54.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:53 smithi059 ceph-mon[30978]: pgmap v139: 97 pgs: 97 active+clean; 2.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-09-10T11:05:54.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:53 smithi181 ceph-mon[35409]: pgmap v139: 97 pgs: 97 active+clean; 2.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-09-10T11:05:54.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:53 smithi115 ceph-mon[34719]: pgmap v139: 97 pgs: 97 active+clean; 2.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-09-10T11:05:56.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:55 smithi059 ceph-mon[30978]: pgmap v140: 97 pgs: 97 active+clean; 2.2 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-09-10T11:05:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:55 smithi181 ceph-mon[35409]: pgmap v140: 97 pgs: 97 active+clean; 2.2 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-09-10T11:05:56.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:55 smithi115 ceph-mon[34719]: pgmap v140: 97 pgs: 97 active+clean; 2.2 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-09-10T11:05:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:57 smithi059 ceph-mon[30978]: pgmap v141: 97 pgs: 97 active+clean; 2.2 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-10T11:05:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:57 smithi181 ceph-mon[35409]: pgmap v141: 97 pgs: 97 active+clean; 2.2 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-10T11:05:58.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:57 smithi115 ceph-mon[34719]: pgmap v141: 97 pgs: 97 active+clean; 2.2 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-10T11:06:00.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:05:59 smithi059 ceph-mon[30978]: pgmap v142: 97 pgs: 97 active+clean; 2.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-09-10T11:06:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:05:59 smithi181 ceph-mon[35409]: pgmap v142: 97 pgs: 97 active+clean; 2.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-09-10T11:06:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:05:59 smithi115 ceph-mon[34719]: pgmap v142: 97 pgs: 97 active+clean; 2.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-09-10T11:06:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.037+0000 7fb733711640 1 -- 172.21.15.59:0/1477116542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c101280 msgr2=0x7fb72c10deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.037+0000 7fb733711640 1 --2- 172.21.15.59:0/1477116542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c101280 0x7fb72c10deb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009900 tx=0x7fb71c02a410 comp rx=0 tx=0).stop 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.037+0000 7fb733711640 1 -- 172.21.15.59:0/1477116542 shutdown_connections 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.037+0000 7fb733711640 1 --2- 172.21.15.59:0/1477116542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb72c10e480 0x7fb72c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.037+0000 7fb733711640 1 --2- 172.21.15.59:0/1477116542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c101280 0x7fb72c10deb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.037+0000 7fb733711640 1 --2- 172.21.15.59:0/1477116542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72c1008d0 0x7fb72c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.037+0000 7fb733711640 1 -- 172.21.15.59:0/1477116542 >> 172.21.15.59:0/1477116542 conn(0x7fb72c0fc6b0 msgr2=0x7fb72c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 -- 172.21.15.59:0/1477116542 shutdown_connections 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 -- 172.21.15.59:0/1477116542 wait complete. 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 Processor -- start 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 -- start start 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c1008d0 0x7fb72c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb72c101280 0x7fb72c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72c10e480 0x7fb72c19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c114100 con 0x7fb72c1008d0 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c113f80 con 0x7fb72c101280 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.038+0000 7fb733711640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c114280 con 0x7fb72c10e480 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7314ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c1008d0 0x7fb72c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7314ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c1008d0 0x7fb72c19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53272/0 (socket says 172.21.15.59:53272) 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7314ad640 1 -- 172.21.15.59:0/192165548 learned_addr learned my addr 172.21.15.59:0/192165548 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb730cac640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb72c101280 0x7fb72c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb731cae640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72c10e480 0x7fb72c19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7314ad640 1 -- 172.21.15.59:0/192165548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72c10e480 msgr2=0x7fb72c19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7314ad640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72c10e480 0x7fb72c19eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7314ad640 1 -- 172.21.15.59:0/192165548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb72c101280 msgr2=0x7fb72c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7314ad640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb72c101280 0x7fb72c19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7314ad640 1 -- 172.21.15.59:0/192165548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c19f5e0 con 0x7fb72c1008d0 2024-09-10T11:06:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7314ad640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c1008d0 0x7fb72c19a5f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e9f0 tx=0x7fb72800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7227fc640 1 -- 172.21.15.59:0/192165548 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72800cd80 con 0x7fb72c1008d0 2024-09-10T11:06:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb733711640 1 -- 172.21.15.59:0/192165548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c19f8d0 con 0x7fb72c1008d0 2024-09-10T11:06:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7227fc640 1 -- 172.21.15.59:0/192165548 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb728005500 con 0x7fb72c1008d0 2024-09-10T11:06:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb7227fc640 1 -- 172.21.15.59:0/192165548 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728010690 con 0x7fb72c1008d0 2024-09-10T11:06:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.039+0000 7fb733711640 1 -- 172.21.15.59:0/192165548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c1a7160 con 0x7fb72c1008d0 2024-09-10T11:06:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.042+0000 7fb7227fc640 1 -- 172.21.15.59:0/192165548 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb7280046c0 con 0x7fb72c1008d0 2024-09-10T11:06:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.042+0000 7fb7364ac740 1 Processor -- start 2024-09-10T11:06:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.042+0000 7fb7364ac740 1 -- start start 2024-09-10T11:06:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 0x55bff53c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7364ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bff532a2f0 con 0x55bff53c6410 2024-09-10T11:06:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7364ac740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55bff52d2270 con 0x55bff53d0cb0 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7364ac740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bff53262b0 con 0x55bff53c5af0 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7314ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7314ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53286/0 (socket says 172.21.15.59:53286) 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7314ad640 1 -- 172.21.15.59:0/3611805392 learned_addr learned my addr 172.21.15.59:0/3611805392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb730cac640 1 --2- 172.21.15.59:0/3611805392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53d30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb731cae640 1 --2- 172.21.15.59:0/3611805392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 0x55bff53c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7227fc640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb7180a2da0 0x7fb7180a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7314ad640 1 -- 172.21.15.59:0/3611805392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 msgr2=0x55bff53c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7314ad640 1 --2- 172.21.15.59:0/3611805392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 0x55bff53c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7314ad640 1 -- 172.21.15.59:0/3611805392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 msgr2=0x55bff53d30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7314ad640 1 --2- 172.21.15.59:0/3611805392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53d30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb731cae640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb7180a2da0 0x7fb7180a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.043+0000 7fb7314ad640 1 -- 172.21.15.59:0/3611805392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff52d1340 con 0x55bff53c6410 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.044+0000 7fb7227fc640 1 -- 172.21.15.59:0/192165548 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fb7280cf9b0 con 0x7fb72c1008d0 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.044+0000 7fb7314ad640 1 --2- 172.21.15.59:0/3611805392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53d0770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb7280cd050 tx=0x7fb72805bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904ebc95014521a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.044+0000 7fb731cae640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb7180a2da0 0x7fb7180a5260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb72c06baf0 tx=0x7fb724004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.044+0000 7fb7177fe640 1 -- 172.21.15.59:0/3611805392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72809bc80 con 0x55bff53c6410 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.044+0000 7fb7177fe640 1 -- 172.21.15.59:0/3611805392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb72809c5b0 con 0x55bff53c6410 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.044+0000 7fb7177fe640 1 -- 172.21.15.59:0/3611805392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72809b810 con 0x55bff53c6410 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 -- 172.21.15.59:0/3611805392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 msgr2=0x55bff53d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3611805392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53d0770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb7280cd050 tx=0x7fb72805bf90 comp rx=0 tx=0).stop 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 -- 172.21.15.59:0/3611805392 shutdown_connections 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3611805392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3611805392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53d0770 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3611805392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 0x55bff53c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 -- 172.21.15.59:0/3611805392 >> 172.21.15.59:0/3611805392 conn(0x55bff53c2060 msgr2=0x55bff53c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 -- 172.21.15.59:0/3611805392 shutdown_connections 2024-09-10T11:06:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 -- 172.21.15.59:0/3611805392 wait complete. 2024-09-10T11:06:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 -- start start 2024-09-10T11:06:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.045+0000 7fb7364ac740 1 Processor -- start 2024-09-10T11:06:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 0x55bff53ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7364ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bff53d3880 con 0x55bff53c5af0 2024-09-10T11:06:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7364ac740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55bff52b3290 con 0x55bff53d0cb0 2024-09-10T11:06:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7364ac740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bff53d3a00 con 0x55bff53c6410 2024-09-10T11:06:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7364ac740 10 client.0 _ll_register_callbacks cb 0x55bff52e4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7314ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7314ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53294/0 (socket says 172.21.15.59:53294) 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7314ad640 1 -- 172.21.15.59:0/3470891376 learned_addr learned my addr 172.21.15.59:0/3470891376 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb730cac640 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 0x55bff53ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb731cae640 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7314ad640 1 -- 172.21.15.59:0/3470891376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 msgr2=0x55bff53ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7314ad640 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 0x55bff53ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7314ad640 1 -- 172.21.15.59:0/3470891376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 msgr2=0x55bff53ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7314ad640 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7314ad640 1 -- 172.21.15.59:0/3470891376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bff503d210 con 0x55bff53c5af0 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb731cae640 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb7314ad640 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53cdae0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e9c0 tx=0x7fb7280cd100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb538eb1c8564ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.046+0000 7fb714ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb714ff9640 1 -- 172.21.15.59:0/3470891376 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72809b9f0 con 0x55bff53c5af0 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb714ff9640 1 -- 172.21.15.59:0/3470891376 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fb7280b0010 con 0x55bff53c5af0 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb7364ac740 1 -- 172.21.15.59:0/3470891376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb72809c5b0 con 0x55bff53c5af0 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb714ff9640 1 -- 172.21.15.59:0/3470891376 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb72809b810 con 0x55bff53c5af0 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb7364ac740 10 client.15621 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb7364ac740 1 -- 172.21.15.59:0/3470891376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bff5109620 con 0x55bff53c5af0 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb714ff9640 1 -- 172.21.15.59:0/3470891376 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb72809c5b0 con 0x55bff53c5af0 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb714ff9640 1 -- 172.21.15.59:0/3470891376 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb72809c110 con 0x55bff53c5af0 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb7364ac740 10 client.15621 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb7364ac740 10 client.15621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb7364ac740 20 client.15621 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bff53e09d0 0x55bff53e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb7364ac740 4 client.15621 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:06:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.047+0000 7fb7364ac740 1 -- 172.21.15.59:0/3470891376 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bff5337a20 con 0x55bff53e09d0 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.048+0000 7fb730cac640 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bff53e09d0 0x55bff53e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.048+0000 7fb714ff9640 10 client.15621 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.048+0000 7fb730cac640 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bff53e09d0 0x55bff53e2dc0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=119b8397ab4ae401 server_cookie=370f1d2ea64e385d in_seq=0 out_seq=0 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb714ff9640 1 -- 172.21.15.59:0/3470891376 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bff5337a20 con 0x55bff53e09d0 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb714ff9640 10 client.15621 handle_command_reply: tid=0 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 client.15621 shutdown 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 -- 172.21.15.59:0/3470891376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 msgr2=0x55bff53cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53cdae0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e9c0 tx=0x7fb7280cd100 comp rx=0 tx=0).stop 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 -- 172.21.15.59:0/3470891376 shutdown_connections 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bff53e09d0 0x55bff53e2dc0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb714ff9640 0 client.15621 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 0x55bff53ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3470891376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53cdae0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 -- 172.21.15.59:0/3470891376 >> 172.21.15.59:0/3470891376 conn(0x55bff53c2060 msgr2=0x55bff53c7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 -- 172.21.15.59:0/3470891376 shutdown_connections 2024-09-10T11:06:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 1 -- 172.21.15.59:0/3470891376 wait complete. 2024-09-10T11:06:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.049+0000 7fb7364ac740 20 client.15621 trim_cache size 0 max 16384 2024-09-10T11:06:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb7364ac740 1 Processor -- start 2024-09-10T11:06:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb7364ac740 1 -- start start 2024-09-10T11:06:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 0x55bff53c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.070 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53e5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb7364ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1b23f0 con 0x55bff53c6410 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb7364ac740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1afcc0 con 0x55bff53d0cb0 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb7364ac740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1adb10 con 0x55bff53c5af0 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb730cac640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb730cac640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53306/0 (socket says 172.21.15.59:53306) 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb730cac640 1 -- 172.21.15.59:0/3004712644 learned_addr learned my addr 172.21.15.59:0/3004712644 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb7314ad640 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 0x55bff53c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb731cae640 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53e5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb730cac640 1 -- 172.21.15.59:0/3004712644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 msgr2=0x55bff53c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb730cac640 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 0x55bff53c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb730cac640 1 -- 172.21.15.59:0/3004712644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 msgr2=0x55bff53e5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb730cac640 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53e5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.071 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb730cac640 1 -- 172.21.15.59:0/3004712644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff53c1e90 con 0x55bff53c6410 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb731cae640 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53e5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.064+0000 7fb730cac640 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53ce390 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb71c02abe0 tx=0x7fb71c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8e6d350d0f690 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb716ffd640 1 -- 172.21.15.59:0/3004712644 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c035040 con 0x55bff53c6410 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb716ffd640 1 -- 172.21.15.59:0/3004712644 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb71c049070 con 0x55bff53c6410 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb716ffd640 1 -- 172.21.15.59:0/3004712644 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c004920 con 0x55bff53c6410 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb7364ac740 1 -- 172.21.15.59:0/3004712644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 msgr2=0x55bff53ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53ce390 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb71c02abe0 tx=0x7fb71c0058d0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb7364ac740 1 -- 172.21.15.59:0/3004712644 shutdown_connections 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff53e5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c6410 0x55bff53ce390 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb7364ac740 1 --2- 172.21.15.59:0/3004712644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c5af0 0x55bff53c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb7364ac740 1 -- 172.21.15.59:0/3004712644 >> 172.21.15.59:0/3004712644 conn(0x55bff53c2060 msgr2=0x55bff53dc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:02.072 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb7364ac740 1 -- 172.21.15.59:0/3004712644 shutdown_connections 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.065+0000 7fb7364ac740 1 -- 172.21.15.59:0/3004712644 wait complete. 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7364ac740 1 -- start start 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7364ac740 1 Processor -- start 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53e24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 0x55bff53e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7364ac740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff54442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7364ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1ae180 con 0x55bff53c5af0 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7364ac740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1af5f0 con 0x55bff53d0cb0 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7364ac740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1ae850 con 0x55bff53c6410 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7364ac740 10 client.0 _ll_register_callbacks cb 0x7fb7280d1f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7314ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53e24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7314ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53e24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53318/0 (socket says 172.21.15.59:53318) 2024-09-10T11:06:02.073 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb7314ad640 1 -- 172.21.15.59:0/1921215462 learned_addr learned my addr 172.21.15.59:0/1921215462 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb730cac640 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 0x55bff53e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.066+0000 7fb731cae640 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff54442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7314ad640 1 -- 172.21.15.59:0/1921215462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 msgr2=0x55bff53e2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7314ad640 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 0x55bff53e2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7314ad640 1 -- 172.21.15.59:0/1921215462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 msgr2=0x55bff54442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7314ad640 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff54442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7314ad640 1 -- 172.21.15.59:0/1921215462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bff5444970 con 0x55bff53c5af0 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7314ad640 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53e24e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb7280a45f0 tx=0x7fb72800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6a24eaa7956954 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb714ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb714ff9640 1 -- 172.21.15.59:0/1921215462 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72809bc80 con 0x55bff53c5af0 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb714ff9640 1 -- 172.21.15.59:0/1921215462 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fb728016d90 con 0x55bff53c5af0 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7364ac740 1 -- 172.21.15.59:0/1921215462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb71c049070 con 0x55bff53c5af0 2024-09-10T11:06:02.074 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb714ff9640 1 -- 172.21.15.59:0/1921215462 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb72809b9f0 con 0x55bff53c5af0 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7364ac740 10 client.15627 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7364ac740 1 -- 172.21.15.59:0/1921215462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bff5444970 con 0x55bff53c5af0 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb714ff9640 1 -- 172.21.15.59:0/1921215462 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb71c049070 con 0x55bff53c5af0 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb714ff9640 1 -- 172.21.15.59:0/1921215462 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb7280d5180 con 0x55bff53c5af0 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7364ac740 10 client.15627 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7364ac740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7364ac740 20 client.15627 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7364ac740 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bff544c070 0x55bff544e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7364ac740 4 client.15627 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.067+0000 7fb7364ac740 1 -- 172.21.15.59:0/1921215462 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bff53c1850 con 0x55bff544c070 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.068+0000 7fb730cac640 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bff544c070 0x55bff544e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.068+0000 7fb730cac640 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bff544c070 0x55bff544e460 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd72c8ad7fe2a0c3 server_cookie=da565582caba3151 in_seq=0 out_seq=0 2024-09-10T11:06:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.068+0000 7fb714ff9640 10 client.15627 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb714ff9640 1 -- 172.21.15.59:0/1921215462 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bff53c1850 con 0x55bff544c070 2024-09-10T11:06:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb714ff9640 10 client.15627 handle_command_reply: tid=0 2024-09-10T11:06:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 client.15627 shutdown 2024-09-10T11:06:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 -- 172.21.15.59:0/1921215462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 msgr2=0x55bff53e24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:02.085 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53e24e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb7280a45f0 tx=0x7fb72800c7d0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 -- 172.21.15.59:0/1921215462 shutdown_connections 2024-09-10T11:06:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bff544c070 0x55bff544e460 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bff53d0cb0 0x55bff54442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bff53c6410 0x55bff53e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 --2- 172.21.15.59:0/1921215462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bff53c5af0 0x55bff53e24e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb714ff9640 0 client.15627 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 -- 172.21.15.59:0/1921215462 >> 172.21.15.59:0/1921215462 conn(0x55bff53c2060 msgr2=0x55bff53c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 -- 172.21.15.59:0/1921215462 shutdown_connections 2024-09-10T11:06:02.086 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 1 -- 172.21.15.59:0/1921215462 wait complete. 2024-09-10T11:06:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.083+0000 7fb7364ac740 20 client.15627 trim_cache size 0 max 16384 2024-09-10T11:06:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:06:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:06:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:06:02.087 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:06:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 -- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb7180a2da0 msgr2=0x7fb7180a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb7180a2da0 0x7fb7180a5260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb72c06baf0 tx=0x7fb724004a40 comp rx=0 tx=0).stop 2024-09-10T11:06:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 -- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c1008d0 msgr2=0x7fb72c19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c1008d0 0x7fb72c19a5f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e9f0 tx=0x7fb72800edf0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 -- 172.21.15.59:0/192165548 shutdown_connections 2024-09-10T11:06:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb7180a2da0 0x7fb7180a5260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72c10e480 0x7fb72c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb72c101280 0x7fb72c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 --2- 172.21.15.59:0/192165548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb72c1008d0 0x7fb72c19a5f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 -- 172.21.15.59:0/192165548 >> 172.21.15.59:0/192165548 conn(0x7fb72c0fc6b0 msgr2=0x7fb72c0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 -- 172.21.15.59:0/192165548 shutdown_connections 2024-09-10T11:06:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:02.084+0000 7fb733711640 1 -- 172.21.15.59:0/192165548 wait complete. 2024-09-10T11:06:02.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:01 smithi059 ceph-mon[30978]: pgmap v143: 97 pgs: 97 active+clean; 2.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-10T11:06:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:01 smithi181 ceph-mon[35409]: pgmap v143: 97 pgs: 97 active+clean; 2.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-10T11:06:02.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:01 smithi115 ceph-mon[34719]: pgmap v143: 97 pgs: 97 active+clean; 2.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-10T11:06:04.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:03 smithi059 ceph-mon[30978]: pgmap v144: 97 pgs: 97 active+clean; 2.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-10T11:06:04.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:03 smithi181 ceph-mon[35409]: pgmap v144: 97 pgs: 97 active+clean; 2.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-10T11:06:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:03 smithi115 ceph-mon[34719]: pgmap v144: 97 pgs: 97 active+clean; 2.4 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-10T11:06:06.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:05 smithi059 ceph-mon[30978]: pgmap v145: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 74 KiB/s wr, 34 op/s 2024-09-10T11:06:06.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:05 smithi181 ceph-mon[35409]: pgmap v145: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 74 KiB/s wr, 34 op/s 2024-09-10T11:06:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:05 smithi115 ceph-mon[34719]: pgmap v145: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 74 KiB/s wr, 34 op/s 2024-09-10T11:06:08.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:07 smithi059 ceph-mon[30978]: pgmap v146: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 56 KiB/s wr, 27 op/s 2024-09-10T11:06:08.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:07 smithi181 ceph-mon[35409]: pgmap v146: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 56 KiB/s wr, 27 op/s 2024-09-10T11:06:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:07 smithi115 ceph-mon[34719]: pgmap v146: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 56 KiB/s wr, 27 op/s 2024-09-10T11:06:10.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:09 smithi059 ceph-mon[30978]: pgmap v147: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 71 KiB/s wr, 32 op/s 2024-09-10T11:06:10.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:09 smithi181 ceph-mon[35409]: pgmap v147: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 71 KiB/s wr, 32 op/s 2024-09-10T11:06:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:09 smithi115 ceph-mon[34719]: pgmap v147: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 71 KiB/s wr, 32 op/s 2024-09-10T11:06:12.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:11 smithi059 ceph-mon[30978]: pgmap v148: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-09-10T11:06:12.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:11 smithi181 ceph-mon[35409]: pgmap v148: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-09-10T11:06:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:11 smithi115 ceph-mon[34719]: pgmap v148: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-09-10T11:06:14.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:13 smithi059 ceph-mon[30978]: pgmap v149: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-09-10T11:06:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:13 smithi181 ceph-mon[35409]: pgmap v149: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-09-10T11:06:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:13 smithi115 ceph-mon[34719]: pgmap v149: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-09-10T11:06:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.183+0000 7f94956d0640 1 -- 172.21.15.59:0/2469921778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 msgr2=0x7f949010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.183+0000 7f94956d0640 1 --2- 172.21.15.59:0/2469921778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 0x7f949010d8c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9488009cd0 tx=0x7f948802a8e0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 -- 172.21.15.59:0/2469921778 shutdown_connections 2024-09-10T11:06:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 --2- 172.21.15.59:0/2469921778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 0x7f949010d8c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 --2- 172.21.15.59:0/2469921778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94901009f0 0x7f9490100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 --2- 172.21.15.59:0/2469921778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9490106a00 0x7f9490106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 -- 172.21.15.59:0/2469921778 >> 172.21.15.59:0/2469921778 conn(0x7f94900fc6b0 msgr2=0x7f94900fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 -- 172.21.15.59:0/2469921778 shutdown_connections 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 -- 172.21.15.59:0/2469921778 wait complete. 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 Processor -- start 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 -- start start 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94901009f0 0x7f9490197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.184+0000 7f94956d0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 0x7f9490197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f94956d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9490106a00 0x7f949019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f94956d0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9490110e40 con 0x7f9490101390 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f94956d0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9490110cc0 con 0x7f94901009f0 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f94956d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9490110fc0 con 0x7f9490106a00 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f9487fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 0x7f9490197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f9487fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 0x7f9490197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49676/0 (socket says 172.21.15.59:49676) 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f9487fff640 1 -- 172.21.15.59:0/753785429 learned_addr learned my addr 172.21.15.59:0/753785429 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f948effd640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94901009f0 0x7f9490197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f948f7fe640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9490106a00 0x7f949019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f9487fff640 1 -- 172.21.15.59:0/753785429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9490106a00 msgr2=0x7f949019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f9487fff640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9490106a00 0x7f949019bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f9487fff640 1 -- 172.21.15.59:0/753785429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94901009f0 msgr2=0x7f9490197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f9487fff640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94901009f0 0x7f9490197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f9487fff640 1 -- 172.21.15.59:0/753785429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949019c200 con 0x7f9490101390 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f948effd640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94901009f0 0x7f9490197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f9487fff640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 0x7f9490197750 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f947800d950 tx=0x7f947800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f948cff9640 1 -- 172.21.15.59:0/753785429 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478017070 con 0x7f9490101390 2024-09-10T11:06:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.185+0000 7f948cff9640 1 -- 172.21.15.59:0/753785429 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9478009c30 con 0x7f9490101390 2024-09-10T11:06:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.186+0000 7f94956d0640 1 -- 172.21.15.59:0/753785429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949019c4f0 con 0x7f9490101390 2024-09-10T11:06:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.186+0000 7f948cff9640 1 -- 172.21.15.59:0/753785429 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947800f6b0 con 0x7f9490101390 2024-09-10T11:06:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.186+0000 7f94956d0640 1 -- 172.21.15.59:0/753785429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94901a3d80 con 0x7f9490101390 2024-09-10T11:06:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.188+0000 7f948cff9640 1 -- 172.21.15.59:0/753785429 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f94780109d0 con 0x7f9490101390 2024-09-10T11:06:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.188+0000 7f9498465740 1 Processor -- start 2024-09-10T11:06:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.188+0000 7f9498465740 1 -- start start 2024-09-10T11:06:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f9498465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 0x55ffad137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f9498465740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad144980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f9498465740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 0x55ffad1472b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f9498465740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ffad09c2f0 con 0x55ffad138310 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f9498465740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ffad044270 con 0x55ffad144ec0 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f9498465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ffad0982b0 con 0x55ffad1379f0 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948cff9640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f947c0a2e20 0x7f947c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49678/0 (socket says 172.21.15.59:49678) 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948effd640 1 -- 172.21.15.59:0/2595245592 learned_addr learned my addr 172.21.15.59:0/2595245592 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948f7fe640 1 --2- 172.21.15.59:0/2595245592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 0x55ffad137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f9487fff640 1 --2- 172.21.15.59:0/2595245592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 0x55ffad1472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948f7fe640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f947c0a2e20 0x7f947c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948cff9640 1 -- 172.21.15.59:0/753785429 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f94780cefb0 con 0x7f9490101390 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948effd640 1 -- 172.21.15.59:0/2595245592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 msgr2=0x55ffad137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948effd640 1 --2- 172.21.15.59:0/2595245592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 0x55ffad137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948effd640 1 -- 172.21.15.59:0/2595245592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 msgr2=0x55ffad1472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948effd640 1 --2- 172.21.15.59:0/2595245592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 0x55ffad1472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.189+0000 7f948effd640 1 -- 172.21.15.59:0/2595245592 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffad043340 con 0x55ffad138310 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.190+0000 7f948effd640 1 --2- 172.21.15.59:0/2595245592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad144980 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f94800114c0 tx=0x7f9480011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e91fe086b3425be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.190+0000 7f948f7fe640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f947c0a2e20 0x7f947c0a52e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9488004ab0 tx=0x7f9488004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.190+0000 7f94857fa640 1 -- 172.21.15.59:0/2595245592 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480004020 con 0x55ffad138310 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.190+0000 7f94857fa640 1 -- 172.21.15.59:0/2595245592 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94800041c0 con 0x55ffad138310 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.190+0000 7f94857fa640 1 -- 172.21.15.59:0/2595245592 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948000f980 con 0x55ffad138310 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.190+0000 7f9498465740 1 -- 172.21.15.59:0/2595245592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 msgr2=0x55ffad144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.190+0000 7f9498465740 1 --2- 172.21.15.59:0/2595245592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad144980 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f94800114c0 tx=0x7f9480011980 comp rx=0 tx=0).stop 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.191+0000 7f9498465740 1 -- 172.21.15.59:0/2595245592 shutdown_connections 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.191+0000 7f9498465740 1 --2- 172.21.15.59:0/2595245592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 0x55ffad1472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.191+0000 7f9498465740 1 --2- 172.21.15.59:0/2595245592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad144980 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.191+0000 7f9498465740 1 --2- 172.21.15.59:0/2595245592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 0x55ffad137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.191+0000 7f9498465740 1 -- 172.21.15.59:0/2595245592 >> 172.21.15.59:0/2595245592 conn(0x55ffad134060 msgr2=0x55ffad134440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.191+0000 7f9498465740 1 -- 172.21.15.59:0/2595245592 shutdown_connections 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.191+0000 7f9498465740 1 -- 172.21.15.59:0/2595245592 wait complete. 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.191+0000 7f9498465740 1 -- start start 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.191+0000 7f9498465740 1 Processor -- start 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9498465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 0x55ffad141e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9498465740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad142350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9498465740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 0x55ffad142890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9498465740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ffad147b20 con 0x55ffad138310 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9498465740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ffad025290 con 0x55ffad144ec0 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9498465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ffad147ca0 con 0x55ffad1379f0 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9498465740 10 client.0 _ll_register_callbacks cb 0x55ffad056140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9487fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9487fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad142350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49692/0 (socket says 172.21.15.59:49692) 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9487fff640 1 -- 172.21.15.59:0/3642086016 learned_addr learned my addr 172.21.15.59:0/3642086016 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f948effd640 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 0x55ffad141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9487fff640 1 -- 172.21.15.59:0/3642086016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 msgr2=0x55ffad141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9487fff640 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 0x55ffad141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9487fff640 1 -- 172.21.15.59:0/3642086016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 msgr2=0x55ffad142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f948f7fe640 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 0x55ffad142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9487fff640 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 0x55ffad142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9487fff640 1 -- 172.21.15.59:0/3642086016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffacdaf210 con 0x55ffad138310 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f948effd640 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 0x55ffad141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9487fff640 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad142350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f947809b490 tx=0x7f94780665d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16562d540e1b6ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f94767fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f94767fc640 1 -- 172.21.15.59:0/3642086016 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478020040 con 0x55ffad138310 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f94767fc640 1 -- 172.21.15.59:0/3642086016 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f94780a3c30 con 0x55ffad138310 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9498465740 1 -- 172.21.15.59:0/3642086016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94800041c0 con 0x55ffad138310 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f94767fc640 1 -- 172.21.15.59:0/3642086016 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f94780ccb00 con 0x55ffad138310 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.192+0000 7f9498465740 10 client.15639 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f9498465740 1 -- 172.21.15.59:0/3642086016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fface7b620 con 0x55ffad138310 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f94767fc640 1 -- 172.21.15.59:0/3642086016 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94800041c0 con 0x55ffad138310 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f94767fc640 1 -- 172.21.15.59:0/3642086016 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f94780b4230 con 0x55ffad138310 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f9498465740 10 client.15639 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f9498465740 10 client.15639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f9498465740 20 client.15639 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f9498465740 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ffad154f60 0x55ffad1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f9498465740 4 client.15639 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f9498465740 1 -- 172.21.15.59:0/3642086016 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffad0a9a20 con 0x55ffad154f60 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.193+0000 7f948effd640 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ffad154f60 0x55ffad1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.194+0000 7f948effd640 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ffad154f60 0x55ffad1573b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5efe8554b3ce719c server_cookie=a565292a935221a in_seq=0 out_seq=0 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.194+0000 7f94767fc640 10 client.15639 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.194+0000 7f94767fc640 1 -- 172.21.15.59:0/3642086016 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffad0a9a20 con 0x55ffad154f60 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.194+0000 7f94767fc640 10 client.15639 handle_command_reply: tid=0 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.194+0000 7f9498465740 1 client.15639 shutdown 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.194+0000 7f9498465740 1 -- 172.21.15.59:0/3642086016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 msgr2=0x55ffad142350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.194+0000 7f9498465740 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad142350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f947809b490 tx=0x7f94780665d0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.194+0000 7f9498465740 1 -- 172.21.15.59:0/3642086016 shutdown_connections 2024-09-10T11:06:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.194+0000 7f9498465740 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ffad154f60 0x55ffad1573b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.195+0000 7f9498465740 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad144ec0 0x55ffad142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.195+0000 7f94767fc640 0 client.15639 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.195+0000 7f9498465740 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad142350 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.195+0000 7f9498465740 1 --2- 172.21.15.59:0/3642086016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad1379f0 0x55ffad141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.195+0000 7f9498465740 1 -- 172.21.15.59:0/3642086016 >> 172.21.15.59:0/3642086016 conn(0x55ffad134060 msgr2=0x55ffad139d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.195+0000 7f9498465740 1 -- 172.21.15.59:0/3642086016 shutdown_connections 2024-09-10T11:06:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.195+0000 7f9498465740 1 -- 172.21.15.59:0/3642086016 wait complete. 2024-09-10T11:06:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.195+0000 7f9498465740 20 client.15639 trim_cache size 0 max 16384 2024-09-10T11:06:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.209+0000 7f9498465740 1 Processor -- start 2024-09-10T11:06:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.209+0000 7f9498465740 1 -- start start 2024-09-10T11:06:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9498465740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad1379f0 0x55ffad15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9498465740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad15d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9498465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad13f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9498465740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94901ade60 con 0x55ffad138310 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9498465740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f94901ab730 con 0x55ffad1379f0 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9498465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f94901a9580 con 0x55ffad144ec0 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9487fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9487fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad15d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49694/0 (socket says 172.21.15.59:49694) 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9487fff640 1 -- 172.21.15.59:0/579920224 learned_addr learned my addr 172.21.15.59:0/579920224 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f948f7fe640 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad13f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9487fff640 1 -- 172.21.15.59:0/579920224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 msgr2=0x55ffad13f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9487fff640 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad13f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9487fff640 1 -- 172.21.15.59:0/579920224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad1379f0 msgr2=0x55ffad15cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f948effd640 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad1379f0 0x55ffad15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9487fff640 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad1379f0 0x55ffad15cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9487fff640 1 -- 172.21.15.59:0/579920224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffad133e90 con 0x55ffad138310 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f948f7fe640 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad13f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9487fff640 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad15d250 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f94780997b0 tx=0x7f9478010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd950b6091f2afd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.210+0000 7f9484ff9640 1 -- 172.21.15.59:0/579920224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478014020 con 0x55ffad138310 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9484ff9640 1 -- 172.21.15.59:0/579920224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947809b500 con 0x55ffad138310 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9484ff9640 1 -- 172.21.15.59:0/579920224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94780cc900 con 0x55ffad138310 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9498465740 1 -- 172.21.15.59:0/579920224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 msgr2=0x55ffad15d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9498465740 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad15d250 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f94780997b0 tx=0x7f9478010d70 comp rx=0 tx=0).stop 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9498465740 1 -- 172.21.15.59:0/579920224 shutdown_connections 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9498465740 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad13f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9498465740 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad138310 0x55ffad15d250 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9498465740 1 --2- 172.21.15.59:0/579920224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad1379f0 0x55ffad15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9498465740 1 -- 172.21.15.59:0/579920224 >> 172.21.15.59:0/579920224 conn(0x55ffad134060 msgr2=0x55ffad143e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9498465740 1 -- 172.21.15.59:0/579920224 shutdown_connections 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.211+0000 7f9498465740 1 -- 172.21.15.59:0/579920224 wait complete. 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9498465740 1 -- start start 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9498465740 1 Processor -- start 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9498465740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad1379f0 0x55ffad1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9498465740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad138310 0x55ffad149af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9498465740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad1b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9498465740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94901a9bf0 con 0x55ffad1379f0 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9498465740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f94901ab060 con 0x55ffad138310 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9498465740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f94901aa2c0 con 0x55ffad144ec0 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9498465740 10 client.0 _ll_register_callbacks cb 0x7f94780977a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad1379f0 0x55ffad1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad1379f0 0x55ffad1495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49708/0 (socket says 172.21.15.59:49708) 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948effd640 1 -- 172.21.15.59:0/2559210374 learned_addr learned my addr 172.21.15.59:0/2559210374 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948f7fe640 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad1b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948effd640 1 -- 172.21.15.59:0/2559210374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 msgr2=0x55ffad1b8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948effd640 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad1b8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948effd640 1 -- 172.21.15.59:0/2559210374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad138310 msgr2=0x55ffad149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9487fff640 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad138310 0x55ffad149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948effd640 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad138310 0x55ffad149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948effd640 1 -- 172.21.15.59:0/2559210374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffad13cb50 con 0x55ffad1379f0 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f948f7fe640 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad1b8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.212+0000 7f9487fff640 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad138310 0x55ffad149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f948effd640 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad1379f0 0x55ffad1495b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9480003f80 tx=0x7f9480009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3b056e46d78d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f94767fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f94767fc640 1 -- 172.21.15.59:0/2559210374 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948001d040 con 0x55ffad1379f0 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f94767fc640 1 -- 172.21.15.59:0/2559210374 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f9480004150 con 0x55ffad1379f0 2024-09-10T11:06:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f9498465740 1 -- 172.21.15.59:0/2559210374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f947809b500 con 0x55ffad1379f0 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f94767fc640 1 -- 172.21.15.59:0/2559210374 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9480011020 con 0x55ffad1379f0 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f9498465740 10 client.15645 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f9498465740 1 -- 172.21.15.59:0/2559210374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ffad1c0510 con 0x55ffad1379f0 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f94767fc640 1 -- 172.21.15.59:0/2559210374 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947809b500 con 0x55ffad1379f0 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f94767fc640 1 -- 172.21.15.59:0/2559210374 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f94800038f0 con 0x55ffad1379f0 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f9498465740 10 client.15645 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f9498465740 10 client.15645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f9498465740 20 client.15645 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f9498465740 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ffad1c0a40 0x55ffad1c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f9498465740 4 client.15645 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.213+0000 7f9498465740 1 -- 172.21.15.59:0/2559210374 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffad0a3d70 con 0x55ffad1c0a40 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.214+0000 7f9487fff640 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ffad1c0a40 0x55ffad1c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.214+0000 7f9487fff640 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ffad1c0a40 0x55ffad1c2e30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd92d6931042a2d9 server_cookie=318b55e79f3d0189 in_seq=0 out_seq=0 2024-09-10T11:06:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.214+0000 7f94767fc640 10 client.15645 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.228+0000 7f94767fc640 1 -- 172.21.15.59:0/2559210374 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffad0a3d70 con 0x55ffad1c0a40 2024-09-10T11:06:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f94767fc640 10 client.15645 handle_command_reply: tid=0 2024-09-10T11:06:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 client.15645 shutdown 2024-09-10T11:06:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 -- 172.21.15.59:0/2559210374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad1379f0 msgr2=0x55ffad1495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad1379f0 0x55ffad1495b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9480003f80 tx=0x7f9480009b30 comp rx=0 tx=0).stop 2024-09-10T11:06:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 -- 172.21.15.59:0/2559210374 shutdown_connections 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ffad1c0a40 0x55ffad1c2e30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ffad144ec0 0x55ffad1b8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f94767fc640 0 client.15645 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ffad138310 0x55ffad149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 --2- 172.21.15.59:0/2559210374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffad1379f0 0x55ffad1495b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 -- 172.21.15.59:0/2559210374 >> 172.21.15.59:0/2559210374 conn(0x55ffad134060 msgr2=0x55ffad139530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 -- 172.21.15.59:0/2559210374 shutdown_connections 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 1 -- 172.21.15.59:0/2559210374 wait complete. 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f9498465740 20 client.15645 trim_cache size 0 max 16384 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:06:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:06:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:06:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:06:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.229+0000 7f94956d0640 1 -- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f947c0a2e20 msgr2=0x7f947c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f947c0a2e20 0x7f947c0a52e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9488004ab0 tx=0x7f9488004a40 comp rx=0 tx=0).stop 2024-09-10T11:06:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 -- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 msgr2=0x7f9490197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 0x7f9490197750 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f947800d950 tx=0x7f947800de10 comp rx=0 tx=0).stop 2024-09-10T11:06:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 -- 172.21.15.59:0/753785429 shutdown_connections 2024-09-10T11:06:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f947c0a2e20 0x7f947c0a52e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9490106a00 0x7f949019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490101390 0x7f9490197750 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 --2- 172.21.15.59:0/753785429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94901009f0 0x7f9490197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 -- 172.21.15.59:0/753785429 >> 172.21.15.59:0/753785429 conn(0x7f94900fc6b0 msgr2=0x7f94900fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 -- 172.21.15.59:0/753785429 shutdown_connections 2024-09-10T11:06:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:15.230+0000 7f94956d0640 1 -- 172.21.15.59:0/753785429 wait complete. 2024-09-10T11:06:16.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:15 smithi059 ceph-mon[30978]: pgmap v150: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 73 KiB/s wr, 32 op/s 2024-09-10T11:06:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:15 smithi181 ceph-mon[35409]: pgmap v150: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 73 KiB/s wr, 32 op/s 2024-09-10T11:06:16.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:15 smithi115 ceph-mon[34719]: pgmap v150: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 73 KiB/s wr, 32 op/s 2024-09-10T11:06:18.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:17 smithi059 ceph-mon[30978]: pgmap v151: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T11:06:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:17 smithi181 ceph-mon[35409]: pgmap v151: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T11:06:18.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:17 smithi115 ceph-mon[34719]: pgmap v151: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T11:06:20.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:19 smithi059 ceph-mon[30978]: pgmap v152: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:06:20.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:19 smithi181 ceph-mon[35409]: pgmap v152: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:06:20.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:19 smithi115 ceph-mon[34719]: pgmap v152: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:06:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:21 smithi059 ceph-mon[30978]: pgmap v153: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:22.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:21 smithi181 ceph-mon[35409]: pgmap v153: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:21 smithi115 ceph-mon[34719]: pgmap v153: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:23 smithi059 ceph-mon[30978]: pgmap v154: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:24.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:23 smithi181 ceph-mon[35409]: pgmap v154: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:23 smithi115 ceph-mon[34719]: pgmap v154: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:26.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:25 smithi059 ceph-mon[30978]: pgmap v155: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 52 KiB/s wr, 17 op/s 2024-09-10T11:06:26.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:25 smithi181 ceph-mon[35409]: pgmap v155: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 52 KiB/s wr, 17 op/s 2024-09-10T11:06:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:25 smithi115 ceph-mon[34719]: pgmap v155: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 52 KiB/s wr, 17 op/s 2024-09-10T11:06:28.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:27 smithi059 ceph-mon[30978]: pgmap v156: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:28.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:27 smithi181 ceph-mon[35409]: pgmap v156: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:27 smithi115 ceph-mon[34719]: pgmap v156: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.332+0000 7fcc180ac640 1 -- 172.21.15.59:0/761943489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 msgr2=0x7fcc10105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.332+0000 7fcc180ac640 1 --2- 172.21.15.59:0/761943489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 0x7fcc10105890 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009900 tx=0x7fcc0402a480 comp rx=0 tx=0).stop 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.333+0000 7fcc180ac640 1 -- 172.21.15.59:0/761943489 shutdown_connections 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.333+0000 7fcc180ac640 1 --2- 172.21.15.59:0/761943489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc10105ee0 0x7fcc10106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.333+0000 7fcc180ac640 1 --2- 172.21.15.59:0/761943489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 0x7fcc10105890 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.333+0000 7fcc180ac640 1 --2- 172.21.15.59:0/761943489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc10100ab0 0x7fcc10100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.333+0000 7fcc180ac640 1 -- 172.21.15.59:0/761943489 >> 172.21.15.59:0/761943489 conn(0x7fcc100fc6b0 msgr2=0x7fcc100fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.333+0000 7fcc180ac640 1 -- 172.21.15.59:0/761943489 shutdown_connections 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.333+0000 7fcc180ac640 1 -- 172.21.15.59:0/761943489 wait complete. 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.333+0000 7fcc180ac640 1 Processor -- start 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.333+0000 7fcc180ac640 1 -- start start 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc180ac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc10100ab0 0x7fcc101a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc180ac640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 0x7fcc101a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc180ac640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc10105ee0 0x7fcc1019e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc180ac640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101184c0 con 0x7fcc101013d0 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc180ac640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcc10118340 con 0x7fcc10105ee0 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc180ac640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcc10118640 con 0x7fcc10100ab0 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15647640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 0x7fcc101a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15647640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 0x7fcc101a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45654/0 (socket says 172.21.15.59:45654) 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15e48640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc10100ab0 0x7fcc101a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15647640 1 -- 172.21.15.59:0/3602153796 learned_addr learned my addr 172.21.15.59:0/3602153796 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc16649640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc10105ee0 0x7fcc1019e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15647640 1 -- 172.21.15.59:0/3602153796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc10100ab0 msgr2=0x7fcc101a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15647640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc10100ab0 0x7fcc101a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15647640 1 -- 172.21.15.59:0/3602153796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc10105ee0 msgr2=0x7fcc1019e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15647640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc10105ee0 0x7fcc1019e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15647640 1 -- 172.21.15.59:0/3602153796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1019eff0 con 0x7fcc101013d0 2024-09-10T11:06:28.337 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.334+0000 7fcc15647640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 0x7fcc101a4bb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcc04006010 tx=0x7fcc040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:28.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.335+0000 7fcc02ffd640 1 -- 172.21.15.59:0/3602153796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0403f030 con 0x7fcc101013d0 2024-09-10T11:06:28.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.335+0000 7fcc02ffd640 1 -- 172.21.15.59:0/3602153796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc04003ce0 con 0x7fcc101013d0 2024-09-10T11:06:28.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.335+0000 7fcc180ac640 1 -- 172.21.15.59:0/3602153796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1019f280 con 0x7fcc101013d0 2024-09-10T11:06:28.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.335+0000 7fcc02ffd640 1 -- 172.21.15.59:0/3602153796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04035070 con 0x7fcc101013d0 2024-09-10T11:06:28.338 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.335+0000 7fcc180ac640 1 -- 172.21.15.59:0/3602153796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc101ab5f0 con 0x7fcc101013d0 2024-09-10T11:06:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.337+0000 7fcc02ffd640 1 -- 172.21.15.59:0/3602153796 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fcc04042030 con 0x7fcc101013d0 2024-09-10T11:06:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.337+0000 7fcc1ae4b740 1 Processor -- start 2024-09-10T11:06:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.337+0000 7fcc1ae4b740 1 -- start start 2024-09-10T11:06:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdb5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdc0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdc30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56166cd1a2f0 con 0x56166cdc0cb0 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56166ccc2270 con 0x56166cdb6410 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56166cd162b0 con 0x56166cdb5af0 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc15647640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdc30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc15647640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdc30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45656/0 (socket says 172.21.15.59:45656) 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc15647640 1 -- 172.21.15.59:0/4293296429 learned_addr learned my addr 172.21.15.59:0/4293296429 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc02ffd640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcbfc0a2e20 0x7fcbfc0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc16649640 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdb5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc15e48640 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdc0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc16649640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcbfc0a2e20 0x7fcbfc0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc15647640 1 -- 172.21.15.59:0/4293296429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 msgr2=0x56166cdb5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc15647640 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdb5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc15647640 1 -- 172.21.15.59:0/4293296429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 msgr2=0x56166cdc0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc15647640 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdc0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc02ffd640 1 -- 172.21.15.59:0/3602153796 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fcc040efb80 con 0x7fcc101013d0 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc15647640 1 -- 172.21.15.59:0/4293296429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166ccc1340 con 0x56166cdc0cb0 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.338+0000 7fcc16649640 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdb5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.339+0000 7fcc15647640 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdc30a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcc040bbd20 tx=0x7fcc0402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f31789e55065af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.339+0000 7fcc16649640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcbfc0a2e20 0x7fcbfc0a52e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009fd0 tx=0x7fcc08004ab0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.339+0000 7fcbfbfff640 1 -- 172.21.15.59:0/4293296429 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04049020 con 0x56166cdc0cb0 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.339+0000 7fcbfbfff640 1 -- 172.21.15.59:0/4293296429 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc040dc110 con 0x56166cdc0cb0 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.339+0000 7fcbfbfff640 1 -- 172.21.15.59:0/4293296429 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040bc020 con 0x56166cdc0cb0 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/4293296429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 msgr2=0x56166cdc30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdc30a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcc040bbd20 tx=0x7fcc0402a480 comp rx=0 tx=0).stop 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/4293296429 shutdown_connections 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdc30a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdc0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/4293296429 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdb5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/4293296429 >> 172.21.15.59:0/4293296429 conn(0x56166cdb2060 msgr2=0x56166cdb2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/4293296429 shutdown_connections 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/4293296429 wait complete. 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 -- start start 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.340+0000 7fcc1ae4b740 1 Processor -- start 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdbdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdbe040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdbe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56166cdc3640 con 0x56166cdc0cb0 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56166cca3290 con 0x56166cdb6410 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56166cdc37c0 con 0x56166cdb5af0 2024-09-10T11:06:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc1ae4b740 10 client.0 _ll_register_callbacks cb 0x56166ccd4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc16649640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdbe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc16649640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdbe580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45658/0 (socket says 172.21.15.59:45658) 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc16649640 1 -- 172.21.15.59:0/529386148 learned_addr learned my addr 172.21.15.59:0/529386148 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc15647640 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdbe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc15e48640 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdbdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc16649640 1 -- 172.21.15.59:0/529386148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 msgr2=0x56166cdbdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc16649640 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdbdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc16649640 1 -- 172.21.15.59:0/529386148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 msgr2=0x56166cdbe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc16649640 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdbe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc16649640 1 -- 172.21.15.59:0/529386148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56166ca2d210 con 0x56166cdc0cb0 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.341+0000 7fcc16649640 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdbe580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcc08012a40 tx=0x7fcc08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab662002cde94539 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcbf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcbf97fa640 1 -- 172.21.15.59:0/529386148 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08023070 con 0x56166cdc0cb0 2024-09-10T11:06:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcbf97fa640 1 -- 172.21.15.59:0/529386148 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fcc08015020 con 0x56166cdc0cb0 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/529386148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc040dc110 con 0x56166cdc0cb0 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcbf97fa640 1 -- 172.21.15.59:0/529386148 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcc08010e20 con 0x56166cdc0cb0 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcc1ae4b740 10 client.15657 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/529386148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56166caf9620 con 0x56166cdc0cb0 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcbf97fa640 1 -- 172.21.15.59:0/529386148 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc040dc110 con 0x56166cdc0cb0 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcbf97fa640 1 -- 172.21.15.59:0/529386148 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fcc0800f040 con 0x56166cdc0cb0 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcc1ae4b740 10 client.15657 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcc1ae4b740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcc1ae4b740 20 client.15657 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56166cdd0910 0x56166cdd2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcc1ae4b740 4 client.15657 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.342+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/529386148 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56166cd27a20 con 0x56166cdd0910 2024-09-10T11:06:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.343+0000 7fcc15e48640 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56166cdd0910 0x56166cdd2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.343+0000 7fcc15e48640 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56166cdd0910 0x56166cdd2d20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=683049e253c5b471 server_cookie=5b77209c6620e728 in_seq=0 out_seq=0 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.343+0000 7fcbf97fa640 10 client.15657 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcbf97fa640 1 -- 172.21.15.59:0/529386148 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56166cd27a20 con 0x56166cdd0910 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcbf97fa640 10 client.15657 handle_command_reply: tid=0 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 client.15657 shutdown 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/529386148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 msgr2=0x56166cdbe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdbe580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcc08012a40 tx=0x7fcc08004a40 comp rx=0 tx=0).stop 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/529386148 shutdown_connections 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56166cdd0910 0x56166cdd2d20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdc0cb0 0x56166cdbe580 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdbe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/529386148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdbdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcbf97fa640 0 client.15657 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:28.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/529386148 >> 172.21.15.59:0/529386148 conn(0x56166cdb2060 msgr2=0x56166cdb7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:28.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/529386148 shutdown_connections 2024-09-10T11:06:28.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/529386148 wait complete. 2024-09-10T11:06:28.352 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.344+0000 7fcc1ae4b740 20 client.15657 trim_cache size 0 max 16384 2024-09-10T11:06:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc1ae4b740 1 Processor -- start 2024-09-10T11:06:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc1ae4b740 1 -- start start 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb5af0 0x56166cdbe3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdd8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdc0cb0 0x56166cdd8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101b6770 con 0x56166cdb5af0 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101b4040 con 0x56166cdb6410 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101b1e90 con 0x56166cdc0cb0 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc15e48640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb5af0 0x56166cdbe3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc15e48640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb5af0 0x56166cdbe3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45664/0 (socket says 172.21.15.59:45664) 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.359+0000 7fcc15e48640 1 -- 172.21.15.59:0/219598157 learned_addr learned my addr 172.21.15.59:0/219598157 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcc16649640 1 --2- 172.21.15.59:0/219598157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdc0cb0 0x56166cdd8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcc15647640 1 --2- 172.21.15.59:0/219598157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdd8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcc15e48640 1 -- 172.21.15.59:0/219598157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdc0cb0 msgr2=0x56166cdd8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcc15e48640 1 --2- 172.21.15.59:0/219598157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdc0cb0 0x56166cdd8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcc15e48640 1 -- 172.21.15.59:0/219598157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 msgr2=0x56166cdd8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcc15e48640 1 --2- 172.21.15.59:0/219598157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdd8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcc15e48640 1 -- 172.21.15.59:0/219598157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166cdd33a0 con 0x56166cdb5af0 2024-09-10T11:06:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcc15e48640 1 --2- 172.21.15.59:0/219598157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb5af0 0x56166cdbe3b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x56166cdd35a0 tx=0x7fcc0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a3b961c93176a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcbfb7fe640 1 -- 172.21.15.59:0/219598157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c01e610 con 0x56166cdb5af0 2024-09-10T11:06:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcbfb7fe640 1 -- 172.21.15.59:0/219598157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc0c01ec90 con 0x56166cdb5af0 2024-09-10T11:06:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.360+0000 7fcbfb7fe640 1 -- 172.21.15.59:0/219598157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c025e40 con 0x56166cdb5af0 2024-09-10T11:06:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/219598157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb5af0 msgr2=0x56166cdbe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/219598157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb5af0 0x56166cdbe3b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x56166cdd35a0 tx=0x7fcc0c0046c0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/219598157 shutdown_connections 2024-09-10T11:06:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/219598157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdc0cb0 0x56166cdd8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/219598157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdb6410 0x56166cdd8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/219598157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb5af0 0x56166cdbe3b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/219598157 >> 172.21.15.59:0/219598157 conn(0x56166cdb2060 msgr2=0x56166cdbfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/219598157 shutdown_connections 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/219598157 wait complete. 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 -- start start 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.361+0000 7fcc1ae4b740 1 Processor -- start 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdc9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb6410 0x56166cdbaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc1ae4b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdc0cb0 0x56166cdbafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101b2500 con 0x56166cdb6410 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101b3970 con 0x56166cdc0cb0 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc1ae4b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101b2bd0 con 0x56166cdb5af0 2024-09-10T11:06:28.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc1ae4b740 10 client.0 _ll_register_callbacks cb 0x7fcc08009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15647640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb6410 0x56166cdbaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15647640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb6410 0x56166cdbaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45668/0 (socket says 172.21.15.59:45668) 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15647640 1 -- 172.21.15.59:0/2948436202 learned_addr learned my addr 172.21.15.59:0/2948436202 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15e48640 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdc9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc16649640 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdc0cb0 0x56166cdbafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15647640 1 -- 172.21.15.59:0/2948436202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 msgr2=0x56166cdc9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15647640 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdc9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15647640 1 -- 172.21.15.59:0/2948436202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdc0cb0 msgr2=0x56166cdbafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15647640 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdc0cb0 0x56166cdbafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15647640 1 -- 172.21.15.59:0/2948436202 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56166cdbb7f0 con 0x56166cdb6410 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc16649640 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdc0cb0 0x56166cdbafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:06:28.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcc15647640 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb6410 0x56166cdbaa20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcc040c4760 tx=0x7fcc0403b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d354313f2ba6875 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcbf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.362+0000 7fcbf97fa640 1 -- 172.21.15.59:0/2948436202 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04049040 con 0x56166cdb6410 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcbf97fa640 1 -- 172.21.15.59:0/2948436202 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fcc040ed4d0 con 0x56166cdb6410 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/2948436202 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc0c01ec90 con 0x56166cdb6410 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcbf97fa640 1 -- 172.21.15.59:0/2948436202 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcc040ed6d0 con 0x56166cdb6410 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc1ae4b740 10 client.15663 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/2948436202 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56166ce3b6e0 con 0x56166cdb6410 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcbf97fa640 1 -- 172.21.15.59:0/2948436202 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc0c01ec90 con 0x56166cdb6410 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcbf97fa640 1 -- 172.21.15.59:0/2948436202 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fcc040d8080 con 0x56166cdb6410 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc1ae4b740 10 client.15663 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc1ae4b740 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc1ae4b740 20 client.15663 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56166ce3bd70 0x56166ce3e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:28.370 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc1ae4b740 4 client.15663 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:06:28.371 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/2948436202 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56166cd21d70 con 0x56166ce3bd70 2024-09-10T11:06:28.371 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.363+0000 7fcc15e48640 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56166ce3bd70 0x56166ce3e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:28.371 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.364+0000 7fcbf97fa640 10 client.15663 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:28.371 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.364+0000 7fcc15e48640 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56166ce3bd70 0x56166ce3e190 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a36c770bbe87dc server_cookie=584f3ca312f0514c in_seq=0 out_seq=0 2024-09-10T11:06:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcbf97fa640 1 -- 172.21.15.59:0/2948436202 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56166cd21d70 con 0x56166ce3bd70 2024-09-10T11:06:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcbf97fa640 10 client.15663 handle_command_reply: tid=0 2024-09-10T11:06:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 client.15663 shutdown 2024-09-10T11:06:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/2948436202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb6410 msgr2=0x56166cdbaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb6410 0x56166cdbaa20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcc040c4760 tx=0x7fcc0403b460 comp rx=0 tx=0).stop 2024-09-10T11:06:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/2948436202 shutdown_connections 2024-09-10T11:06:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56166ce3bd70 0x56166ce3e190 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56166cdc0cb0 0x56166cdbafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56166cdb6410 0x56166cdbaa20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcbf97fa640 0 client.15663 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 --2- 172.21.15.59:0/2948436202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56166cdb5af0 0x56166cdc9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/2948436202 >> 172.21.15.59:0/2948436202 conn(0x56166cdb2060 msgr2=0x56166cdb7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/2948436202 shutdown_connections 2024-09-10T11:06:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 1 -- 172.21.15.59:0/2948436202 wait complete. 2024-09-10T11:06:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.378+0000 7fcc1ae4b740 20 client.15663 trim_cache size 0 max 16384 2024-09-10T11:06:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:06:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:06:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:06:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:06:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 -- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcbfc0a2e20 msgr2=0x7fcbfc0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcbfc0a2e20 0x7fcbfc0a52e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009fd0 tx=0x7fcc08004ab0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 -- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 msgr2=0x7fcc101a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 0x7fcc101a4bb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcc04006010 tx=0x7fcc040042f0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 -- 172.21.15.59:0/3602153796 shutdown_connections 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc10105ee0 0x7fcc1019e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101013d0 0x7fcc101a4bb0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcbfc0a2e20 0x7fcbfc0a52e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 --2- 172.21.15.59:0/3602153796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc10100ab0 0x7fcc101a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 -- 172.21.15.59:0/3602153796 >> 172.21.15.59:0/3602153796 conn(0x7fcc100fc6b0 msgr2=0x7fcc10103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 -- 172.21.15.59:0/3602153796 shutdown_connections 2024-09-10T11:06:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:28.379+0000 7fcc180ac640 1 -- 172.21.15.59:0/3602153796 wait complete. 2024-09-10T11:06:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:29 smithi059 ceph-mon[30978]: pgmap v157: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:06:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:06:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:06:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:06:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:06:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:29 smithi181 ceph-mon[35409]: pgmap v157: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:06:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:06:30.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:06:30.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:06:30.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:06:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:29 smithi115 ceph-mon[34719]: pgmap v157: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:06:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:06:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:06:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:06:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:06:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:31 smithi059 ceph-mon[30978]: pgmap v158: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T11:06:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:31 smithi181 ceph-mon[35409]: pgmap v158: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T11:06:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:31 smithi115 ceph-mon[34719]: pgmap v158: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T11:06:34.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:33 smithi059 ceph-mon[30978]: pgmap v159: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T11:06:34.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:33 smithi181 ceph-mon[35409]: pgmap v159: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T11:06:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:33 smithi115 ceph-mon[34719]: pgmap v159: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T11:06:36.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:35 smithi059 ceph-mon[30978]: pgmap v160: 97 pgs: 97 active+clean; 3.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:06:36.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:35 smithi181 ceph-mon[35409]: pgmap v160: 97 pgs: 97 active+clean; 3.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:06:36.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:35 smithi115 ceph-mon[34719]: pgmap v160: 97 pgs: 97 active+clean; 3.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:06:38.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:37 smithi059 ceph-mon[30978]: pgmap v161: 97 pgs: 97 active+clean; 3.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-10T11:06:38.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:37 smithi181 ceph-mon[35409]: pgmap v161: 97 pgs: 97 active+clean; 3.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-10T11:06:38.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:37 smithi115 ceph-mon[34719]: pgmap v161: 97 pgs: 97 active+clean; 3.6 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-10T11:06:40.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:39 smithi059 ceph-mon[30978]: pgmap v162: 97 pgs: 97 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-09-10T11:06:40.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:39 smithi181 ceph-mon[35409]: pgmap v162: 97 pgs: 97 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-09-10T11:06:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:39 smithi115 ceph-mon[34719]: pgmap v162: 97 pgs: 97 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-09-10T11:06:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.480+0000 7fc0211f8640 1 -- 172.21.15.59:0/1230588479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c107b70 msgr2=0x7fc01c107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.480+0000 7fc0211f8640 1 --2- 172.21.15.59:0/1230588479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c107b70 0x7fc01c107f50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009cd0 tx=0x7fc00c02a8e0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.480+0000 7fc0211f8640 1 -- 172.21.15.59:0/1230588479 shutdown_connections 2024-09-10T11:06:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.480+0000 7fc0211f8640 1 --2- 172.21.15.59:0/1230588479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01c102470 0x7fc01c10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.480+0000 7fc0211f8640 1 --2- 172.21.15.59:0/1230588479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01c101ad0 0x7fc01c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.480+0000 7fc0211f8640 1 --2- 172.21.15.59:0/1230588479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c107b70 0x7fc01c107f50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.480+0000 7fc0211f8640 1 -- 172.21.15.59:0/1230588479 >> 172.21.15.59:0/1230588479 conn(0x7fc01c0fd7d0 msgr2=0x7fc01c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.480+0000 7fc0211f8640 1 -- 172.21.15.59:0/1230588479 shutdown_connections 2024-09-10T11:06:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.480+0000 7fc0211f8640 1 -- 172.21.15.59:0/1230588479 wait complete. 2024-09-10T11:06:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc0211f8640 1 Processor -- start 2024-09-10T11:06:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc0211f8640 1 -- start start 2024-09-10T11:06:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc0211f8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c101ad0 0x7fc01c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc0211f8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01c102470 0x7fc01c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc0211f8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01c107b70 0x7fc01c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc0211f8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c111f20 con 0x7fc01c101ad0 2024-09-10T11:06:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc0211f8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c111da0 con 0x7fc01c102470 2024-09-10T11:06:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc0211f8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1120a0 con 0x7fc01c107b70 2024-09-10T11:06:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc01ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c101ad0 0x7fc01c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc01ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c101ad0 0x7fc01c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44892/0 (socket says 172.21.15.59:44892) 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc01ad9d640 1 -- 172.21.15.59:0/781346858 learned_addr learned my addr 172.21.15.59:0/781346858 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc01a59c640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01c102470 0x7fc01c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.481+0000 7fc01b59e640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01c107b70 0x7fc01c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc01ad9d640 1 -- 172.21.15.59:0/781346858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01c107b70 msgr2=0x7fc01c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01c107b70 0x7fc01c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc01ad9d640 1 -- 172.21.15.59:0/781346858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01c102470 msgr2=0x7fc01c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01c102470 0x7fc01c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc01ad9d640 1 -- 172.21.15.59:0/781346858 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01c19d420 con 0x7fc01c101ad0 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc01b59e640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01c107b70 0x7fc01c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c101ad0 0x7fc01c198430 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc00c02ae00 tx=0x7fc00c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc013fff640 1 -- 172.21.15.59:0/781346858 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c004040 con 0x7fc01c101ad0 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc0211f8640 1 -- 172.21.15.59:0/781346858 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01c19d6b0 con 0x7fc01c101ad0 2024-09-10T11:06:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc013fff640 1 -- 172.21.15.59:0/781346858 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc00c0046c0 con 0x7fc01c101ad0 2024-09-10T11:06:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc013fff640 1 -- 172.21.15.59:0/781346858 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c046480 con 0x7fc01c101ad0 2024-09-10T11:06:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.482+0000 7fc0211f8640 1 -- 172.21.15.59:0/781346858 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc01c1a4fa0 con 0x7fc01c101ad0 2024-09-10T11:06:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.484+0000 7fc013fff640 1 -- 172.21.15.59:0/781346858 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc00c0305a0 con 0x7fc01c101ad0 2024-09-10T11:06:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc024067740 1 Processor -- start 2024-09-10T11:06:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc024067740 1 -- start start 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc024067740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3161af0 0x55bcd3161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc024067740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 0x55bcd316c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc024067740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc024067740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bcd30c62f0 con 0x55bcd316ccb0 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc024067740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55bcd306e270 con 0x55bcd3161af0 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc024067740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bcd30c22b0 con 0x55bcd3162410 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc01a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc01a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44894/0 (socket says 172.21.15.59:44894) 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.485+0000 7fc01a59c640 1 -- 172.21.15.59:0/3174616591 learned_addr learned my addr 172.21.15.59:0/3174616591 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/3174616591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 0x55bcd316c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc01b59e640 1 --2- 172.21.15.59:0/3174616591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3161af0 0x55bcd3161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc013fff640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc0080a2da0 0x7fc0080a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc01a59c640 1 -- 172.21.15.59:0/3174616591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 msgr2=0x55bcd316c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc01a59c640 1 --2- 172.21.15.59:0/3174616591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 0x55bcd316c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc01a59c640 1 -- 172.21.15.59:0/3174616591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3161af0 msgr2=0x55bcd3161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc01a59c640 1 --2- 172.21.15.59:0/3174616591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3161af0 0x55bcd3161ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc01a59c640 1 -- 172.21.15.59:0/3174616591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd306d340 con 0x55bcd316ccb0 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc01b59e640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc0080a2da0 0x7fc0080a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc013fff640 1 -- 172.21.15.59:0/781346858 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fc00c02e030 con 0x7fc01c101ad0 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc01a59c640 1 --2- 172.21.15.59:0/3174616591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316f0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc00400bcb0 tx=0x7fc0040107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736fda3e9b04d038 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc0117fa640 1 -- 172.21.15.59:0/3174616591 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004004030 con 0x55bcd316ccb0 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc0117fa640 1 -- 172.21.15.59:0/3174616591 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0040041d0 con 0x55bcd316ccb0 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.486+0000 7fc0117fa640 1 -- 172.21.15.59:0/3174616591 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004011840 con 0x55bcd316ccb0 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc024067740 1 -- 172.21.15.59:0/3174616591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 msgr2=0x55bcd316f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc01b59e640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc0080a2da0 0x7fc0080a5260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc014005fd0 tx=0x7fc0140046c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc024067740 1 --2- 172.21.15.59:0/3174616591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316f0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc00400bcb0 tx=0x7fc0040107a0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc024067740 1 -- 172.21.15.59:0/3174616591 shutdown_connections 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc024067740 1 --2- 172.21.15.59:0/3174616591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316f0a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc024067740 1 --2- 172.21.15.59:0/3174616591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 0x55bcd316c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc024067740 1 --2- 172.21.15.59:0/3174616591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3161af0 0x55bcd3161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc024067740 1 -- 172.21.15.59:0/3174616591 >> 172.21.15.59:0/3174616591 conn(0x55bcd315e060 msgr2=0x55bcd315e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc024067740 1 -- 172.21.15.59:0/3174616591 shutdown_connections 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.487+0000 7fc024067740 1 -- 172.21.15.59:0/3174616591 wait complete. 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc024067740 1 -- start start 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc024067740 1 Processor -- start 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc024067740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3161af0 0x55bcd3169bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc024067740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 0x55bcd316a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc024067740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc024067740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bcd316f880 con 0x55bcd316ccb0 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc024067740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55bcd304f290 con 0x55bcd3162410 2024-09-10T11:06:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc024067740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bcd316fa00 con 0x55bcd3161af0 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc024067740 10 client.0 _ll_register_callbacks cb 0x55bcd3080140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc01b59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc01b59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44910/0 (socket says 172.21.15.59:44910) 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc01b59e640 1 -- 172.21.15.59:0/1715873296 learned_addr learned my addr 172.21.15.59:0/1715873296 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc01a59c640 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 0x55bcd316a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.488+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3161af0 0x55bcd3169bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc01b59e640 1 -- 172.21.15.59:0/1715873296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3161af0 msgr2=0x55bcd3169bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc01b59e640 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3161af0 0x55bcd3169bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc01b59e640 1 -- 172.21.15.59:0/1715873296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 msgr2=0x55bcd316a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc01b59e640 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 0x55bcd316a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc01b59e640 1 -- 172.21.15.59:0/1715873296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd2dd9210 con 0x55bcd316ccb0 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3161af0 0x55bcd3169bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:06:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc01b59e640 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316a640 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc01400d610 tx=0x7fc014004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff4edc252790d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc0027fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc0027fc640 1 -- 172.21.15.59:0/1715873296 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014022070 con 0x55bcd316ccb0 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc0027fc640 1 -- 172.21.15.59:0/1715873296 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fc014010a20 con 0x55bcd316ccb0 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc024067740 1 -- 172.21.15.59:0/1715873296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0040041d0 con 0x55bcd316ccb0 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc0027fc640 1 -- 172.21.15.59:0/1715873296 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc01402e050 con 0x55bcd316ccb0 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc024067740 10 client.15675 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc024067740 1 -- 172.21.15.59:0/1715873296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bcd2ea5620 con 0x55bcd316ccb0 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc0027fc640 1 -- 172.21.15.59:0/1715873296 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0040041d0 con 0x55bcd316ccb0 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.489+0000 7fc0027fc640 1 -- 172.21.15.59:0/1715873296 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc01401d3b0 con 0x55bcd316ccb0 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.490+0000 7fc024067740 10 client.15675 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.490+0000 7fc024067740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.490+0000 7fc024067740 20 client.15675 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.490+0000 7fc024067740 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bcd317ccb0 0x55bcd317f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.490+0000 7fc024067740 4 client.15675 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.490+0000 7fc024067740 1 -- 172.21.15.59:0/1715873296 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcd30d3a20 con 0x55bcd317ccb0 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.490+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bcd317ccb0 0x55bcd317f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.490+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bcd317ccb0 0x55bcd317f120 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da39239251bbf1e server_cookie=949669dd6ba9567c in_seq=0 out_seq=0 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.490+0000 7fc0027fc640 10 client.15675 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc0027fc640 1 -- 172.21.15.59:0/1715873296 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bcd30d3a20 con 0x55bcd317ccb0 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc0027fc640 10 client.15675 handle_command_reply: tid=0 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 client.15675 shutdown 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 -- 172.21.15.59:0/1715873296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 msgr2=0x55bcd316a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316a640 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc01400d610 tx=0x7fc014004730 comp rx=0 tx=0).stop 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 -- 172.21.15.59:0/1715873296 shutdown_connections 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bcd317ccb0 0x55bcd317f120 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd316ccb0 0x55bcd316a640 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 0x55bcd316a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 --2- 172.21.15.59:0/1715873296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3161af0 0x55bcd3169bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc0027fc640 0 client.15675 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 -- 172.21.15.59:0/1715873296 >> 172.21.15.59:0/1715873296 conn(0x55bcd315e060 msgr2=0x55bcd3163d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 -- 172.21.15.59:0/1715873296 shutdown_connections 2024-09-10T11:06:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 1 -- 172.21.15.59:0/1715873296 wait complete. 2024-09-10T11:06:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.491+0000 7fc024067740 20 client.15675 trim_cache size 0 max 16384 2024-09-10T11:06:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.506+0000 7fc024067740 1 Processor -- start 2024-09-10T11:06:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.506+0000 7fc024067740 1 -- start start 2024-09-10T11:06:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.506+0000 7fc024067740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd316bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.506+0000 7fc024067740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 0x55bcd316a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.506+0000 7fc024067740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd316ccb0 0x55bcd3184a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.506+0000 7fc024067740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1b0090 con 0x55bcd3161af0 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.506+0000 7fc024067740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1ad960 con 0x55bcd316ccb0 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.506+0000 7fc024067740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1ab7b0 con 0x55bcd3162410 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.506+0000 7fc01ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd316bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd316bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44916/0 (socket says 172.21.15.59:44916) 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01ad9d640 1 -- 172.21.15.59:0/2440189297 learned_addr learned my addr 172.21.15.59:0/2440189297 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01a59c640 1 --2- 172.21.15.59:0/2440189297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 0x55bcd316a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01ad9d640 1 -- 172.21.15.59:0/2440189297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 msgr2=0x55bcd316a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/2440189297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 0x55bcd316a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01ad9d640 1 -- 172.21.15.59:0/2440189297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd316ccb0 msgr2=0x55bcd3184a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/2440189297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd316ccb0 0x55bcd3184a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01ad9d640 1 -- 172.21.15.59:0/2440189297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd3161920 con 0x55bcd3161af0 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01a59c640 1 --2- 172.21.15.59:0/2440189297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 0x55bcd316a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/2440189297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd316bef0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0dd190 tx=0x7fc00c0f2bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f020e878407ca4c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc010ff9640 1 -- 172.21.15.59:0/2440189297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c0bc880 con 0x55bcd3161af0 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc010ff9640 1 -- 172.21.15.59:0/2440189297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc00c036060 con 0x55bcd3161af0 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.507+0000 7fc010ff9640 1 -- 172.21.15.59:0/2440189297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c0c5b90 con 0x55bcd3161af0 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 -- 172.21.15.59:0/2440189297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 msgr2=0x55bcd316bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 --2- 172.21.15.59:0/2440189297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd316bef0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0dd190 tx=0x7fc00c0f2bc0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 -- 172.21.15.59:0/2440189297 shutdown_connections 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 --2- 172.21.15.59:0/2440189297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd316ccb0 0x55bcd3184a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 --2- 172.21.15.59:0/2440189297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd3162410 0x55bcd316a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 --2- 172.21.15.59:0/2440189297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd316bef0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 -- 172.21.15.59:0/2440189297 >> 172.21.15.59:0/2440189297 conn(0x55bcd315e060 msgr2=0x55bcd315d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 -- 172.21.15.59:0/2440189297 shutdown_connections 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 -- 172.21.15.59:0/2440189297 wait complete. 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 -- start start 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.508+0000 7fc024067740 1 Processor -- start 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc024067740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd3174eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc024067740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 0x55bcd31753f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc024067740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd316ccb0 0x55bcd3171c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc024067740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1abe20 con 0x55bcd3161af0 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc024067740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1ad290 con 0x55bcd3162410 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc024067740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1ac4f0 con 0x55bcd316ccb0 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc024067740 10 client.0 _ll_register_callbacks cb 0x7fc01400d480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd3174eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd3174eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44926/0 (socket says 172.21.15.59:44926) 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01ad9d640 1 -- 172.21.15.59:0/3050507842 learned_addr learned my addr 172.21.15.59:0/3050507842 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01b59e640 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd316ccb0 0x55bcd3171c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01a59c640 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 0x55bcd31753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01ad9d640 1 -- 172.21.15.59:0/3050507842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd316ccb0 msgr2=0x55bcd3171c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd316ccb0 0x55bcd3171c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01ad9d640 1 -- 172.21.15.59:0/3050507842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 msgr2=0x55bcd31753f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 0x55bcd31753f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01ad9d640 1 -- 172.21.15.59:0/3050507842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd317b8a0 con 0x55bcd3161af0 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01b59e640 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd316ccb0 0x55bcd3171c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc01ad9d640 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd3174eb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0c5660 tx=0x7fc00c0f6260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf38fd3f901417e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc0027fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc0027fc640 1 -- 172.21.15.59:0/3050507842 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c0c5b90 con 0x55bcd3161af0 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc0027fc640 1 -- 172.21.15.59:0/3050507842 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fc00c0ee2c0 con 0x55bcd3161af0 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.509+0000 7fc024067740 1 -- 172.21.15.59:0/3050507842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc00c036060 con 0x55bcd3161af0 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc0027fc640 1 -- 172.21.15.59:0/3050507842 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc00c0ee4c0 con 0x55bcd3161af0 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc024067740 10 client.15681 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc024067740 1 -- 172.21.15.59:0/3050507842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bcd31e8230 con 0x55bcd3161af0 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc0027fc640 1 -- 172.21.15.59:0/3050507842 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc00c036060 con 0x55bcd3161af0 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc0027fc640 1 -- 172.21.15.59:0/3050507842 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc00c0da050 con 0x55bcd3161af0 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc024067740 10 client.15681 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc024067740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc024067740 20 client.15681 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc024067740 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bcd31e88a0 0x55bcd31eac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc024067740 4 client.15681 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc024067740 1 -- 172.21.15.59:0/3050507842 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bcd30cdd70 con 0x55bcd31e88a0 2024-09-10T11:06:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.510+0000 7fc01a59c640 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bcd31e88a0 0x55bcd31eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.511+0000 7fc01a59c640 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bcd31e88a0 0x55bcd31eac90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=820a830ef81ce045 server_cookie=82bff2cf84beb024 in_seq=0 out_seq=0 2024-09-10T11:06:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.511+0000 7fc0027fc640 10 client.15681 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc0027fc640 1 -- 172.21.15.59:0/3050507842 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bcd30cdd70 con 0x55bcd31e88a0 2024-09-10T11:06:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc0027fc640 10 client.15681 handle_command_reply: tid=0 2024-09-10T11:06:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 client.15681 shutdown 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 -- 172.21.15.59:0/3050507842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 msgr2=0x55bcd3174eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd3174eb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0c5660 tx=0x7fc00c0f6260 comp rx=0 tx=0).stop 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 -- 172.21.15.59:0/3050507842 shutdown_connections 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55bcd31e88a0 0x55bcd31eac90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcd316ccb0 0x55bcd3171c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bcd3162410 0x55bcd31753f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc0027fc640 0 client.15681 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 --2- 172.21.15.59:0/3050507842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcd3161af0 0x55bcd3174eb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 -- 172.21.15.59:0/3050507842 >> 172.21.15.59:0/3050507842 conn(0x55bcd315e060 msgr2=0x55bcd3163550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 -- 172.21.15.59:0/3050507842 shutdown_connections 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 1 -- 172.21.15.59:0/3050507842 wait complete. 2024-09-10T11:06:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.525+0000 7fc024067740 20 client.15681 trim_cache size 0 max 16384 2024-09-10T11:06:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:06:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:06:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:06:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 -- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc0080a2da0 msgr2=0x7fc0080a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc0080a2da0 0x7fc0080a5260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc014005fd0 tx=0x7fc0140046c0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 -- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c101ad0 msgr2=0x7fc01c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c101ad0 0x7fc01c198430 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc00c02ae00 tx=0x7fc00c003970 comp rx=0 tx=0).stop 2024-09-10T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 -- 172.21.15.59:0/781346858 shutdown_connections 2024-09-10T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc0080a2da0 0x7fc0080a5260 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01c107b70 0x7fc01c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01c102470 0x7fc01c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 --2- 172.21.15.59:0/781346858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc01c101ad0 0x7fc01c198430 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 -- 172.21.15.59:0/781346858 >> 172.21.15.59:0/781346858 conn(0x7fc01c0fd7d0 msgr2=0x7fc01c0fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 -- 172.21.15.59:0/781346858 shutdown_connections 2024-09-10T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:41.526+0000 7fc0211f8640 1 -- 172.21.15.59:0/781346858 wait complete. 2024-09-10T11:06:41.790 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.790 INFO:tasks.workunit.client.0.smithi059.stdout:189/600: open fd = 3 2024-09-10T11:06:41.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.790 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.790 INFO:tasks.workunit.client.0.smithi059.stdout:190/600: open fd = 3 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:191/600: open fd = 3 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:192/600: open fd = 3 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:193/600: open fd = 3 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:194/600: open fd = 3 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:195/600: open fd = 3 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:196/600: open fd = 3 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:197/600: open fd = 3 2024-09-10T11:06:41.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:198/600: open fd = 3 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:199/600: open fd = 3 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:200/600: open fd = 3 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.793 INFO:tasks.workunit.client.0.smithi059.stdout:201/600: open fd = 3 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:202/600: open fd = 3 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:203/600: open fd = 3 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:204/600: open fd = 3 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:205/600: open fd = 3 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:206/600: open fd = 3 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:207/600: open fd = 3 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:208/600: open fd = 3 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:209/600: open fd = 3 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:210/600: open fd = 3 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:211/600: open fd = 3 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:212/600: open fd = 3 2024-09-10T11:06:41.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:213/600: open fd = 3 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:214/600: open fd = 3 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:215/600: open fd = 3 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:216/600: open fd = 3 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:217/600: open fd = 3 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:218/600: open fd = 3 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.798 INFO:tasks.workunit.client.0.smithi059.stdout:219/600: open fd = 3 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:220/600: open fd = 3 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:221/600: open fd = 3 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:222/600: open fd = 3 2024-09-10T11:06:41.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:223/600: open fd = 3 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:224/600: open fd = 3 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:225/600: open fd = 3 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:226/600: open fd = 3 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:227/600: open fd = 3 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:228/600: open fd = 3 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.801 INFO:tasks.workunit.client.0.smithi059.stdout:229/600: open fd = 3 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:230/600: open fd = 3 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:231/600: open fd = 3 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:232/600: open fd = 3 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:233/600: open fd = 3 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:234/600: open fd = 3 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:235/600: open fd = 3 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:236/600: open fd = 3 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:237/600: open fd = 3 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:238/600: open fd = 3 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:239/600: open fd = 3 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:240/600: open fd = 3 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:241/600: open fd = 3 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:242/600: open fd = 3 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:243/600: open fd = 3 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:244/600: open fd = 3 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.806 INFO:tasks.workunit.client.0.smithi059.stdout:245/600: open fd = 3 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:246/600: open fd = 3 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:247/600: open fd = 3 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:248/600: open fd = 3 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.807 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.808 INFO:tasks.workunit.client.0.smithi059.stdout:249/600: open fd = 3 2024-09-10T11:06:41.808 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.808 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.808 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:06:41.808 INFO:tasks.workunit.client.0.smithi059.stdout:250/600: open fd = 3 2024-09-10T11:06:41.808 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:41.808 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:06:42.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:41 smithi059 ceph-mon[30978]: pgmap v163: 97 pgs: 97 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:42.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:41 smithi181 ceph-mon[35409]: pgmap v163: 97 pgs: 97 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:42.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:41 smithi115 ceph-mon[34719]: pgmap v163: 97 pgs: 97 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:44.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:43 smithi059 ceph-mon[30978]: pgmap v164: 97 pgs: 97 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:44.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:43 smithi181 ceph-mon[35409]: pgmap v164: 97 pgs: 97 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:44.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:43 smithi115 ceph-mon[34719]: pgmap v164: 97 pgs: 97 active+clean; 3.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:06:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:45 smithi181 ceph-mon[35409]: pgmap v165: 97 pgs: 97 active+clean; 4.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 56 KiB/s wr, 19 op/s 2024-09-10T11:06:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:45 smithi115 ceph-mon[34719]: pgmap v165: 97 pgs: 97 active+clean; 4.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 56 KiB/s wr, 19 op/s 2024-09-10T11:06:46.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:45 smithi059 ceph-mon[30978]: pgmap v165: 97 pgs: 97 active+clean; 4.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 56 KiB/s wr, 19 op/s 2024-09-10T11:06:48.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:47 smithi181 ceph-mon[35409]: pgmap v166: 97 pgs: 97 active+clean; 4.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-10T11:06:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:47 smithi115 ceph-mon[34719]: pgmap v166: 97 pgs: 97 active+clean; 4.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-10T11:06:48.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:47 smithi059 ceph-mon[30978]: pgmap v166: 97 pgs: 97 active+clean; 4.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-10T11:06:50.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:49 smithi181 ceph-mon[35409]: pgmap v167: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-09-10T11:06:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:49 smithi115 ceph-mon[34719]: pgmap v167: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-09-10T11:06:50.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:49 smithi059 ceph-mon[30978]: pgmap v167: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-09-10T11:06:52.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:51 smithi181 ceph-mon[35409]: pgmap v168: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-09-10T11:06:52.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:51 smithi115 ceph-mon[34719]: pgmap v168: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-09-10T11:06:52.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:51 smithi059 ceph-mon[30978]: pgmap v168: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-09-10T11:06:54.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:53 smithi181 ceph-mon[35409]: pgmap v169: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-09-10T11:06:54.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:53 smithi115 ceph-mon[34719]: pgmap v169: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-09-10T11:06:54.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:53 smithi059 ceph-mon[30978]: pgmap v169: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-09-10T11:06:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 -- 172.21.15.59:0/1933830525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41741009f0 msgr2=0x7f4174100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 --2- 172.21.15.59:0/1933830525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41741009f0 0x7f4174100e50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4168009930 tx=0x7f416802a420 comp rx=0 tx=0).stop 2024-09-10T11:06:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 -- 172.21.15.59:0/1933830525 shutdown_connections 2024-09-10T11:06:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 --2- 172.21.15.59:0/1933830525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4174101390 0x7f417410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 --2- 172.21.15.59:0/1933830525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41741009f0 0x7f4174100e50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 --2- 172.21.15.59:0/1933830525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4174106a00 0x7f4174106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 -- 172.21.15.59:0/1933830525 >> 172.21.15.59:0/1933830525 conn(0x7f41740fc6b0 msgr2=0x7f41740fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 -- 172.21.15.59:0/1933830525 shutdown_connections 2024-09-10T11:06:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 -- 172.21.15.59:0/1933830525 wait complete. 2024-09-10T11:06:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 Processor -- start 2024-09-10T11:06:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.626+0000 7f417a71a640 1 -- start start 2024-09-10T11:06:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f417a71a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41741009f0 0x7f41741972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f417a71a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4174101390 0x7f4174197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f417a71a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4174106a00 0x7f417419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f417a71a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4174110e40 con 0x7f4174101390 2024-09-10T11:06:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f417a71a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4174110cc0 con 0x7f4174106a00 2024-09-10T11:06:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f417a71a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4174110fc0 con 0x7f41741009f0 2024-09-10T11:06:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f41737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4174101390 0x7f4174197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f41737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4174101390 0x7f4174197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57742/0 (socket says 172.21.15.59:57742) 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f4173fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41741009f0 0x7f41741972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f41737fe640 1 -- 172.21.15.59:0/2866333938 learned_addr learned my addr 172.21.15.59:0/2866333938 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f4178cb7640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4174106a00 0x7f417419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f41737fe640 1 -- 172.21.15.59:0/2866333938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41741009f0 msgr2=0x7f41741972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f41737fe640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41741009f0 0x7f41741972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f41737fe640 1 -- 172.21.15.59:0/2866333938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4174106a00 msgr2=0x7f417419bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f41737fe640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4174106a00 0x7f417419bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.627+0000 7f41737fe640 1 -- 172.21.15.59:0/2866333938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417419c2e0 con 0x7f4174101390 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.628+0000 7f41737fe640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4174101390 0x7f4174197830 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4168009230 tx=0x7f4168004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.628+0000 7f41717fa640 1 -- 172.21.15.59:0/2866333938 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416803f030 con 0x7f4174101390 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.628+0000 7f41717fa640 1 -- 172.21.15.59:0/2866333938 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4168003ad0 con 0x7f4174101390 2024-09-10T11:06:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.628+0000 7f417a71a640 1 -- 172.21.15.59:0/2866333938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417419c570 con 0x7f4174101390 2024-09-10T11:06:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.628+0000 7f41717fa640 1 -- 172.21.15.59:0/2866333938 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168035070 con 0x7f4174101390 2024-09-10T11:06:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.628+0000 7f417a71a640 1 -- 172.21.15.59:0/2866333938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41741a3e60 con 0x7f4174101390 2024-09-10T11:06:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.630+0000 7f41717fa640 1 -- 172.21.15.59:0/2866333938 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4168042030 con 0x7f4174101390 2024-09-10T11:06:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f417d4ae740 1 Processor -- start 2024-09-10T11:06:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f417d4ae740 1 -- start start 2024-09-10T11:06:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71e9d0 0x56156f71edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71f2f0 0x56156f72b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f72e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f417d4ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56156f6832f0 con 0x56156f72bec0 2024-09-10T11:06:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f417d4ae740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56156f62b270 con 0x56156f71f2f0 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f417d4ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56156f67f2b0 con 0x56156f71e9d0 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f41717fa640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f415c0a2da0 0x7f415c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f41737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f72e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f4178cb7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71e9d0 0x56156f71edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f41737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f72e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57756/0 (socket says 172.21.15.59:57756) 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f41737fe640 1 -- 172.21.15.59:0/1098243201 learned_addr learned my addr 172.21.15.59:0/1098243201 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f4173fff640 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71f2f0 0x56156f72b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.631+0000 7f4178cb7640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f415c0a2da0 0x7f415c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f41717fa640 1 -- 172.21.15.59:0/2866333938 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f41680ef970 con 0x7f4174101390 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f41737fe640 1 -- 172.21.15.59:0/1098243201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71e9d0 msgr2=0x56156f71edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f41737fe640 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71e9d0 0x56156f71edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f41737fe640 1 -- 172.21.15.59:0/1098243201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71f2f0 msgr2=0x56156f72b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f41737fe640 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71f2f0 0x56156f72b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f41737fe640 1 -- 172.21.15.59:0/1098243201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56156f62a340 con 0x56156f72bec0 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f4178cb7640 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71e9d0 0x56156f71edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f4173fff640 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71f2f0 0x56156f72b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f41737fe640 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f72e2b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f41680bbb40 tx=0x7f4168005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c97001688b2ef93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f4178cb7640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f415c0a2da0 0x7f415c0a5260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f416c009990 tx=0x7f416c0096a0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f415a7fc640 1 -- 172.21.15.59:0/1098243201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168049020 con 0x56156f72bec0 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f415a7fc640 1 -- 172.21.15.59:0/1098243201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41680c4a80 con 0x56156f72bec0 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.632+0000 7f415a7fc640 1 -- 172.21.15.59:0/1098243201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168031bd0 con 0x56156f72bec0 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 -- 172.21.15.59:0/1098243201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 msgr2=0x56156f72e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f72e2b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f41680bbb40 tx=0x7f4168005c00 comp rx=0 tx=0).stop 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 -- 172.21.15.59:0/1098243201 shutdown_connections 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f72e2b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71f2f0 0x56156f72b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 --2- 172.21.15.59:0/1098243201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71e9d0 0x56156f71edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 -- 172.21.15.59:0/1098243201 >> 172.21.15.59:0/1098243201 conn(0x56156f71b060 msgr2=0x56156f71b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 -- 172.21.15.59:0/1098243201 shutdown_connections 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 -- 172.21.15.59:0/1098243201 wait complete. 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.633+0000 7f417d4ae740 1 -- start start 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f417d4ae740 1 Processor -- start 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f728e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f729350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 0x56156f729890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f417d4ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56156f72e8b0 con 0x56156f71f2f0 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f417d4ae740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56156f60c290 con 0x56156f71e9d0 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f417d4ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56156f72ea30 con 0x56156f72bec0 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f417d4ae740 10 client.0 _ll_register_callbacks cb 0x56156f63d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f41737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f729350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f41737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f729350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57770/0 (socket says 172.21.15.59:57770) 2024-09-10T11:06:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f41737fe640 1 -- 172.21.15.59:0/2590891157 learned_addr learned my addr 172.21.15.59:0/2590891157 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f4178cb7640 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 0x56156f729890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f4173fff640 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f728e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f41737fe640 1 -- 172.21.15.59:0/2590891157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 msgr2=0x56156f729890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f41737fe640 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 0x56156f729890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f41737fe640 1 -- 172.21.15.59:0/2590891157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 msgr2=0x56156f728e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f41737fe640 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f728e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.634+0000 7f41737fe640 1 -- 172.21.15.59:0/2590891157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56156f396210 con 0x56156f71f2f0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f41737fe640 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f729350 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f41680bbe50 tx=0x7f41680c02f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee5ed7836fed3df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f41537fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f41537fe640 1 -- 172.21.15.59:0/2590891157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168049070 con 0x56156f71f2f0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f41537fe640 1 -- 172.21.15.59:0/2590891157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f41680ed2c0 con 0x56156f71f2f0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f417d4ae740 1 -- 172.21.15.59:0/2590891157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41680c4a80 con 0x56156f71f2f0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f41537fe640 1 -- 172.21.15.59:0/2590891157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f41680ed4c0 con 0x56156f71f2f0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f417d4ae740 10 client.15693 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f417d4ae740 1 -- 172.21.15.59:0/2590891157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56156f462620 con 0x56156f71f2f0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f41537fe640 1 -- 172.21.15.59:0/2590891157 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41680c4a80 con 0x56156f71f2f0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f41537fe640 1 -- 172.21.15.59:0/2590891157 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f416809ace0 con 0x56156f71f2f0 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f417d4ae740 10 client.15693 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f417d4ae740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f417d4ae740 20 client.15693 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f417d4ae740 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56156f73baa0 0x56156f73de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f417d4ae740 4 client.15693 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.635+0000 7f417d4ae740 1 -- 172.21.15.59:0/2590891157 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56156f690a20 con 0x56156f73baa0 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.636+0000 7f4173fff640 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56156f73baa0 0x56156f73de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.636+0000 7f4173fff640 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56156f73baa0 0x56156f73de90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e56c222926c09851 server_cookie=637b2df3ca20912c in_seq=0 out_seq=0 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.636+0000 7f41537fe640 10 client.15693 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f41537fe640 1 -- 172.21.15.59:0/2590891157 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56156f690a20 con 0x56156f73baa0 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f41537fe640 10 client.15693 handle_command_reply: tid=0 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 client.15693 shutdown 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 -- 172.21.15.59:0/2590891157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 msgr2=0x56156f729350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f729350 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f41680bbe50 tx=0x7f41680c02f0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 -- 172.21.15.59:0/2590891157 shutdown_connections 2024-09-10T11:06:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56156f73baa0 0x56156f73de90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 0x56156f729890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f729350 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f41537fe640 0 client.15693 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 --2- 172.21.15.59:0/2590891157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f728e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 -- 172.21.15.59:0/2590891157 >> 172.21.15.59:0/2590891157 conn(0x56156f71b060 msgr2=0x56156f720dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 -- 172.21.15.59:0/2590891157 shutdown_connections 2024-09-10T11:06:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 1 -- 172.21.15.59:0/2590891157 wait complete. 2024-09-10T11:06:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.637+0000 7f417d4ae740 20 client.15693 trim_cache size 0 max 16384 2024-09-10T11:06:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f417d4ae740 1 Processor -- start 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f417d4ae740 1 -- start start 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f720cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71f2f0 0x56156f743690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f743bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f417d4ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f41741adfa0 con 0x56156f72bec0 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f417d4ae740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f41741ab870 con 0x56156f71e9d0 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f417d4ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f41741a96c0 con 0x56156f71f2f0 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f4178cb7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f743bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f4178cb7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f743bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57786/0 (socket says 172.21.15.59:57786) 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f4178cb7640 1 -- 172.21.15.59:0/789333959 learned_addr learned my addr 172.21.15.59:0/789333959 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.652+0000 7f4173fff640 1 --2- 172.21.15.59:0/789333959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f720cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f41737fe640 1 --2- 172.21.15.59:0/789333959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71f2f0 0x56156f743690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f4178cb7640 1 -- 172.21.15.59:0/789333959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71f2f0 msgr2=0x56156f743690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f4178cb7640 1 --2- 172.21.15.59:0/789333959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71f2f0 0x56156f743690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f4178cb7640 1 -- 172.21.15.59:0/789333959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 msgr2=0x56156f720cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f4178cb7640 1 --2- 172.21.15.59:0/789333959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f720cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f4178cb7640 1 -- 172.21.15.59:0/789333959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56156f71f120 con 0x56156f72bec0 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f4178cb7640 1 --2- 172.21.15.59:0/789333959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f743bd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f416c009e70 tx=0x7f416c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c215d0f6c43fe253 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f4159ffb640 1 -- 172.21.15.59:0/789333959 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c012e20 con 0x56156f72bec0 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f4159ffb640 1 -- 172.21.15.59:0/789333959 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f416c01f400 con 0x56156f72bec0 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.653+0000 7f4159ffb640 1 -- 172.21.15.59:0/789333959 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c011640 con 0x56156f72bec0 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 -- 172.21.15.59:0/789333959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 msgr2=0x56156f743bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 --2- 172.21.15.59:0/789333959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f743bd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f416c009e70 tx=0x7f416c009920 comp rx=0 tx=0).stop 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 -- 172.21.15.59:0/789333959 shutdown_connections 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 --2- 172.21.15.59:0/789333959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f72bec0 0x56156f743bd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 --2- 172.21.15.59:0/789333959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f71f2f0 0x56156f743690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 --2- 172.21.15.59:0/789333959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f720cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 -- 172.21.15.59:0/789333959 >> 172.21.15.59:0/789333959 conn(0x56156f71b060 msgr2=0x56156f7205a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 -- 172.21.15.59:0/789333959 shutdown_connections 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 -- 172.21.15.59:0/789333959 wait complete. 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 -- start start 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.654+0000 7f417d4ae740 1 Processor -- start 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f72fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f730250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f417d4ae740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 0x56156f7a5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f417d4ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f41741a9d30 con 0x56156f71f2f0 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f417d4ae740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f41741ab1a0 con 0x56156f71e9d0 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f417d4ae740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f41741aa400 con 0x56156f72bec0 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f417d4ae740 10 client.0 _ll_register_callbacks cb 0x7f4164004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f730250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f730250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57796/0 (socket says 172.21.15.59:57796) 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41737fe640 1 -- 172.21.15.59:0/4019232201 learned_addr learned my addr 172.21.15.59:0/4019232201 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f4178cb7640 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 0x56156f7a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f4173fff640 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f72fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41737fe640 1 -- 172.21.15.59:0/4019232201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 msgr2=0x56156f7a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41737fe640 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 0x56156f7a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41737fe640 1 -- 172.21.15.59:0/4019232201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 msgr2=0x56156f72fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41737fe640 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f72fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41737fe640 1 -- 172.21.15.59:0/4019232201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56156f730b30 con 0x56156f71f2f0 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41737fe640 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f730250 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f41680bb360 tx=0x7f4168005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e1b272d191da1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41537fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.655+0000 7f41537fe640 1 -- 172.21.15.59:0/4019232201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41680c4a80 con 0x56156f71f2f0 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f41537fe640 1 -- 172.21.15.59:0/4019232201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f41680bb5d0 con 0x56156f71f2f0 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f417d4ae740 1 -- 172.21.15.59:0/4019232201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f416c01f400 con 0x56156f71f2f0 2024-09-10T11:06:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f41537fe640 1 -- 172.21.15.59:0/4019232201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f41680ed2c0 con 0x56156f71f2f0 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f417d4ae740 10 client.15699 fetch_fsmap learned FSMap version 26 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f417d4ae740 1 -- 172.21.15.59:0/4019232201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56156f730b30 con 0x56156f71f2f0 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f41537fe640 1 -- 172.21.15.59:0/4019232201 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f416c01f400 con 0x56156f71f2f0 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f41537fe640 1 -- 172.21.15.59:0/4019232201 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f416809ace0 con 0x56156f71f2f0 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f417d4ae740 10 client.15699 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f417d4ae740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f417d4ae740 20 client.15699 populate_metadata read hostname 'smithi059' 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f417d4ae740 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56156f7a70d0 0x56156f7a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f417d4ae740 4 client.15699 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f417d4ae740 1 -- 172.21.15.59:0/4019232201 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56156f68ad70 con 0x56156f7a70d0 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.656+0000 7f4173fff640 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56156f7a70d0 0x56156f7a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.657+0000 7f41537fe640 10 client.15699 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.657+0000 7f4173fff640 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56156f7a70d0 0x56156f7a94f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1afaccc8234a28c9 server_cookie=fc5060691095aff2 in_seq=0 out_seq=0 2024-09-10T11:06:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f41537fe640 1 -- 172.21.15.59:0/4019232201 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56156f68ad70 con 0x56156f7a70d0 2024-09-10T11:06:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f41537fe640 10 client.15699 handle_command_reply: tid=0 2024-09-10T11:06:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 client.15699 shutdown 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 -- 172.21.15.59:0/4019232201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 msgr2=0x56156f730250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f730250 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f41680bb360 tx=0x7f4168005c90 comp rx=0 tx=0).stop 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 -- 172.21.15.59:0/4019232201 shutdown_connections 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56156f7a70d0 0x56156f7a94f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56156f72bec0 0x56156f7a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56156f71f2f0 0x56156f730250 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 --2- 172.21.15.59:0/4019232201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56156f71e9d0 0x56156f72fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f41537fe640 0 client.15699 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 -- 172.21.15.59:0/4019232201 >> 172.21.15.59:0/4019232201 conn(0x56156f71b060 msgr2=0x56156f7295d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 -- 172.21.15.59:0/4019232201 shutdown_connections 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.671+0000 7f417d4ae740 1 -- 172.21.15.59:0/4019232201 wait complete. 2024-09-10T11:06:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417d4ae740 20 client.15699 trim_cache size 0 max 16384 2024-09-10T11:06:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:06:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:06:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:06:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 -- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f415c0a2da0 msgr2=0x7f415c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f415c0a2da0 0x7f415c0a5260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f416c009990 tx=0x7f416c0096a0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 -- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4174101390 msgr2=0x7f4174197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4174101390 0x7f4174197830 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4168009230 tx=0x7f4168004270 comp rx=0 tx=0).stop 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 -- 172.21.15.59:0/2866333938 shutdown_connections 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4174106a00 0x7f417419bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4174101390 0x7f4174197830 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f415c0a2da0 0x7f415c0a5260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 --2- 172.21.15.59:0/2866333938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41741009f0 0x7f41741972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 -- 172.21.15.59:0/2866333938 >> 172.21.15.59:0/2866333938 conn(0x7f41740fc6b0 msgr2=0x7f41740fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 -- 172.21.15.59:0/2866333938 shutdown_connections 2024-09-10T11:06:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:06:54.672+0000 7f417a71a640 1 -- 172.21.15.59:0/2866333938 wait complete. 2024-09-10T11:06:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:55 smithi181 ceph-mon[35409]: pgmap v170: 97 pgs: 97 active+clean; 4.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-09-10T11:06:56.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:55 smithi115 ceph-mon[34719]: pgmap v170: 97 pgs: 97 active+clean; 4.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-09-10T11:06:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:55 smithi059 ceph-mon[30978]: pgmap v170: 97 pgs: 97 active+clean; 4.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-09-10T11:06:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:57 smithi181 ceph-mon[35409]: pgmap v171: 97 pgs: 97 active+clean; 4.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-09-10T11:06:58.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:57 smithi115 ceph-mon[34719]: pgmap v171: 97 pgs: 97 active+clean; 4.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-09-10T11:06:58.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:57 smithi059 ceph-mon[30978]: pgmap v171: 97 pgs: 97 active+clean; 4.3 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-09-10T11:07:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:06:59 smithi181 ceph-mon[35409]: pgmap v172: 97 pgs: 97 active+clean; 4.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:07:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:06:59 smithi115 ceph-mon[34719]: pgmap v172: 97 pgs: 97 active+clean; 4.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:07:00.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:06:59 smithi059 ceph-mon[30978]: pgmap v172: 97 pgs: 97 active+clean; 4.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-10T11:07:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:01 smithi181 ceph-mon[35409]: pgmap v173: 97 pgs: 97 active+clean; 4.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:07:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:01 smithi115 ceph-mon[34719]: pgmap v173: 97 pgs: 97 active+clean; 4.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:07:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:01 smithi059 ceph-mon[30978]: pgmap v173: 97 pgs: 97 active+clean; 4.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:07:04.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:03 smithi181 ceph-mon[35409]: pgmap v174: 97 pgs: 97 active+clean; 4.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:07:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:03 smithi115 ceph-mon[34719]: pgmap v174: 97 pgs: 97 active+clean; 4.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:07:04.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:03 smithi059 ceph-mon[30978]: pgmap v174: 97 pgs: 97 active+clean; 4.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-09-10T11:07:06.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:05 smithi181 ceph-mon[35409]: pgmap v175: 97 pgs: 97 active+clean; 4.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 75 KiB/s wr, 32 op/s 2024-09-10T11:07:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:05 smithi115 ceph-mon[34719]: pgmap v175: 97 pgs: 97 active+clean; 4.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 75 KiB/s wr, 32 op/s 2024-09-10T11:07:06.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:05 smithi059 ceph-mon[30978]: pgmap v175: 97 pgs: 97 active+clean; 4.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 75 KiB/s wr, 32 op/s 2024-09-10T11:07:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.771+0000 7faf9934b640 1 -- 172.21.15.59:0/1873217633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 msgr2=0x7faf94100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.771+0000 7faf9934b640 1 --2- 172.21.15.59:0/1873217633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 0x7faf94100e50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7faf88009930 tx=0x7faf8802a420 comp rx=0 tx=0).stop 2024-09-10T11:07:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.771+0000 7faf9934b640 1 -- 172.21.15.59:0/1873217633 shutdown_connections 2024-09-10T11:07:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.771+0000 7faf9934b640 1 --2- 172.21.15.59:0/1873217633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf94101390 0x7faf9410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.771+0000 7faf9934b640 1 --2- 172.21.15.59:0/1873217633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 0x7faf94100e50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.771+0000 7faf9934b640 1 --2- 172.21.15.59:0/1873217633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf94106a00 0x7faf94106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.771+0000 7faf9934b640 1 -- 172.21.15.59:0/1873217633 >> 172.21.15.59:0/1873217633 conn(0x7faf940fc6b0 msgr2=0x7faf940fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:07.776 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.771+0000 7faf9934b640 1 -- 172.21.15.59:0/1873217633 shutdown_connections 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.771+0000 7faf9934b640 1 -- 172.21.15.59:0/1873217633 wait complete. 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf9934b640 1 Processor -- start 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf9934b640 1 -- start start 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf9934b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 0x7faf94198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf9934b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf94101390 0x7faf94198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf9934b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf94106a00 0x7faf9419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf9934b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faf94110e40 con 0x7faf941009f0 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf9934b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faf94110cc0 con 0x7faf94101390 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf9934b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faf94110fc0 con 0x7faf94106a00 2024-09-10T11:07:07.777 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 0x7faf94198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 0x7faf94198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46334/0 (socket says 172.21.15.59:46334) 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.772+0000 7faf92ffd640 1 -- 172.21.15.59:0/3319812143 learned_addr learned my addr 172.21.15.59:0/3319812143 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf927fc640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf94101390 0x7faf94198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf937fe640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf94106a00 0x7faf9419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf92ffd640 1 -- 172.21.15.59:0/3319812143 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf94106a00 msgr2=0x7faf9419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf92ffd640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf94106a00 0x7faf9419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf92ffd640 1 -- 172.21.15.59:0/3319812143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf94101390 msgr2=0x7faf94198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf92ffd640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf94101390 0x7faf94198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf92ffd640 1 -- 172.21.15.59:0/3319812143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9419d430 con 0x7faf941009f0 2024-09-10T11:07:07.778 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf92ffd640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 0x7faf94198440 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faf8400d950 tx=0x7faf8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:07.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf7bfff640 1 -- 172.21.15.59:0/3319812143 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84017070 con 0x7faf941009f0 2024-09-10T11:07:07.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf9934b640 1 -- 172.21.15.59:0/3319812143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9419d720 con 0x7faf941009f0 2024-09-10T11:07:07.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf7bfff640 1 -- 172.21.15.59:0/3319812143 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf84009c30 con 0x7faf941009f0 2024-09-10T11:07:07.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf7bfff640 1 -- 172.21.15.59:0/3319812143 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8400f6b0 con 0x7faf941009f0 2024-09-10T11:07:07.779 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.773+0000 7faf9934b640 1 -- 172.21.15.59:0/3319812143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf941a4fb0 con 0x7faf941009f0 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.776+0000 7faf7bfff640 1 -- 172.21.15.59:0/3319812143 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7faf840109d0 con 0x7faf941009f0 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.776+0000 7faf9c1c5740 1 Processor -- start 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.776+0000 7faf9c1c5740 1 -- start start 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.776+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14399d0 0x55eeb1439db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.776+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb1448b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.776+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 0x55eeb144b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.776+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eeb139e2f0 con 0x55eeb143a2f0 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.776+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eeb1346270 con 0x55eeb14490c0 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.776+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eeb139a2b0 con 0x55eeb14399d0 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb1448b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf7bfff640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7faf7c0a2da0 0x7faf7c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.787 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb1448b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46342/0 (socket says 172.21.15.59:46342) 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf92ffd640 1 -- 172.21.15.59:0/4287628982 learned_addr learned my addr 172.21.15.59:0/4287628982 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf937fe640 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14399d0 0x55eeb1439db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf927fc640 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 0x55eeb144b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf937fe640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7faf7c0a2da0 0x7faf7c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf7bfff640 1 -- 172.21.15.59:0/3319812143 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7faf840cf010 con 0x7faf941009f0 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf92ffd640 1 -- 172.21.15.59:0/4287628982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14399d0 msgr2=0x55eeb1439db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf92ffd640 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14399d0 0x55eeb1439db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf92ffd640 1 -- 172.21.15.59:0/4287628982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 msgr2=0x55eeb144b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf92ffd640 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 0x55eeb144b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf92ffd640 1 -- 172.21.15.59:0/4287628982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb1345340 con 0x55eeb143a2f0 2024-09-10T11:07:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf927fc640 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 0x55eeb144b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf937fe640 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14399d0 0x55eeb1439db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf92ffd640 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb1448b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7faf840cc6b0 tx=0x7faf84000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f86b3d96b24333 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf797fa640 1 -- 172.21.15.59:0/4287628982 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84020070 con 0x55eeb143a2f0 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf937fe640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7faf7c0a2da0 0x7faf7c0a5260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009370 tx=0x7faf8c009520 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf797fa640 1 -- 172.21.15.59:0/4287628982 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf8409b510 con 0x55eeb143a2f0 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.777+0000 7faf797fa640 1 -- 172.21.15.59:0/4287628982 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840d10d0 con 0x55eeb143a2f0 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.778+0000 7faf9c1c5740 1 -- 172.21.15.59:0/4287628982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 msgr2=0x55eeb1448b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.778+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb1448b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7faf840cc6b0 tx=0x7faf84000bc0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.778+0000 7faf9c1c5740 1 -- 172.21.15.59:0/4287628982 shutdown_connections 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.778+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 0x55eeb144b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.778+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb1448b80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.778+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/4287628982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14399d0 0x55eeb1439db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.778+0000 7faf9c1c5740 1 -- 172.21.15.59:0/4287628982 >> 172.21.15.59:0/4287628982 conn(0x55eeb1436060 msgr2=0x55eeb1436440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.778+0000 7faf9c1c5740 1 -- 172.21.15.59:0/4287628982 shutdown_connections 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.778+0000 7faf9c1c5740 1 -- 172.21.15.59:0/4287628982 wait complete. 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf9c1c5740 1 -- start start 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf9c1c5740 1 Processor -- start 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb1446030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb143a2f0 0x55eeb1446570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 0x55eeb1446ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eeb144bc30 con 0x55eeb14399d0 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eeb1327290 con 0x55eeb143a2f0 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55eeb144bdb0 con 0x55eeb14490c0 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf9c1c5740 10 client.0 _ll_register_callbacks cb 0x55eeb1358140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:07:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb1446030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb1446030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46346/0 (socket says 172.21.15.59:46346) 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf92ffd640 1 -- 172.21.15.59:0/2903461771 learned_addr learned my addr 172.21.15.59:0/2903461771 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.779+0000 7faf937fe640 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 0x55eeb1446ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf927fc640 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb143a2f0 0x55eeb1446570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf92ffd640 1 -- 172.21.15.59:0/2903461771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 msgr2=0x55eeb1446ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf92ffd640 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 0x55eeb1446ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf92ffd640 1 -- 172.21.15.59:0/2903461771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb143a2f0 msgr2=0x55eeb1446570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf92ffd640 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb143a2f0 0x55eeb1446570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf92ffd640 1 -- 172.21.15.59:0/2903461771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb10b1210 con 0x55eeb14399d0 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf927fc640 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb143a2f0 0x55eeb1446570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf92ffd640 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb1446030 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7faf840cccc0 tx=0x7faf840971a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6372d16c805cbd1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf76ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:07:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf76ff5640 1 -- 172.21.15.59:0/2903461771 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840b4060 con 0x55eeb14399d0 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf76ff5640 1 -- 172.21.15.59:0/2903461771 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7faf840d1070 con 0x55eeb14399d0 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf9c1c5740 1 -- 172.21.15.59:0/2903461771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf8409b510 con 0x55eeb14399d0 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf76ff5640 1 -- 172.21.15.59:0/2903461771 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faf84020040 con 0x55eeb14399d0 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf9c1c5740 10 client.15711 fetch_fsmap learned FSMap version 26 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf9c1c5740 1 -- 172.21.15.59:0/2903461771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eeb117d620 con 0x55eeb14399d0 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf76ff5640 1 -- 172.21.15.59:0/2903461771 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf8409b510 con 0x55eeb14399d0 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.780+0000 7faf76ff5640 1 -- 172.21.15.59:0/2903461771 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7faf8409a960 con 0x55eeb14399d0 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.781+0000 7faf9c1c5740 10 client.15711 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.781+0000 7faf9c1c5740 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:07:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.781+0000 7faf9c1c5740 20 client.15711 populate_metadata read hostname 'smithi059' 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.781+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eeb1458eb0 0x55eeb145b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.781+0000 7faf9c1c5740 4 client.15711 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.781+0000 7faf9c1c5740 1 -- 172.21.15.59:0/2903461771 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eeb13aba20 con 0x55eeb1458eb0 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.781+0000 7faf927fc640 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eeb1458eb0 0x55eeb145b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.781+0000 7faf76ff5640 10 client.15711 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.781+0000 7faf927fc640 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eeb1458eb0 0x55eeb145b2a0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ac8d80524d21a5 server_cookie=eeebaa062823fef1 in_seq=0 out_seq=0 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf76ff5640 1 -- 172.21.15.59:0/2903461771 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eeb13aba20 con 0x55eeb1458eb0 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf76ff5640 10 client.15711 handle_command_reply: tid=0 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 client.15711 shutdown 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 -- 172.21.15.59:0/2903461771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 msgr2=0x55eeb1446030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb1446030 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7faf840cccc0 tx=0x7faf840971a0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 -- 172.21.15.59:0/2903461771 shutdown_connections 2024-09-10T11:07:07.793 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eeb1458eb0 0x55eeb145b2a0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 0x55eeb1446ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf76ff5640 0 client.15711 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb143a2f0 0x55eeb1446570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/2903461771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb1446030 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 -- 172.21.15.59:0/2903461771 >> 172.21.15.59:0/2903461771 conn(0x55eeb1436060 msgr2=0x55eeb143bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 -- 172.21.15.59:0/2903461771 shutdown_connections 2024-09-10T11:07:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 1 -- 172.21.15.59:0/2903461771 wait complete. 2024-09-10T11:07:07.794 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.782+0000 7faf9c1c5740 20 client.15711 trim_cache size 0 max 16384 2024-09-10T11:07:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf9c1c5740 1 Processor -- start 2024-09-10T11:07:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf9c1c5740 1 -- start start 2024-09-10T11:07:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb145e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb143a2f0 0x55eeb145e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 0x55eeb1443270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faf941ae010 con 0x55eeb14399d0 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faf941ab8e0 con 0x55eeb14490c0 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faf941a9730 con 0x55eeb143a2f0 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb145e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf92ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb145e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46358/0 (socket says 172.21.15.59:46358) 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf92ffd640 1 -- 172.21.15.59:0/910071045 learned_addr learned my addr 172.21.15.59:0/910071045 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf927fc640 1 --2- 172.21.15.59:0/910071045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb143a2f0 0x55eeb145e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.797+0000 7faf937fe640 1 --2- 172.21.15.59:0/910071045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 0x55eeb1443270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf92ffd640 1 -- 172.21.15.59:0/910071045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb143a2f0 msgr2=0x55eeb145e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf92ffd640 1 --2- 172.21.15.59:0/910071045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb143a2f0 0x55eeb145e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf92ffd640 1 -- 172.21.15.59:0/910071045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 msgr2=0x55eeb1443270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf92ffd640 1 --2- 172.21.15.59:0/910071045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 0x55eeb1443270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf92ffd640 1 -- 172.21.15.59:0/910071045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb1444fc0 con 0x55eeb14399d0 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf92ffd640 1 --2- 172.21.15.59:0/910071045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb145e2c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faf84097970 tx=0x7faf840cc7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6c95e034179e57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf78ff9640 1 -- 172.21.15.59:0/910071045 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840b4040 con 0x55eeb14399d0 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf78ff9640 1 -- 172.21.15.59:0/910071045 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf840a4180 con 0x55eeb14399d0 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf78ff9640 1 -- 172.21.15.59:0/910071045 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840998a0 con 0x55eeb14399d0 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf9c1c5740 1 -- 172.21.15.59:0/910071045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 msgr2=0x55eeb145e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/910071045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb145e2c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faf84097970 tx=0x7faf840cc7f0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf9c1c5740 1 -- 172.21.15.59:0/910071045 shutdown_connections 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/910071045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14490c0 0x55eeb1443270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/910071045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb143a2f0 0x55eeb145e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.798+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/910071045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb14399d0 0x55eeb145e2c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 -- 172.21.15.59:0/910071045 >> 172.21.15.59:0/910071045 conn(0x55eeb1436060 msgr2=0x55eeb1454860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 -- 172.21.15.59:0/910071045 shutdown_connections 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 -- 172.21.15.59:0/910071045 wait complete. 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 -- start start 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 Processor -- start 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14399d0 0x55eeb145c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb145cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 0x55eeb14bc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faf941a9da0 con 0x55eeb143a2f0 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faf941ab210 con 0x55eeb14399d0 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faf941aa470 con 0x55eeb14490c0 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf9c1c5740 10 client.0 _ll_register_callbacks cb 0x7faf8400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf927fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb145cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf927fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb145cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46360/0 (socket says 172.21.15.59:46360) 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf927fc640 1 -- 172.21.15.59:0/1286602715 learned_addr learned my addr 172.21.15.59:0/1286602715 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.799+0000 7faf937fe640 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 0x55eeb14bc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf92ffd640 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14399d0 0x55eeb145c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf927fc640 1 -- 172.21.15.59:0/1286602715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 msgr2=0x55eeb14bc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf927fc640 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 0x55eeb14bc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf927fc640 1 -- 172.21.15.59:0/1286602715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14399d0 msgr2=0x55eeb145c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf927fc640 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14399d0 0x55eeb145c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf927fc640 1 -- 172.21.15.59:0/1286602715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb143a120 con 0x55eeb143a2f0 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf92ffd640 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14399d0 0x55eeb145c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf927fc640 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb145cea0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faf8802a940 tx=0x7faf88005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c01876d00be9cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf76ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf76ff5640 1 -- 172.21.15.59:0/1286602715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88035040 con 0x55eeb143a2f0 2024-09-10T11:07:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf76ff5640 1 -- 172.21.15.59:0/1286602715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7faf88004240 con 0x55eeb143a2f0 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf9c1c5740 1 -- 172.21.15.59:0/1286602715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eeb13a5d70 con 0x55eeb143a2f0 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf76ff5640 1 -- 172.21.15.59:0/1286602715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faf88054050 con 0x55eeb143a2f0 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf9c1c5740 10 client.15717 fetch_fsmap learned FSMap version 26 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf9c1c5740 1 -- 172.21.15.59:0/1286602715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eeb1455a10 con 0x55eeb143a2f0 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.800+0000 7faf76ff5640 1 -- 172.21.15.59:0/1286602715 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55eeb13a5d70 con 0x55eeb143a2f0 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.801+0000 7faf76ff5640 1 -- 172.21.15.59:0/1286602715 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7faf8803d6b0 con 0x55eeb143a2f0 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.801+0000 7faf9c1c5740 10 client.15717 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.801+0000 7faf9c1c5740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.801+0000 7faf9c1c5740 20 client.15717 populate_metadata read hostname 'smithi059' 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.801+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eeb14c4630 0x55eeb14c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.801+0000 7faf9c1c5740 4 client.15717 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.801+0000 7faf9c1c5740 1 -- 172.21.15.59:0/1286602715 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eeb1322900 con 0x55eeb14c4630 2024-09-10T11:07:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.801+0000 7faf92ffd640 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eeb14c4630 0x55eeb14c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.802+0000 7faf92ffd640 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eeb14c4630 0x55eeb14c6a50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b56b46705610b54d server_cookie=6ec2f4d4c7a57e6e in_seq=0 out_seq=0 2024-09-10T11:07:07.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.802+0000 7faf76ff5640 10 client.15717 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.816+0000 7faf76ff5640 1 -- 172.21.15.59:0/1286602715 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eeb1322900 con 0x55eeb14c4630 2024-09-10T11:07:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.816+0000 7faf76ff5640 10 client.15717 handle_command_reply: tid=0 2024-09-10T11:07:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.816+0000 7faf9c1c5740 1 client.15717 shutdown 2024-09-10T11:07:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 -- 172.21.15.59:0/1286602715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 msgr2=0x55eeb145cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb145cea0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faf8802a940 tx=0x7faf88005fd0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 -- 172.21.15.59:0/1286602715 shutdown_connections 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55eeb14c4630 0x55eeb14c6a50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eeb14490c0 0x55eeb14bc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf76ff5640 0 client.15717 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eeb143a2f0 0x55eeb145cea0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 --2- 172.21.15.59:0/1286602715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eeb14399d0 0x55eeb145c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 -- 172.21.15.59:0/1286602715 >> 172.21.15.59:0/1286602715 conn(0x55eeb1436060 msgr2=0x55eeb1447890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 -- 172.21.15.59:0/1286602715 shutdown_connections 2024-09-10T11:07:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 1 -- 172.21.15.59:0/1286602715 wait complete. 2024-09-10T11:07:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9c1c5740 20 client.15717 trim_cache size 0 max 16384 2024-09-10T11:07:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:07:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:07:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:07:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:07:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 -- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7faf7c0a2da0 msgr2=0x7faf7c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7faf7c0a2da0 0x7faf7c0a5260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009370 tx=0x7faf8c009520 comp rx=0 tx=0).stop 2024-09-10T11:07:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 -- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 msgr2=0x7faf94198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 0x7faf94198440 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faf8400d950 tx=0x7faf8400de10 comp rx=0 tx=0).stop 2024-09-10T11:07:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 -- 172.21.15.59:0/3319812143 shutdown_connections 2024-09-10T11:07:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7faf7c0a2da0 0x7faf7c0a5260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf94106a00 0x7faf9419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf94101390 0x7faf94198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 --2- 172.21.15.59:0/3319812143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf941009f0 0x7faf94198440 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.817+0000 7faf9934b640 1 -- 172.21.15.59:0/3319812143 >> 172.21.15.59:0/3319812143 conn(0x7faf940fc6b0 msgr2=0x7faf9406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.818+0000 7faf9934b640 1 -- 172.21.15.59:0/3319812143 shutdown_connections 2024-09-10T11:07:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:07.818+0000 7faf9934b640 1 -- 172.21.15.59:0/3319812143 wait complete. 2024-09-10T11:07:08.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:07 smithi181 ceph-mon[35409]: pgmap v176: 97 pgs: 97 active+clean; 4.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 60 KiB/s wr, 27 op/s 2024-09-10T11:07:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:07 smithi115 ceph-mon[34719]: pgmap v176: 97 pgs: 97 active+clean; 4.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 60 KiB/s wr, 27 op/s 2024-09-10T11:07:08.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:07 smithi059 ceph-mon[30978]: pgmap v176: 97 pgs: 97 active+clean; 4.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 60 KiB/s wr, 27 op/s 2024-09-10T11:07:10.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:09 smithi181 ceph-mon[35409]: pgmap v177: 97 pgs: 97 active+clean; 4.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 83 KiB/s wr, 34 op/s 2024-09-10T11:07:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:09 smithi115 ceph-mon[34719]: pgmap v177: 97 pgs: 97 active+clean; 4.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 83 KiB/s wr, 34 op/s 2024-09-10T11:07:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:09 smithi059 ceph-mon[30978]: pgmap v177: 97 pgs: 97 active+clean; 4.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 83 KiB/s wr, 34 op/s 2024-09-10T11:07:12.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:11 smithi181 ceph-mon[35409]: pgmap v178: 97 pgs: 97 active+clean; 4.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-09-10T11:07:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:11 smithi115 ceph-mon[34719]: pgmap v178: 97 pgs: 97 active+clean; 4.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-09-10T11:07:12.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:11 smithi059 ceph-mon[30978]: pgmap v178: 97 pgs: 97 active+clean; 4.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-09-10T11:07:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:13 smithi181 ceph-mon[35409]: pgmap v179: 97 pgs: 97 active+clean; 4.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-09-10T11:07:14.190 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:13 smithi059 ceph-mon[30978]: pgmap v179: 97 pgs: 97 active+clean; 4.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-09-10T11:07:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:13 smithi115 ceph-mon[34719]: pgmap v179: 97 pgs: 97 active+clean; 4.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-09-10T11:07:16.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:15 smithi115 ceph-mon[34719]: pgmap v180: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 78 KiB/s wr, 31 op/s 2024-09-10T11:07:16.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:15 smithi059 ceph-mon[30978]: pgmap v180: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 78 KiB/s wr, 31 op/s 2024-09-10T11:07:16.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:15 smithi181 ceph-mon[35409]: pgmap v180: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 78 KiB/s wr, 31 op/s 2024-09-10T11:07:18.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:17 smithi115 ceph-mon[34719]: pgmap v181: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-09-10T11:07:18.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:17 smithi059 ceph-mon[30978]: pgmap v181: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-09-10T11:07:18.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:17 smithi181 ceph-mon[35409]: pgmap v181: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-09-10T11:07:20.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:19 smithi115 ceph-mon[34719]: pgmap v182: 97 pgs: 97 active+clean; 5.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-09-10T11:07:20.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:19 smithi059 ceph-mon[30978]: pgmap v182: 97 pgs: 97 active+clean; 5.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-09-10T11:07:20.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:19 smithi181 ceph-mon[35409]: pgmap v182: 97 pgs: 97 active+clean; 5.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-09-10T11:07:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 -- 172.21.15.59:0/705631087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 msgr2=0x7f32bc10dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 --2- 172.21.15.59:0/705631087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 0x7f32bc10dde0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009900 tx=0x7f32ac02a480 comp rx=0 tx=0).stop 2024-09-10T11:07:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 -- 172.21.15.59:0/705631087 shutdown_connections 2024-09-10T11:07:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 --2- 172.21.15.59:0/705631087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32bc10e320 0x7f32bc110770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 --2- 172.21.15.59:0/705631087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 0x7f32bc10dde0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 --2- 172.21.15.59:0/705631087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc074620 0x7f32bc074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 -- 172.21.15.59:0/705631087 >> 172.21.15.59:0/705631087 conn(0x7f32bc0fd7e0 msgr2=0x7f32bc0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:20.923 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 -- 172.21.15.59:0/705631087 shutdown_connections 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 -- 172.21.15.59:0/705631087 wait complete. 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.918+0000 7f32c3742640 1 Processor -- start 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c3742640 1 -- start start 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c3742640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32bc074620 0x7f32bc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c3742640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 0x7f32bc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c3742640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc10e320 0x7f32bc19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c3742640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc1140b0 con 0x7f32bc074f40 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c3742640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc113f30 con 0x7f32bc10e320 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c3742640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc114230 con 0x7f32bc074620 2024-09-10T11:07:20.924 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c0cdd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 0x7f32bc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c0cdd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 0x7f32bc19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36710/0 (socket says 172.21.15.59:36710) 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c0cdd640 1 -- 172.21.15.59:0/569066024 learned_addr learned my addr 172.21.15.59:0/569066024 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c14de640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32bc074620 0x7f32bc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c1cdf640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc10e320 0x7f32bc19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c0cdd640 1 -- 172.21.15.59:0/569066024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32bc074620 msgr2=0x7f32bc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32bc074620 0x7f32bc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c0cdd640 1 -- 172.21.15.59:0/569066024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc10e320 msgr2=0x7f32bc19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc10e320 0x7f32bc19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.919+0000 7f32c0cdd640 1 -- 172.21.15.59:0/569066024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc19f5f0 con 0x7f32bc074f40 2024-09-10T11:07:20.925 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.920+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 0x7f32bc19ab40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f32ac006010 tx=0x7f32ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.920+0000 7f32b27fc640 1 -- 172.21.15.59:0/569066024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac03f030 con 0x7f32bc074f40 2024-09-10T11:07:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.920+0000 7f32b27fc640 1 -- 172.21.15.59:0/569066024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32ac003ce0 con 0x7f32bc074f40 2024-09-10T11:07:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.920+0000 7f32c3742640 1 -- 172.21.15.59:0/569066024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32bc19f880 con 0x7f32bc074f40 2024-09-10T11:07:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.920+0000 7f32b27fc640 1 -- 172.21.15.59:0/569066024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac035070 con 0x7f32bc074f40 2024-09-10T11:07:20.926 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.920+0000 7f32c3742640 1 -- 172.21.15.59:0/569066024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32bc1a7170 con 0x7f32bc074f40 2024-09-10T11:07:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.922+0000 7f32b27fc640 1 -- 172.21.15.59:0/569066024 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f32ac042030 con 0x7f32bc074f40 2024-09-10T11:07:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c64dc740 1 Processor -- start 2024-09-10T11:07:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c64dc740 1 -- start start 2024-09-10T11:07:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 0x556e251f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e251fd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251fdcb0 0x556e252000a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c64dc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556e251572f0 con 0x556e251fdcb0 2024-09-10T11:07:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c64dc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556e250ff270 con 0x556e251f2af0 2024-09-10T11:07:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c64dc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556e251532b0 con 0x556e251f3410 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32b27fc640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f32a80a2da0 0x7f32a80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c0cdd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251fdcb0 0x556e252000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c1cdf640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f32a80a2da0 0x7f32a80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c0cdd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251fdcb0 0x556e252000a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36724/0 (socket says 172.21.15.59:36724) 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c0cdd640 1 -- 172.21.15.59:0/55793724 learned_addr learned my addr 172.21.15.59:0/55793724 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c1cdf640 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 0x556e251f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32c14de640 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e251fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.923+0000 7f32b27fc640 1 -- 172.21.15.59:0/569066024 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f32ac0ef540 con 0x7f32bc074f40 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32c0cdd640 1 -- 172.21.15.59:0/55793724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 msgr2=0x556e251fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e251fd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32c0cdd640 1 -- 172.21.15.59:0/55793724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 msgr2=0x556e251f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 0x556e251f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32c0cdd640 1 -- 172.21.15.59:0/55793724 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e250fe340 con 0x556e251fdcb0 2024-09-10T11:07:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32c14de640 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e251fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:07:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32c1cdf640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f32a80a2da0 0x7f32a80a5260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32b4005fd0 tx=0x7f32b4009e80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251fdcb0 0x556e252000a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0b7fb0 tx=0x7f32ac08ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c668b014ec6a3c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32a77fe640 1 -- 172.21.15.59:0/55793724 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac049070 con 0x556e251fdcb0 2024-09-10T11:07:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32a77fe640 1 -- 172.21.15.59:0/55793724 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32ac0bbb50 con 0x556e251fdcb0 2024-09-10T11:07:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.924+0000 7f32a77fe640 1 -- 172.21.15.59:0/55793724 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac090a00 con 0x556e251fdcb0 2024-09-10T11:07:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 -- 172.21.15.59:0/55793724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251fdcb0 msgr2=0x556e252000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251fdcb0 0x556e252000a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0b7fb0 tx=0x7f32ac08ec80 comp rx=0 tx=0).stop 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 -- 172.21.15.59:0/55793724 shutdown_connections 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251fdcb0 0x556e252000a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e251fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 --2- 172.21.15.59:0/55793724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 0x556e251f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 -- 172.21.15.59:0/55793724 >> 172.21.15.59:0/55793724 conn(0x556e251ef060 msgr2=0x556e251ef440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 -- 172.21.15.59:0/55793724 shutdown_connections 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 -- 172.21.15.59:0/55793724 wait complete. 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 -- start start 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.925+0000 7f32c64dc740 1 Processor -- start 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 0x556e251fabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f3410 0x556e251fb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251fdcb0 0x556e251fb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c64dc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556e25200640 con 0x556e251f3410 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c64dc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556e250e0290 con 0x556e251f2af0 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c64dc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x556e252007c0 con 0x556e251fdcb0 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c64dc740 10 client.0 _ll_register_callbacks cb 0x556e25111140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c0cdd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f3410 0x556e251fb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c0cdd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f3410 0x556e251fb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36730/0 (socket says 172.21.15.59:36730) 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c0cdd640 1 -- 172.21.15.59:0/474607309 learned_addr learned my addr 172.21.15.59:0/474607309 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c1cdf640 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251fdcb0 0x556e251fb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c14de640 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 0x556e251fabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c0cdd640 1 -- 172.21.15.59:0/474607309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251fdcb0 msgr2=0x556e251fb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251fdcb0 0x556e251fb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c0cdd640 1 -- 172.21.15.59:0/474607309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 msgr2=0x556e251fabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 0x556e251fabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c0cdd640 1 -- 172.21.15.59:0/474607309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e24e6a210 con 0x556e251f3410 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c14de640 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 0x556e251fabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f3410 0x556e251fb0f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0bb850 tx=0x7f32ac0ecbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b701db4759c1c214 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.926+0000 7f32a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32a4ff9640 1 -- 172.21.15.59:0/474607309 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0d9060 con 0x556e251f3410 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32a4ff9640 1 -- 172.21.15.59:0/474607309 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f32ac0ece90 con 0x556e251f3410 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32c64dc740 1 -- 172.21.15.59:0/474607309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32ac0bbb50 con 0x556e251f3410 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32a4ff9640 1 -- 172.21.15.59:0/474607309 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f32ac049040 con 0x556e251f3410 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32c64dc740 10 client.15729 fetch_fsmap learned FSMap version 26 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32c64dc740 1 -- 172.21.15.59:0/474607309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556e24f36620 con 0x556e251f3410 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32a4ff9640 1 -- 172.21.15.59:0/474607309 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32ac0bbb50 con 0x556e251f3410 2024-09-10T11:07:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32a4ff9640 1 -- 172.21.15.59:0/474607309 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f32ac0d4be0 con 0x556e251f3410 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32c64dc740 10 client.15729 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32c64dc740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32c64dc740 20 client.15729 populate_metadata read hostname 'smithi059' 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32c64dc740 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e2520d7f0 0x556e2520fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32c64dc740 4 client.15729 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.927+0000 7f32c64dc740 1 -- 172.21.15.59:0/474607309 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e25164a20 con 0x556e2520d7f0 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.928+0000 7f32c14de640 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e2520d7f0 0x556e2520fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.928+0000 7f32c14de640 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e2520d7f0 0x556e2520fbe0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc0567c6bdadf4a4 server_cookie=897ffc953d419aa7 in_seq=0 out_seq=0 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.928+0000 7f32a4ff9640 10 client.15729 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32a4ff9640 1 -- 172.21.15.59:0/474607309 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e25164a20 con 0x556e2520d7f0 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32a4ff9640 10 client.15729 handle_command_reply: tid=0 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 client.15729 shutdown 2024-09-10T11:07:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 -- 172.21.15.59:0/474607309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f3410 msgr2=0x556e251fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f3410 0x556e251fb0f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0bb850 tx=0x7f32ac0ecbb0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 -- 172.21.15.59:0/474607309 shutdown_connections 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e2520d7f0 0x556e2520fbe0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251fdcb0 0x556e251fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f3410 0x556e251fb0f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 --2- 172.21.15.59:0/474607309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251f2af0 0x556e251fabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32a4ff9640 0 client.15729 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 -- 172.21.15.59:0/474607309 >> 172.21.15.59:0/474607309 conn(0x556e251ef060 msgr2=0x556e251f4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 -- 172.21.15.59:0/474607309 shutdown_connections 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 1 -- 172.21.15.59:0/474607309 wait complete. 2024-09-10T11:07:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.929+0000 7f32c64dc740 20 client.15729 trim_cache size 0 max 16384 2024-09-10T11:07:20.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c64dc740 1 Processor -- start 2024-09-10T11:07:20.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c64dc740 1 -- start start 2024-09-10T11:07:20.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251fb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e25215450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 0x556e25215990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c64dc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc1b23d0 con 0x556e251f2af0 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c64dc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc1afca0 con 0x556e251fdcb0 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c64dc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc1adaf0 con 0x556e251f3410 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c14de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251fb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c14de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251fb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36744/0 (socket says 172.21.15.59:36744) 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.944+0000 7f32c14de640 1 -- 172.21.15.59:0/2452819526 learned_addr learned my addr 172.21.15.59:0/2452819526 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.945+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/2452819526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e25215450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.945+0000 7f32c1cdf640 1 --2- 172.21.15.59:0/2452819526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 0x556e25215990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.945+0000 7f32c14de640 1 -- 172.21.15.59:0/2452819526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 msgr2=0x556e25215450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.945+0000 7f32c14de640 1 --2- 172.21.15.59:0/2452819526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e25215450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.945+0000 7f32c14de640 1 -- 172.21.15.59:0/2452819526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 msgr2=0x556e25215990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.945+0000 7f32c14de640 1 --2- 172.21.15.59:0/2452819526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 0x556e25215990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.945+0000 7f32c14de640 1 -- 172.21.15.59:0/2452819526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e251eee90 con 0x556e251f2af0 2024-09-10T11:07:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.945+0000 7f32c14de640 1 --2- 172.21.15.59:0/2452819526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251fb460 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f32b800bac0 tx=0x7f32b800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0d7da703342c4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.945+0000 7f32a6ffd640 1 -- 172.21.15.59:0/2452819526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8003eb0 con 0x556e251f2af0 2024-09-10T11:07:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32a6ffd640 1 -- 172.21.15.59:0/2452819526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b8011920 con 0x556e251f2af0 2024-09-10T11:07:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32a6ffd640 1 -- 172.21.15.59:0/2452819526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b801daf0 con 0x556e251f2af0 2024-09-10T11:07:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32c64dc740 1 -- 172.21.15.59:0/2452819526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 msgr2=0x556e251fb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32c64dc740 1 --2- 172.21.15.59:0/2452819526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251fb460 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f32b800bac0 tx=0x7f32b800b390 comp rx=0 tx=0).stop 2024-09-10T11:07:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32c64dc740 1 -- 172.21.15.59:0/2452819526 shutdown_connections 2024-09-10T11:07:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32c64dc740 1 --2- 172.21.15.59:0/2452819526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 0x556e25215990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32c64dc740 1 --2- 172.21.15.59:0/2452819526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e25215450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32c64dc740 1 --2- 172.21.15.59:0/2452819526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251fb460 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32c64dc740 1 -- 172.21.15.59:0/2452819526 >> 172.21.15.59:0/2452819526 conn(0x556e251ef060 msgr2=0x556e251fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32c64dc740 1 -- 172.21.15.59:0/2452819526 shutdown_connections 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.946+0000 7f32c64dc740 1 -- 172.21.15.59:0/2452819526 wait complete. 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c64dc740 1 -- start start 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c64dc740 1 Processor -- start 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e251f8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c64dc740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 0x556e251f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c64dc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc1ae160 con 0x556e251f2af0 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c64dc740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc1af5d0 con 0x556e251fdcb0 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c64dc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc1ae830 con 0x556e251f3410 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c64dc740 10 client.0 _ll_register_callbacks cb 0x7f32b4011720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c14de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c14de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36752/0 (socket says 172.21.15.59:36752) 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c14de640 1 -- 172.21.15.59:0/3641846110 learned_addr learned my addr 172.21.15.59:0/3641846110 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.947+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e251f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c1cdf640 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 0x556e251f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c14de640 1 -- 172.21.15.59:0/3641846110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 msgr2=0x556e251f8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c14de640 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e251f8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c14de640 1 -- 172.21.15.59:0/3641846110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 msgr2=0x556e251f85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c14de640 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 0x556e251f85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c14de640 1 -- 172.21.15.59:0/3641846110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e251efcf0 con 0x556e251f2af0 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c1cdf640 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 0x556e251f85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c14de640 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251f7b40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f32b801d5b0 tx=0x7f32b801d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a9f77c84c6ed86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32a4ff9640 1 -- 172.21.15.59:0/3641846110 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8011ad0 con 0x556e251f2af0 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32a4ff9640 1 -- 172.21.15.59:0/3641846110 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f32b8011c70 con 0x556e251f2af0 2024-09-10T11:07:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c64dc740 1 -- 172.21.15.59:0/3641846110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32b8011920 con 0x556e251f2af0 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32a4ff9640 1 -- 172.21.15.59:0/3641846110 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f32b8003cb0 con 0x556e251f2af0 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c64dc740 10 client.15735 fetch_fsmap learned FSMap version 26 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32c64dc740 1 -- 172.21.15.59:0/3641846110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556e25278510 con 0x556e251f2af0 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.948+0000 7f32a4ff9640 1 -- 172.21.15.59:0/3641846110 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b8011920 con 0x556e251f2af0 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32a4ff9640 1 -- 172.21.15.59:0/3641846110 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f32b8036430 con 0x556e251f2af0 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32c64dc740 10 client.15735 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32c64dc740 10 client.15735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32c64dc740 20 client.15735 populate_metadata read hostname 'smithi059' 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32c64dc740 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e25278bd0 0x556e2527afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32c64dc740 4 client.15735 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32c64dc740 1 -- 172.21.15.59:0/3641846110 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556e2515ed70 con 0x556e25278bd0 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e25278bd0 0x556e2527afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32c0cdd640 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e25278bd0 0x556e2527afc0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=febab1ab2ae5f580 server_cookie=f41c5f589501a59d in_seq=0 out_seq=0 2024-09-10T11:07:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.949+0000 7f32a4ff9640 10 client.15735 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.962+0000 7f32a4ff9640 1 -- 172.21.15.59:0/3641846110 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556e2515ed70 con 0x556e25278bd0 2024-09-10T11:07:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.962+0000 7f32a4ff9640 10 client.15735 handle_command_reply: tid=0 2024-09-10T11:07:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.962+0000 7f32c64dc740 1 client.15735 shutdown 2024-09-10T11:07:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 -- 172.21.15.59:0/3641846110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 msgr2=0x556e251f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251f7b40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f32b801d5b0 tx=0x7f32b801d5e0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 -- 172.21.15.59:0/3641846110 shutdown_connections 2024-09-10T11:07:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x556e25278bd0 0x556e2527afc0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556e251fdcb0 0x556e251f85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32a4ff9640 0 client.15735 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556e251f3410 0x556e251f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 --2- 172.21.15.59:0/3641846110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e251f2af0 0x556e251f7b40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 -- 172.21.15.59:0/3641846110 >> 172.21.15.59:0/3641846110 conn(0x556e251ef060 msgr2=0x556e251ed9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 -- 172.21.15.59:0/3641846110 shutdown_connections 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 1 -- 172.21.15.59:0/3641846110 wait complete. 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c64dc740 20 client.15735 trim_cache size 0 max 16384 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:07:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:07:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c3742640 1 -- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f32a80a2da0 msgr2=0x7f32a80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c3742640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f32a80a2da0 0x7f32a80a5260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32b4005fd0 tx=0x7f32b4009e80 comp rx=0 tx=0).stop 2024-09-10T11:07:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c3742640 1 -- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 msgr2=0x7f32bc19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c3742640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 0x7f32bc19ab40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f32ac006010 tx=0x7f32ac0042f0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c3742640 1 -- 172.21.15.59:0/569066024 shutdown_connections 2024-09-10T11:07:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c3742640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32bc10e320 0x7f32bc19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c3742640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32bc074f40 0x7f32bc19ab40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c3742640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f32a80a2da0 0x7f32a80a5260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.963+0000 7f32c3742640 1 --2- 172.21.15.59:0/569066024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32bc074620 0x7f32bc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.964+0000 7f32c3742640 1 -- 172.21.15.59:0/569066024 >> 172.21.15.59:0/569066024 conn(0x7f32bc0fd7e0 msgr2=0x7f32bc0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.964+0000 7f32c3742640 1 -- 172.21.15.59:0/569066024 shutdown_connections 2024-09-10T11:07:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:20.964+0000 7f32c3742640 1 -- 172.21.15.59:0/569066024 wait complete. 2024-09-10T11:07:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:21 smithi115 ceph-mon[34719]: pgmap v183: 97 pgs: 97 active+clean; 5.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:07:22.238 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:21 smithi181 ceph-mon[35409]: pgmap v183: 97 pgs: 97 active+clean; 5.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:07:22.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:21 smithi059 ceph-mon[30978]: pgmap v183: 97 pgs: 97 active+clean; 5.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:07:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:23 smithi115 ceph-mon[34719]: pgmap v184: 97 pgs: 97 active+clean; 5.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:07:24.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:23 smithi059 ceph-mon[30978]: pgmap v184: 97 pgs: 97 active+clean; 5.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:07:24.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:23 smithi181 ceph-mon[35409]: pgmap v184: 97 pgs: 97 active+clean; 5.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:07:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:25 smithi115 ceph-mon[34719]: pgmap v185: 97 pgs: 97 active+clean; 1.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:07:26.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:25 smithi059 ceph-mon[30978]: pgmap v185: 97 pgs: 97 active+clean; 1.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:07:26.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:25 smithi181 ceph-mon[35409]: pgmap v185: 97 pgs: 97 active+clean; 1.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:07:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:27 smithi115 ceph-mon[34719]: pgmap v186: 97 pgs: 97 active+clean; 1.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:07:28.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:27 smithi059 ceph-mon[30978]: pgmap v186: 97 pgs: 97 active+clean; 1.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:07:28.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:27 smithi181 ceph-mon[35409]: pgmap v186: 97 pgs: 97 active+clean; 1.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:07:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:29 smithi059 ceph-mon[30978]: pgmap v187: 97 pgs: 97 active+clean; 1.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:07:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:07:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:07:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:07:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:29 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:07:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:29 smithi181 ceph-mon[35409]: pgmap v187: 97 pgs: 97 active+clean; 1.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:07:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:07:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:07:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:07:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:29 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:07:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:29 smithi115 ceph-mon[34719]: pgmap v187: 97 pgs: 97 active+clean; 1.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:07:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:07:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:07:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:07:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:29 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:07:32.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:31 smithi059 ceph-mon[30978]: pgmap v188: 97 pgs: 97 active+clean; 1.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:07:32.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:31 smithi181 ceph-mon[35409]: pgmap v188: 97 pgs: 97 active+clean; 1.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:07:32.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:31 smithi115 ceph-mon[34719]: pgmap v188: 97 pgs: 97 active+clean; 1.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.062+0000 7f8371b2c640 1 -- 172.21.15.59:0/785590796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c1009f0 msgr2=0x7f836c100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.062+0000 7f8371b2c640 1 --2- 172.21.15.59:0/785590796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c1009f0 0x7f836c100e50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8354009930 tx=0x7f835402a420 comp rx=0 tx=0).stop 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.062+0000 7f8371b2c640 1 -- 172.21.15.59:0/785590796 shutdown_connections 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.062+0000 7f8371b2c640 1 --2- 172.21.15.59:0/785590796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f836c101390 0x7f836c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.062+0000 7f8371b2c640 1 --2- 172.21.15.59:0/785590796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c1009f0 0x7f836c100e50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.062+0000 7f8371b2c640 1 --2- 172.21.15.59:0/785590796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f836c106a00 0x7f836c106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.062+0000 7f8371b2c640 1 -- 172.21.15.59:0/785590796 >> 172.21.15.59:0/785590796 conn(0x7f836c0fc6b0 msgr2=0x7f836c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.062+0000 7f8371b2c640 1 -- 172.21.15.59:0/785590796 shutdown_connections 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.062+0000 7f8371b2c640 1 -- 172.21.15.59:0/785590796 wait complete. 2024-09-10T11:07:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.063+0000 7f8371b2c640 1 Processor -- start 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.063+0000 7f8371b2c640 1 -- start start 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.063+0000 7f8371b2c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f836c1009f0 0x7f836c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f8371b2c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f836c101390 0x7f836c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f8371b2c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c106a00 0x7f836c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f8371b2c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f836c110e40 con 0x7f836c106a00 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f8371b2c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f836c110cc0 con 0x7f836c1009f0 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f8371b2c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f836c110fc0 con 0x7f836c101390 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c106a00 0x7f836c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c106a00 0x7f836c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48282/0 (socket says 172.21.15.59:48282) 2024-09-10T11:07:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836bfff640 1 -- 172.21.15.59:0/3655368141 learned_addr learned my addr 172.21.15.59:0/3655368141 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836affd640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f836c101390 0x7f836c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836b7fe640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f836c1009f0 0x7f836c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836bfff640 1 -- 172.21.15.59:0/3655368141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f836c101390 msgr2=0x7f836c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836bfff640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f836c101390 0x7f836c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836bfff640 1 -- 172.21.15.59:0/3655368141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f836c1009f0 msgr2=0x7f836c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836bfff640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f836c1009f0 0x7f836c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836bfff640 1 -- 172.21.15.59:0/3655368141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c19d3a0 con 0x7f836c106a00 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f836bfff640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c106a00 0x7f836c19cc70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f836400eaa0 tx=0x7f836400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f8368ff9640 1 -- 172.21.15.59:0/3655368141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836400cdb0 con 0x7f836c106a00 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f8368ff9640 1 -- 172.21.15.59:0/3655368141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8364005020 con 0x7f836c106a00 2024-09-10T11:07:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f8368ff9640 1 -- 172.21.15.59:0/3655368141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83640116b0 con 0x7f836c106a00 2024-09-10T11:07:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.064+0000 7f8371b2c640 1 -- 172.21.15.59:0/3655368141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836c19d690 con 0x7f836c106a00 2024-09-10T11:07:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.065+0000 7f8371b2c640 1 -- 172.21.15.59:0/3655368141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836c1a4f20 con 0x7f836c106a00 2024-09-10T11:07:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.067+0000 7f8368ff9640 1 -- 172.21.15.59:0/3655368141 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8364005560 con 0x7f836c106a00 2024-09-10T11:07:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.067+0000 7f83748c1740 1 Processor -- start 2024-09-10T11:07:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.067+0000 7f83748c1740 1 -- start start 2024-09-10T11:07:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.067+0000 7f83748c1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d11490bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.067+0000 7f83748c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 0x55d114916770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.067+0000 7f83748c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d1149190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.067+0000 7f83748c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d1148702f0 con 0x55d114916cb0 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.067+0000 7f83748c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d114818270 con 0x55d11490c410 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.067+0000 7f83748c1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d11486c2b0 con 0x55d11490baf0 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d1149190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d11490bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d11490bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.59:54934/0 (socket says 172.21.15.59:54934) 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 -- 172.21.15.59:0/186139483 learned_addr learned my addr 172.21.15.59:0/186139483 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836b7fe640 1 --2- 172.21.15.59:0/186139483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 0x55d114916770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f8368ff9640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f83580a2e20 0x7f83580a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 -- 172.21.15.59:0/186139483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 msgr2=0x55d114916770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 --2- 172.21.15.59:0/186139483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 0x55d114916770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 -- 172.21.15.59:0/186139483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 msgr2=0x55d1149190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836bfff640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f83580a2e20 0x7f83580a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 --2- 172.21.15.59:0/186139483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d1149190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 -- 172.21.15.59:0/186139483 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d114817340 con 0x55d11490baf0 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836b7fe640 1 --2- 172.21.15.59:0/186139483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 0x55d114916770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f8368ff9640 1 -- 172.21.15.59:0/3655368141 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f83640cf710 con 0x7f836c106a00 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.068+0000 7f836affd640 1 --2- 172.21.15.59:0/186139483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d11490bed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f835402a940 tx=0x7f8354009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=307e0a7e03ce3776 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f8361ffb640 1 -- 172.21.15.59:0/186139483 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354035040 con 0x55d11490baf0 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f836bfff640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f83580a2e20 0x7f83580a52e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f836401c000 tx=0x7f83640058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f8361ffb640 1 -- 172.21.15.59:0/186139483 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83540035f0 con 0x55d11490baf0 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f8361ffb640 1 -- 172.21.15.59:0/186139483 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835403d6a0 con 0x55d11490baf0 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f83748c1740 1 -- 172.21.15.59:0/186139483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 msgr2=0x55d11490bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f83748c1740 1 --2- 172.21.15.59:0/186139483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d11490bed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f835402a940 tx=0x7f8354009260 comp rx=0 tx=0).stop 2024-09-10T11:07:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f83748c1740 1 -- 172.21.15.59:0/186139483 shutdown_connections 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f83748c1740 1 --2- 172.21.15.59:0/186139483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d1149190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f83748c1740 1 --2- 172.21.15.59:0/186139483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 0x55d114916770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f83748c1740 1 --2- 172.21.15.59:0/186139483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d11490bed0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f83748c1740 1 -- 172.21.15.59:0/186139483 >> 172.21.15.59:0/186139483 conn(0x55d114908060 msgr2=0x55d114908440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f83748c1740 1 -- 172.21.15.59:0/186139483 shutdown_connections 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.069+0000 7f83748c1740 1 -- 172.21.15.59:0/186139483 wait complete. 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f83748c1740 1 -- start start 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f83748c1740 1 Processor -- start 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f83748c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d114913ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f83748c1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 0x55d1149140e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f83748c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d114916cb0 0x55d114914620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f83748c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d114919880 con 0x55d11490baf0 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f83748c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d1147f9290 con 0x55d114916cb0 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f83748c1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d114919a00 con 0x55d11490c410 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f83748c1740 10 client.0 _ll_register_callbacks cb 0x55d11482a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f836affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d114913ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.070+0000 7f836affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d114913ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48306/0 (socket says 172.21.15.59:48306) 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f836affd640 1 -- 172.21.15.59:0/959833717 learned_addr learned my addr 172.21.15.59:0/959833717 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f836b7fe640 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 0x55d1149140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f836affd640 1 -- 172.21.15.59:0/959833717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 msgr2=0x55d1149140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f836affd640 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 0x55d1149140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f836affd640 1 -- 172.21.15.59:0/959833717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d114916cb0 msgr2=0x55d114914620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f836affd640 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d114916cb0 0x55d114914620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f836affd640 1 -- 172.21.15.59:0/959833717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d114583210 con 0x55d11490baf0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f836affd640 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d114913ba0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8354031510 tx=0x7f8354005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6500844b75da902c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f834affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f834affd640 1 -- 172.21.15.59:0/959833717 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835404e020 con 0x55d11490baf0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f83748c1740 1 -- 172.21.15.59:0/959833717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83540035f0 con 0x55d11490baf0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f834affd640 1 -- 172.21.15.59:0/959833717 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f83540041e0 con 0x55d11490baf0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f834affd640 1 -- 172.21.15.59:0/959833717 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8354059050 con 0x55d11490baf0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f83748c1740 10 client.15747 fetch_fsmap learned FSMap version 26 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.071+0000 7f83748c1740 1 -- 172.21.15.59:0/959833717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d11464f620 con 0x55d11490baf0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.072+0000 7f834affd640 1 -- 172.21.15.59:0/959833717 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83540035f0 con 0x55d11490baf0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.072+0000 7f834affd640 1 -- 172.21.15.59:0/959833717 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f835403d640 con 0x55d11490baf0 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.072+0000 7f83748c1740 10 client.15747 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.072+0000 7f83748c1740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:07:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.072+0000 7f83748c1740 20 client.15747 populate_metadata read hostname 'smithi059' 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.072+0000 7f83748c1740 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d11492af00 0x55d11492d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.072+0000 7f83748c1740 4 client.15747 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.072+0000 7f83748c1740 1 -- 172.21.15.59:0/959833717 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d11487da20 con 0x55d11492af00 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.072+0000 7f836b7fe640 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d11492af00 0x55d11492d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.073+0000 7f836b7fe640 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d11492af00 0x55d11492d2f0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e61e9a24310d48 server_cookie=39a0833a4b8d9cd2 in_seq=0 out_seq=0 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.073+0000 7f834affd640 10 client.15747 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.073+0000 7f834affd640 1 -- 172.21.15.59:0/959833717 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d11487da20 con 0x55d11492af00 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.073+0000 7f834affd640 10 client.15747 handle_command_reply: tid=0 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 client.15747 shutdown 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 -- 172.21.15.59:0/959833717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 msgr2=0x55d114913ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d114913ba0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8354031510 tx=0x7f8354005e60 comp rx=0 tx=0).stop 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 -- 172.21.15.59:0/959833717 shutdown_connections 2024-09-10T11:07:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d11492af00 0x55d11492d2f0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d114916cb0 0x55d114914620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 0x55d1149140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f834affd640 0 client.15747 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 --2- 172.21.15.59:0/959833717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d114913ba0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 -- 172.21.15.59:0/959833717 >> 172.21.15.59:0/959833717 conn(0x55d114908060 msgr2=0x55d11490dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 -- 172.21.15.59:0/959833717 shutdown_connections 2024-09-10T11:07:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 1 -- 172.21.15.59:0/959833717 wait complete. 2024-09-10T11:07:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.074+0000 7f83748c1740 20 client.15747 trim_cache size 0 max 16384 2024-09-10T11:07:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.088+0000 7f83748c1740 1 Processor -- start 2024-09-10T11:07:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.088+0000 7f83748c1740 1 -- start start 2024-09-10T11:07:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f83748c1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d1149328c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f83748c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 0x55d114932e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f83748c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d114910de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f83748c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f836c1adf10 con 0x55d114916cb0 2024-09-10T11:07:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f83748c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f836c1ab7e0 con 0x55d11490c410 2024-09-10T11:07:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f83748c1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f836c1a9630 con 0x55d11490baf0 2024-09-10T11:07:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d114910de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d114910de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48314/0 (socket says 172.21.15.59:48314) 2024-09-10T11:07:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 -- 172.21.15.59:0/1451232517 learned_addr learned my addr 172.21.15.59:0/1451232517 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 --2- 172.21.15.59:0/1451232517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d1149328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836b7fe640 1 --2- 172.21.15.59:0/1451232517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 0x55d114932e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 -- 172.21.15.59:0/1451232517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 msgr2=0x55d1149328c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 --2- 172.21.15.59:0/1451232517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d1149328c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 -- 172.21.15.59:0/1451232517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 msgr2=0x55d114932e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 --2- 172.21.15.59:0/1451232517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 0x55d114932e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 -- 172.21.15.59:0/1451232517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d114912b30 con 0x55d114916cb0 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f836affd640 1 --2- 172.21.15.59:0/1451232517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d114910de0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8354001eb0 tx=0x7f8354005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4598ea835e3620da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f83617fa640 1 -- 172.21.15.59:0/1451232517 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354062070 con 0x55d114916cb0 2024-09-10T11:07:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f83617fa640 1 -- 172.21.15.59:0/1451232517 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f835403de00 con 0x55d114916cb0 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.089+0000 7f83617fa640 1 -- 172.21.15.59:0/1451232517 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835404e040 con 0x55d114916cb0 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 -- 172.21.15.59:0/1451232517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 msgr2=0x55d114910de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 --2- 172.21.15.59:0/1451232517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d114910de0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8354001eb0 tx=0x7f8354005be0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 -- 172.21.15.59:0/1451232517 shutdown_connections 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 --2- 172.21.15.59:0/1451232517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d114916cb0 0x55d114910de0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 --2- 172.21.15.59:0/1451232517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d11490c410 0x55d114932e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 --2- 172.21.15.59:0/1451232517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490baf0 0x55d1149328c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 -- 172.21.15.59:0/1451232517 >> 172.21.15.59:0/1451232517 conn(0x55d114908060 msgr2=0x55d114915c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 -- 172.21.15.59:0/1451232517 shutdown_connections 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 -- 172.21.15.59:0/1451232517 wait complete. 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.090+0000 7f83748c1740 1 -- start start 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f83748c1740 1 Processor -- start 2024-09-10T11:07:34.098 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f83748c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d1149237e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f83748c1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 0x55d11491eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f83748c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d114916cb0 0x55d11491f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f83748c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f836c1a9ca0 con 0x55d11490baf0 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f83748c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f836c1ab110 con 0x55d114916cb0 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f83748c1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f836c1aa370 con 0x55d11490c410 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f83748c1740 10 client.0 _ll_register_callbacks cb 0x7f8354032c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d1149237e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d1149237e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48318/0 (socket says 172.21.15.59:48318) 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836affd640 1 -- 172.21.15.59:0/592781709 learned_addr learned my addr 172.21.15.59:0/592781709 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836b7fe640 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 0x55d11491eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836affd640 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d114916cb0 0x55d11491f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836affd640 1 -- 172.21.15.59:0/592781709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 msgr2=0x55d11491eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836affd640 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 0x55d11491eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836affd640 1 -- 172.21.15.59:0/592781709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d114916cb0 msgr2=0x55d11491f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836affd640 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d114916cb0 0x55d11491f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836affd640 1 -- 172.21.15.59:0/592781709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d11491f870 con 0x55d11490baf0 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.091+0000 7f836b7fe640 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 0x55d11491eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f836affd640 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d1149237e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8354060040 tx=0x7f8354004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3187a753bbd71063 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f834affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f834affd640 1 -- 172.21.15.59:0/592781709 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354062030 con 0x55d11490baf0 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f834affd640 1 -- 172.21.15.59:0/592781709 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f835403dc00 con 0x55d11490baf0 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f83748c1740 1 -- 172.21.15.59:0/592781709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f835403de00 con 0x55d11490baf0 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f834affd640 1 -- 172.21.15.59:0/592781709 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f835404e040 con 0x55d11490baf0 2024-09-10T11:07:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f83748c1740 10 client.15753 fetch_fsmap learned FSMap version 26 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f83748c1740 1 -- 172.21.15.59:0/592781709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d1149957b0 con 0x55d11490baf0 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f834affd640 1 -- 172.21.15.59:0/592781709 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f835403de00 con 0x55d11490baf0 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f834affd640 1 -- 172.21.15.59:0/592781709 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8354003b40 con 0x55d11490baf0 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f83748c1740 10 client.15753 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f83748c1740 10 client.15753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f83748c1740 20 client.15753 populate_metadata read hostname 'smithi059' 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f83748c1740 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d114995cd0 0x55d1149980c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f83748c1740 4 client.15753 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.092+0000 7f83748c1740 1 -- 172.21.15.59:0/592781709 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d114877d70 con 0x55d114995cd0 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.093+0000 7f836b7fe640 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d114995cd0 0x55d1149980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.093+0000 7f836b7fe640 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d114995cd0 0x55d1149980c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d12422cff245e724 server_cookie=7c4ecb25c0bcf2bd in_seq=0 out_seq=0 2024-09-10T11:07:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.093+0000 7f834affd640 10 client.15753 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.106+0000 7f834affd640 1 -- 172.21.15.59:0/592781709 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d114877d70 con 0x55d114995cd0 2024-09-10T11:07:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.106+0000 7f834affd640 10 client.15753 handle_command_reply: tid=0 2024-09-10T11:07:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.106+0000 7f83748c1740 1 client.15753 shutdown 2024-09-10T11:07:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 -- 172.21.15.59:0/592781709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 msgr2=0x55d1149237e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d1149237e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8354060040 tx=0x7f8354004340 comp rx=0 tx=0).stop 2024-09-10T11:07:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 -- 172.21.15.59:0/592781709 shutdown_connections 2024-09-10T11:07:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55d114995cd0 0x55d1149980c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d114916cb0 0x55d11491f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d11490c410 0x55d11491eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f834affd640 0 client.15753 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 --2- 172.21.15.59:0/592781709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d11490baf0 0x55d1149237e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 -- 172.21.15.59:0/592781709 >> 172.21.15.59:0/592781709 conn(0x55d114908060 msgr2=0x55d11490d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 -- 172.21.15.59:0/592781709 shutdown_connections 2024-09-10T11:07:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 1 -- 172.21.15.59:0/592781709 wait complete. 2024-09-10T11:07:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f83748c1740 20 client.15753 trim_cache size 0 max 16384 2024-09-10T11:07:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:07:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:07:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:07:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:07:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f8371b2c640 1 -- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f83580a2e20 msgr2=0x7f83580a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f8371b2c640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f83580a2e20 0x7f83580a52e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f836401c000 tx=0x7f83640058d0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f8371b2c640 1 -- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c106a00 msgr2=0x7f836c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.107+0000 7f8371b2c640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c106a00 0x7f836c19cc70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f836400eaa0 tx=0x7f836400ef60 comp rx=0 tx=0).stop 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.108+0000 7f8371b2c640 1 -- 172.21.15.59:0/3655368141 shutdown_connections 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.108+0000 7f8371b2c640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836c106a00 0x7f836c19cc70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.108+0000 7f8371b2c640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f83580a2e20 0x7f83580a52e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.108+0000 7f8371b2c640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f836c101390 0x7f836c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.108+0000 7f8371b2c640 1 --2- 172.21.15.59:0/3655368141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f836c1009f0 0x7f836c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.108+0000 7f8371b2c640 1 -- 172.21.15.59:0/3655368141 >> 172.21.15.59:0/3655368141 conn(0x7f836c0fc6b0 msgr2=0x7f836c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.108+0000 7f8371b2c640 1 -- 172.21.15.59:0/3655368141 shutdown_connections 2024-09-10T11:07:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:34.108+0000 7f8371b2c640 1 -- 172.21.15.59:0/3655368141 wait complete. 2024-09-10T11:07:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:33 smithi059 ceph-mon[30978]: pgmap v189: 97 pgs: 97 active+clean; 1.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:07:34.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:33 smithi181 ceph-mon[35409]: pgmap v189: 97 pgs: 97 active+clean; 1.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:07:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:33 smithi115 ceph-mon[34719]: pgmap v189: 97 pgs: 97 active+clean; 1.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:07:36.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:35 smithi059 ceph-mon[30978]: pgmap v190: 97 pgs: 97 active+clean; 1.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-09-10T11:07:36.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:35 smithi181 ceph-mon[35409]: pgmap v190: 97 pgs: 97 active+clean; 1.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-09-10T11:07:36.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:35 smithi115 ceph-mon[34719]: pgmap v190: 97 pgs: 97 active+clean; 1.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-09-10T11:07:38.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:37 smithi059 ceph-mon[30978]: pgmap v191: 97 pgs: 97 active+clean; 1.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-09-10T11:07:38.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:37 smithi181 ceph-mon[35409]: pgmap v191: 97 pgs: 97 active+clean; 1.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-09-10T11:07:38.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:37 smithi115 ceph-mon[34719]: pgmap v191: 97 pgs: 97 active+clean; 1.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-09-10T11:07:40.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:39 smithi059 ceph-mon[30978]: pgmap v192: 97 pgs: 97 active+clean; 2.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 16 op/s 2024-09-10T11:07:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:39 smithi181 ceph-mon[35409]: pgmap v192: 97 pgs: 97 active+clean; 2.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 16 op/s 2024-09-10T11:07:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:39 smithi115 ceph-mon[34719]: pgmap v192: 97 pgs: 97 active+clean; 2.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 16 op/s 2024-09-10T11:07:42.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:41 smithi059 ceph-mon[30978]: pgmap v193: 97 pgs: 97 active+clean; 2.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 12 op/s 2024-09-10T11:07:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:41 smithi181 ceph-mon[35409]: pgmap v193: 97 pgs: 97 active+clean; 2.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 12 op/s 2024-09-10T11:07:42.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:41 smithi115 ceph-mon[34719]: pgmap v193: 97 pgs: 97 active+clean; 2.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 12 op/s 2024-09-10T11:07:44.278 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:251/600: open fd = 3 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:252/600: open fd = 3 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:253/600: open fd = 3 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:254/600: open fd = 3 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:255/600: open fd = 3 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:256/600: open fd = 3 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.280 INFO:tasks.workunit.client.0.smithi059.stdout:257/600: open fd = 3 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:258/600: open fd = 3 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:259/600: open fd = 3 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:260/600: open fd = 3 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.281 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:261/600: open fd = 3 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:262/600: open fd = 3 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:263/600: open fd = 3 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:264/600: open fd = 3 2024-09-10T11:07:44.282 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:265/600: open fd = 3 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:266/600: open fd = 3 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:267/600: open fd = 3 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:268/600: open fd = 3 2024-09-10T11:07:44.283 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:269/600: open fd = 3 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:270/600: open fd = 3 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:271/600: open fd = 3 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.284 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:272/600: open fd = 3 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:273/600: open fd = 3 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:274/600: open fd = 3 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.285 INFO:tasks.workunit.client.0.smithi059.stdout:275/600: open fd = 3 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:276/600: open fd = 3 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:277/600: open fd = 3 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:278/600: open fd = 3 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:279/600: open fd = 3 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:280/600: open fd = 3 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:281/600: open fd = 3 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.287 INFO:tasks.workunit.client.0.smithi059.stdout:282/600: open fd = 3 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:283/600: open fd = 3 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:284/600: open fd = 3 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.288 INFO:tasks.workunit.client.0.smithi059.stdout:285/600: open fd = 3 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:286/600: open fd = 3 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:287/600: open fd = 3 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:288/600: open fd = 3 2024-09-10T11:07:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:289/600: open fd = 3 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:290/600: open fd = 3 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:291/600: open fd = 3 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:292/600: open fd = 3 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:293/600: open fd = 3 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:294/600: open fd = 3 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.291 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:295/600: open fd = 3 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:296/600: open fd = 3 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:297/600: open fd = 3 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:298/600: open fd = 3 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:299/600: open fd = 3 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:300/600: open fd = 3 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:301/600: open fd = 3 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.293 INFO:tasks.workunit.client.0.smithi059.stdout:302/600: open fd = 3 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:303/600: open fd = 3 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:304/600: open fd = 3 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:305/600: open fd = 3 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.294 INFO:tasks.workunit.client.0.smithi059.stdout:306/600: open fd = 3 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:307/600: open fd = 3 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:308/600: open fd = 3 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:309/600: open fd = 3 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.295 INFO:tasks.workunit.client.0.smithi059.stdout:310/600: open fd = 3 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:311/600: open fd = 3 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:312/600: open fd = 3 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:07:44.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:43 smithi059 ceph-mon[30978]: pgmap v194: 97 pgs: 97 active+clean; 2.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 12 op/s 2024-09-10T11:07:44.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:43 smithi181 ceph-mon[35409]: pgmap v194: 97 pgs: 97 active+clean; 2.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 12 op/s 2024-09-10T11:07:44.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:43 smithi115 ceph-mon[34719]: pgmap v194: 97 pgs: 97 active+clean; 2.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 12 op/s 2024-09-10T11:07:46.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:45 smithi059 ceph-mon[30978]: pgmap v195: 97 pgs: 97 active+clean; 2.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-09-10T11:07:46.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:45 smithi181 ceph-mon[35409]: pgmap v195: 97 pgs: 97 active+clean; 2.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-09-10T11:07:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:45 smithi115 ceph-mon[34719]: pgmap v195: 97 pgs: 97 active+clean; 2.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-09-10T11:07:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.211+0000 7f10c01b0640 1 -- 172.21.15.59:0/776731296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 msgr2=0x7f10b810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.211+0000 7f10c01b0640 1 --2- 172.21.15.59:0/776731296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 0x7f10b810d8c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009cd0 tx=0x7f10b002a8e0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.211+0000 7f10c01b0640 1 -- 172.21.15.59:0/776731296 shutdown_connections 2024-09-10T11:07:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.211+0000 7f10c01b0640 1 --2- 172.21.15.59:0/776731296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 0x7f10b810d8c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.211+0000 7f10c01b0640 1 --2- 172.21.15.59:0/776731296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b81009f0 0x7f10b8100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.211+0000 7f10c01b0640 1 --2- 172.21.15.59:0/776731296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10b8106a00 0x7f10b8106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.211+0000 7f10c01b0640 1 -- 172.21.15.59:0/776731296 >> 172.21.15.59:0/776731296 conn(0x7f10b80fc6b0 msgr2=0x7f10b80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.211+0000 7f10c01b0640 1 -- 172.21.15.59:0/776731296 shutdown_connections 2024-09-10T11:07:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.211+0000 7f10c01b0640 1 -- 172.21.15.59:0/776731296 wait complete. 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10c01b0640 1 Processor -- start 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10c01b0640 1 -- start start 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10c01b0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b81009f0 0x7f10b8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10c01b0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 0x7f10b8198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10c01b0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10b8106a00 0x7f10b819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10c01b0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8110e40 con 0x7f10b8101390 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10c01b0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8110cc0 con 0x7f10b81009f0 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10c01b0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8110fc0 con 0x7f10b8106a00 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10bd74b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 0x7f10b8198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10bd74b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 0x7f10b8198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35210/0 (socket says 172.21.15.59:35210) 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10bd74b640 1 -- 172.21.15.59:0/4045447886 learned_addr learned my addr 172.21.15.59:0/4045447886 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b81009f0 0x7f10b8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10be74d640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10b8106a00 0x7f10b819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.212+0000 7f10bd74b640 1 -- 172.21.15.59:0/4045447886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10b8106a00 msgr2=0x7f10b819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10bd74b640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10b8106a00 0x7f10b819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10bd74b640 1 -- 172.21.15.59:0/4045447886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b81009f0 msgr2=0x7f10b8198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10bd74b640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b81009f0 0x7f10b8198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10bd74b640 1 -- 172.21.15.59:0/4045447886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b819d340 con 0x7f10b8101390 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10bd74b640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 0x7f10b8198890 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e9f0 tx=0x7f10a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10aeffd640 1 -- 172.21.15.59:0/4045447886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a800cd80 con 0x7f10b8101390 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10aeffd640 1 -- 172.21.15.59:0/4045447886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a8010910 con 0x7f10b8101390 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10c01b0640 1 -- 172.21.15.59:0/4045447886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b819d630 con 0x7f10b8101390 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10aeffd640 1 -- 172.21.15.59:0/4045447886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8018990 con 0x7f10b8101390 2024-09-10T11:07:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.213+0000 7f10c01b0640 1 -- 172.21.15.59:0/4045447886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b81a4ec0 con 0x7f10b8101390 2024-09-10T11:07:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10aeffd640 1 -- 172.21.15.59:0/4045447886 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f10a8010ac0 con 0x7f10b8101390 2024-09-10T11:07:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10c3025740 1 Processor -- start 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10c3025740 1 -- start start 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10c3025740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10c3025740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 0x555cb72f1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10c3025740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72f1cb0 0x555cb72f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10c3025740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555cb724b2f0 con 0x555cb72f1cb0 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10c3025740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x555cb71f3270 con 0x555cb72e6af0 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10c3025740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555cb72472b0 con 0x555cb72e7410 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10bd74b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72f1cb0 0x555cb72f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10bd74b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72f1cb0 0x555cb72f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35224/0 (socket says 172.21.15.59:35224) 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.216+0000 7f10bd74b640 1 -- 172.21.15.59:0/37699649 learned_addr learned my addr 172.21.15.59:0/37699649 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 0x555cb72f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10be74d640 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10aeffd640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f10a40a2e20 0x7f10a40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10bd74b640 1 -- 172.21.15.59:0/37699649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 msgr2=0x555cb72f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10bd74b640 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 0x555cb72f1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10bd74b640 1 -- 172.21.15.59:0/37699649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 msgr2=0x555cb72e6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10bd74b640 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72e6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10bd74b640 1 -- 172.21.15.59:0/37699649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cb71f2340 con 0x555cb72f1cb0 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10be74d640 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 0x555cb72f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10be74d640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f10a40a2e20 0x7f10a40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10aeffd640 1 -- 172.21.15.59:0/4045447886 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f10a80cf6e0 con 0x7f10b8101390 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10bd74b640 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72f1cb0 0x555cb72f40a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f10a80ccd80 tx=0x7f10a8024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c61c5df3c84efdf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10a3fff640 1 -- 172.21.15.59:0/37699649 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a809b7d0 con 0x555cb72f1cb0 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10be74d640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f10a40a2e20 0x7f10a40a52e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10b0006010 tx=0x7f10b003e040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10a3fff640 1 -- 172.21.15.59:0/37699649 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a809bc90 con 0x555cb72f1cb0 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.217+0000 7f10a3fff640 1 -- 172.21.15.59:0/37699649 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a809b5f0 con 0x555cb72f1cb0 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.218+0000 7f10c3025740 1 -- 172.21.15.59:0/37699649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72f1cb0 msgr2=0x555cb72f40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.218+0000 7f10c3025740 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72f1cb0 0x555cb72f40a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f10a80ccd80 tx=0x7f10a8024000 comp rx=0 tx=0).stop 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.218+0000 7f10c3025740 1 -- 172.21.15.59:0/37699649 shutdown_connections 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.218+0000 7f10c3025740 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72f1cb0 0x555cb72f40a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.218+0000 7f10c3025740 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 0x555cb72f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.218+0000 7f10c3025740 1 --2- 172.21.15.59:0/37699649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.218+0000 7f10c3025740 1 -- 172.21.15.59:0/37699649 >> 172.21.15.59:0/37699649 conn(0x555cb72e3060 msgr2=0x555cb72e3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.218+0000 7f10c3025740 1 -- 172.21.15.59:0/37699649 shutdown_connections 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.218+0000 7f10c3025740 1 -- 172.21.15.59:0/37699649 wait complete. 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10c3025740 1 -- start start 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10c3025740 1 Processor -- start 2024-09-10T11:07:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10c3025740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10c3025740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72ef020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10c3025740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 0x555cb72ef560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10c3025740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555cb72f4880 con 0x555cb72e7410 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10c3025740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x555cb71d4290 con 0x555cb72e6af0 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10c3025740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555cb72f4a00 con 0x555cb72f1cb0 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10c3025740 10 client.0 _ll_register_callbacks cb 0x555cb7205140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10bd74b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10bd74b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72ef020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35230/0 (socket says 172.21.15.59:35230) 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10bd74b640 1 -- 172.21.15.59:0/4119032590 learned_addr learned my addr 172.21.15.59:0/4119032590 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.219+0000 7f10be74d640 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 0x555cb72ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10bd74b640 1 -- 172.21.15.59:0/4119032590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 msgr2=0x555cb72ef560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10bd74b640 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 0x555cb72ef560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10bd74b640 1 -- 172.21.15.59:0/4119032590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 msgr2=0x555cb72eeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10bd74b640 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72eeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10bd74b640 1 -- 172.21.15.59:0/4119032590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cb6f5e210 con 0x555cb72e7410 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10bd74b640 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72ef020 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10a80cd410 tx=0x7f10a8097900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9bae5259365406 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10a17fa640 1 -- 172.21.15.59:0/4119032590 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a809b7d0 con 0x555cb72e7410 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10a17fa640 1 -- 172.21.15.59:0/4119032590 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f10a80d5170 con 0x555cb72e7410 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10c3025740 1 -- 172.21.15.59:0/4119032590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a809bc90 con 0x555cb72e7410 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10a17fa640 1 -- 172.21.15.59:0/4119032590 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f10a809ff90 con 0x555cb72e7410 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10c3025740 10 client.15765 fetch_fsmap learned FSMap version 26 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10c3025740 1 -- 172.21.15.59:0/4119032590 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555cb702a620 con 0x555cb72e7410 2024-09-10T11:07:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.220+0000 7f10a17fa640 1 -- 172.21.15.59:0/4119032590 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a809bc90 con 0x555cb72e7410 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.221+0000 7f10a17fa640 1 -- 172.21.15.59:0/4119032590 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f10a809bf80 con 0x555cb72e7410 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.221+0000 7f10c3025740 10 client.15765 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.221+0000 7f10c3025740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.221+0000 7f10c3025740 20 client.15765 populate_metadata read hostname 'smithi059' 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.221+0000 7f10c3025740 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x555cb7301a30 0x555cb7303e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.221+0000 7f10c3025740 4 client.15765 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.221+0000 7f10c3025740 1 -- 172.21.15.59:0/4119032590 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cb7258a20 con 0x555cb7301a30 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.221+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x555cb7301a30 0x555cb7303e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.222+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x555cb7301a30 0x555cb7303e20 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9e5ed1564cb5497 server_cookie=172a6435e388f306 in_seq=0 out_seq=0 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.222+0000 7f10a17fa640 10 client.15765 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.222+0000 7f10a17fa640 1 -- 172.21.15.59:0/4119032590 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cb7258a20 con 0x555cb7301a30 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.222+0000 7f10a17fa640 10 client.15765 handle_command_reply: tid=0 2024-09-10T11:07:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.222+0000 7f10c3025740 1 client.15765 shutdown 2024-09-10T11:07:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.222+0000 7f10c3025740 1 -- 172.21.15.59:0/4119032590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 msgr2=0x555cb72ef020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.222+0000 7f10c3025740 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72ef020 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10a80cd410 tx=0x7f10a8097900 comp rx=0 tx=0).stop 2024-09-10T11:07:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10c3025740 1 -- 172.21.15.59:0/4119032590 shutdown_connections 2024-09-10T11:07:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10c3025740 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x555cb7301a30 0x555cb7303e20 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10c3025740 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 0x555cb72ef560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10c3025740 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72ef020 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10c3025740 1 --2- 172.21.15.59:0/4119032590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72eeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10a17fa640 0 client.15765 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10c3025740 1 -- 172.21.15.59:0/4119032590 >> 172.21.15.59:0/4119032590 conn(0x555cb72e3060 msgr2=0x555cb72e21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10c3025740 1 -- 172.21.15.59:0/4119032590 shutdown_connections 2024-09-10T11:07:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10c3025740 1 -- 172.21.15.59:0/4119032590 wait complete. 2024-09-10T11:07:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.223+0000 7f10c3025740 20 client.15765 trim_cache size 0 max 16384 2024-09-10T11:07:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.237+0000 7f10c3025740 1 Processor -- start 2024-09-10T11:07:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.237+0000 7f10c3025740 1 -- start start 2024-09-10T11:07:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.237+0000 7f10c3025740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e6af0 0x555cb72e9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.237+0000 7f10c3025740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 0x555cb72ed390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.237+0000 7f10c3025740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72f1cb0 0x555cb72ef390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.237+0000 7f10c3025740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f10b81b0130 con 0x555cb72e6af0 2024-09-10T11:07:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.237+0000 7f10c3025740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f10b81ada00 con 0x555cb72f1cb0 2024-09-10T11:07:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.237+0000 7f10c3025740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f10b81ab850 con 0x555cb72e7410 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bdf4c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e6af0 0x555cb72e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bdf4c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e6af0 0x555cb72e9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35240/0 (socket says 172.21.15.59:35240) 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bdf4c640 1 -- 172.21.15.59:0/494730712 learned_addr learned my addr 172.21.15.59:0/494730712 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bd74b640 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 0x555cb72ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10be74d640 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72f1cb0 0x555cb72ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bdf4c640 1 -- 172.21.15.59:0/494730712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 msgr2=0x555cb72ed390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 0x555cb72ed390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bdf4c640 1 -- 172.21.15.59:0/494730712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72f1cb0 msgr2=0x555cb72ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72f1cb0 0x555cb72ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bdf4c640 1 -- 172.21.15.59:0/494730712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cb72e2e90 con 0x555cb72e6af0 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10be74d640 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72f1cb0 0x555cb72ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e6af0 0x555cb72e9560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000c00 tx=0x7f10b400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee79c3f13e7abd6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10a37fe640 1 -- 172.21.15.59:0/494730712 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4004220 con 0x555cb72e6af0 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10a37fe640 1 -- 172.21.15.59:0/494730712 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10b40043c0 con 0x555cb72e6af0 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.238+0000 7f10a37fe640 1 -- 172.21.15.59:0/494730712 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b401d9e0 con 0x555cb72e6af0 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 -- 172.21.15.59:0/494730712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e6af0 msgr2=0x555cb72e9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e6af0 0x555cb72e9560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000c00 tx=0x7f10b400b410 comp rx=0 tx=0).stop 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 -- 172.21.15.59:0/494730712 shutdown_connections 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72f1cb0 0x555cb72ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72e7410 0x555cb72ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 --2- 172.21.15.59:0/494730712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e6af0 0x555cb72e9560 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 -- 172.21.15.59:0/494730712 >> 172.21.15.59:0/494730712 conn(0x555cb72e3060 msgr2=0x555cb72f0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 -- 172.21.15.59:0/494730712 shutdown_connections 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 -- 172.21.15.59:0/494730712 wait complete. 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 -- start start 2024-09-10T11:07:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.239+0000 7f10c3025740 1 Processor -- start 2024-09-10T11:07:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10c3025740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72fa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10c3025740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72f5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10c3025740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 0x555cb72f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10c3025740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f10b81abec0 con 0x555cb72e7410 2024-09-10T11:07:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10c3025740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f10b81ad330 con 0x555cb72e6af0 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10c3025740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f10b81ac590 con 0x555cb72f1cb0 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10c3025740 10 client.0 _ll_register_callbacks cb 0x7f10b400b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bd74b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bd74b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35244/0 (socket says 172.21.15.59:35244) 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bd74b640 1 -- 172.21.15.59:0/2614924278 learned_addr learned my addr 172.21.15.59:0/2614924278 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10be74d640 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 0x555cb72f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bd74b640 1 -- 172.21.15.59:0/2614924278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 msgr2=0x555cb72f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bd74b640 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 0x555cb72f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bd74b640 1 -- 172.21.15.59:0/2614924278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 msgr2=0x555cb72fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bd74b640 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72fa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bd74b640 1 -- 172.21.15.59:0/2614924278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cb72de2d0 con 0x555cb72e7410 2024-09-10T11:07:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10be74d640 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 0x555cb72f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10bd74b640 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72f5680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f10a8085120 tx=0x7f10a809b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae128129c97493e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10a17fa640 1 -- 172.21.15.59:0/2614924278 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80a4850 con 0x555cb72e7410 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10a17fa640 1 -- 172.21.15.59:0/2614924278 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7f10a8098300 con 0x555cb72e7410 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.240+0000 7f10c3025740 1 -- 172.21.15.59:0/2614924278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10b40043c0 con 0x555cb72e7410 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10a17fa640 1 -- 172.21.15.59:0/2614924278 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f10a809bef0 con 0x555cb72e7410 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10c3025740 10 client.15771 fetch_fsmap learned FSMap version 26 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10c3025740 1 -- 172.21.15.59:0/2614924278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555cb736c0e0 con 0x555cb72e7410 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10a17fa640 1 -- 172.21.15.59:0/2614924278 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10b40043c0 con 0x555cb72e7410 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10a17fa640 1 -- 172.21.15.59:0/2614924278 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f10a8018c50 con 0x555cb72e7410 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10c3025740 10 client.15771 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:07:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10c3025740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:07:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10c3025740 20 client.15771 populate_metadata read hostname 'smithi059' 2024-09-10T11:07:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10c3025740 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x555cb736c6d0 0x555cb736eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:07:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10c3025740 4 client.15771 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:07:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10c3025740 1 -- 172.21.15.59:0/2614924278 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cb7252d70 con 0x555cb736c6d0 2024-09-10T11:07:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.241+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x555cb736c6d0 0x555cb736eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:07:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.242+0000 7f10a17fa640 10 client.15771 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.242+0000 7f10bdf4c640 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x555cb736c6d0 0x555cb736eaf0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81ff69bf46f39f19 server_cookie=82ba193a84b68c0c in_seq=0 out_seq=0 2024-09-10T11:07:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10a17fa640 1 -- 172.21.15.59:0/2614924278 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cb7252d70 con 0x555cb736c6d0 2024-09-10T11:07:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10a17fa640 10 client.15771 handle_command_reply: tid=0 2024-09-10T11:07:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 client.15771 shutdown 2024-09-10T11:07:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 -- 172.21.15.59:0/2614924278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 msgr2=0x555cb72f5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72f5680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f10a8085120 tx=0x7f10a809b5f0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 -- 172.21.15.59:0/2614924278 shutdown_connections 2024-09-10T11:07:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x555cb736c6d0 0x555cb736eaf0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555cb72f1cb0 0x555cb72f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cb72e7410 0x555cb72f5680 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10a17fa640 0 client.15771 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:07:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 --2- 172.21.15.59:0/2614924278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555cb72e6af0 0x555cb72fa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 -- 172.21.15.59:0/2614924278 >> 172.21.15.59:0/2614924278 conn(0x555cb72e3060 msgr2=0x555cb72f0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 -- 172.21.15.59:0/2614924278 shutdown_connections 2024-09-10T11:07:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 1 -- 172.21.15.59:0/2614924278 wait complete. 2024-09-10T11:07:47.258 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.256+0000 7f10c3025740 20 client.15771 trim_cache size 0 max 16384 2024-09-10T11:07:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:07:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:07:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:07:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:07:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 -- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f10a40a2e20 msgr2=0x7f10a40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f10a40a2e20 0x7f10a40a52e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10b0006010 tx=0x7f10b003e040 comp rx=0 tx=0).stop 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 -- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 msgr2=0x7f10b8198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 0x7f10b8198890 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e9f0 tx=0x7f10a800eeb0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 -- 172.21.15.59:0/4045447886 shutdown_connections 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f10a40a2e20 0x7f10a40a52e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f10b8106a00 0x7f10b819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10b8101390 0x7f10b8198890 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 --2- 172.21.15.59:0/4045447886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b81009f0 0x7f10b8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 -- 172.21.15.59:0/4045447886 >> 172.21.15.59:0/4045447886 conn(0x7f10b80fc6b0 msgr2=0x7f10b80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 -- 172.21.15.59:0/4045447886 shutdown_connections 2024-09-10T11:07:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:07:47.257+0000 7f10c01b0640 1 -- 172.21.15.59:0/4045447886 wait complete. 2024-09-10T11:07:48.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:47 smithi059 ceph-mon[30978]: pgmap v196: 97 pgs: 97 active+clean; 2.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:07:48.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:47 smithi181 ceph-mon[35409]: pgmap v196: 97 pgs: 97 active+clean; 2.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:07:48.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:47 smithi115 ceph-mon[34719]: pgmap v196: 97 pgs: 97 active+clean; 2.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:07:50.261 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:49 smithi115 ceph-mon[34719]: pgmap v197: 97 pgs: 97 active+clean; 2.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 19 op/s 2024-09-10T11:07:50.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:49 smithi059 ceph-mon[30978]: pgmap v197: 97 pgs: 97 active+clean; 2.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 19 op/s 2024-09-10T11:07:50.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:49 smithi181 ceph-mon[35409]: pgmap v197: 97 pgs: 97 active+clean; 2.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 19 op/s 2024-09-10T11:07:52.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:52 smithi059 ceph-mon[30978]: pgmap v198: 97 pgs: 97 active+clean; 2.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-10T11:07:52.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:52 smithi181 ceph-mon[35409]: pgmap v198: 97 pgs: 97 active+clean; 2.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-10T11:07:52.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:52 smithi115 ceph-mon[34719]: pgmap v198: 97 pgs: 97 active+clean; 2.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-10T11:07:54.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:54 smithi059 ceph-mon[30978]: pgmap v199: 97 pgs: 97 active+clean; 2.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-10T11:07:54.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:54 smithi181 ceph-mon[35409]: pgmap v199: 97 pgs: 97 active+clean; 2.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-10T11:07:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:54 smithi115 ceph-mon[34719]: pgmap v199: 97 pgs: 97 active+clean; 2.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-10T11:07:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:56 smithi059 ceph-mon[30978]: pgmap v200: 97 pgs: 97 active+clean; 2.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-09-10T11:07:56.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:56 smithi181 ceph-mon[35409]: pgmap v200: 97 pgs: 97 active+clean; 2.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-09-10T11:07:56.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:56 smithi115 ceph-mon[34719]: pgmap v200: 97 pgs: 97 active+clean; 2.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-09-10T11:07:58.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:07:58 smithi059 ceph-mon[30978]: pgmap v201: 97 pgs: 97 active+clean; 2.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-10T11:07:58.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:07:58 smithi181 ceph-mon[35409]: pgmap v201: 97 pgs: 97 active+clean; 2.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-10T11:07:58.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:07:58 smithi115 ceph-mon[34719]: pgmap v201: 97 pgs: 97 active+clean; 2.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/616401410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24106a00 msgr2=0x7fdc24106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/616401410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24106a00 0x7fdc24106de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009930 tx=0x7fdc2002a420 comp rx=0 tx=0).stop 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/616401410 shutdown_connections 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/616401410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc24101390 0x7fdc2410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/616401410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc241009f0 0x7fdc24100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/616401410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24106a00 0x7fdc24106de0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/616401410 >> 172.21.15.59:0/616401410 conn(0x7fdc240fc6b0 msgr2=0x7fdc240fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/616401410 shutdown_connections 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/616401410 wait complete. 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.358+0000 7fdc2c5c4640 1 Processor -- start 2024-09-10T11:08:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2c5c4640 1 -- start start 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2c5c4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc241009f0 0x7fdc241983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2c5c4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24101390 0x7fdc24198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2c5c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc24106a00 0x7fdc2419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2c5c4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdc24110e40 con 0x7fdc24101390 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2c5c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc24110cc0 con 0x7fdc24106a00 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2c5c4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc24110fc0 con 0x7fdc241009f0 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc29b5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24101390 0x7fdc24198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc29b5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24101390 0x7fdc24198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39912/0 (socket says 172.21.15.59:39912) 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc29b5f640 1 -- 172.21.15.59:0/3683547614 learned_addr learned my addr 172.21.15.59:0/3683547614 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2a360640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc241009f0 0x7fdc241983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc24106a00 0x7fdc2419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc29b5f640 1 -- 172.21.15.59:0/3683547614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc241009f0 msgr2=0x7fdc241983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc241009f0 0x7fdc241983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc29b5f640 1 -- 172.21.15.59:0/3683547614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc24106a00 msgr2=0x7fdc2419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc24106a00 0x7fdc2419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc29b5f640 1 -- 172.21.15.59:0/3683547614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2419d3d0 con 0x7fdc24101390 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc24106a00 0x7fdc2419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.359+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24101390 0x7fdc24198920 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400d770 tx=0x7fdc1400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.360+0000 7fdc1b7fe640 1 -- 172.21.15.59:0/3683547614 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14017070 con 0x7fdc24101390 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.360+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/3683547614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2419d6c0 con 0x7fdc24101390 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.360+0000 7fdc1b7fe640 1 -- 172.21.15.59:0/3683547614 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc14005500 con 0x7fdc24101390 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.360+0000 7fdc1b7fe640 1 -- 172.21.15.59:0/3683547614 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14004e00 con 0x7fdc24101390 2024-09-10T11:08:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.360+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/3683547614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc241a4f50 con 0x7fdc24101390 2024-09-10T11:08:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.362+0000 7fdc1b7fe640 1 -- 172.21.15.59:0/3683547614 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fdc14004fa0 con 0x7fdc24101390 2024-09-10T11:08:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.362+0000 7fdc2f441740 1 Processor -- start 2024-09-10T11:08:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2f441740 1 -- start start 2024-09-10T11:08:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02aa9d0 0x5572a02aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02ba0c0 0x5572a02bc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2f441740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5572a020f2f0 con 0x5572a02ab2f0 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2f441740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5572a01b7270 con 0x5572a02ba0c0 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2f441740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5572a020b2b0 con 0x5572a02aa9d0 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2a360640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2a360640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39922/0 (socket says 172.21.15.59:39922) 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2a360640 1 -- 172.21.15.59:0/1135317570 learned_addr learned my addr 172.21.15.59:0/1135317570 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc1b7fe640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc100a2da0 0x7fdc100a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/1135317570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02aa9d0 0x5572a02aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.363+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/1135317570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02ba0c0 0x5572a02bc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc100a2da0 0x7fdc100a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc1b7fe640 1 -- 172.21.15.59:0/3683547614 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fdc140ceef0 con 0x7fdc24101390 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc2a360640 1 -- 172.21.15.59:0/1135317570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02aa9d0 msgr2=0x5572a02aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc2a360640 1 --2- 172.21.15.59:0/1135317570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02aa9d0 0x5572a02aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc2a360640 1 -- 172.21.15.59:0/1135317570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02ba0c0 msgr2=0x5572a02bc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc2a360640 1 --2- 172.21.15.59:0/1135317570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02ba0c0 0x5572a02bc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc2a360640 1 -- 172.21.15.59:0/1135317570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572a01b6340 con 0x5572a02ab2f0 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc2a360640 1 --2- 172.21.15.59:0/1135317570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b9b80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdc20033000 tx=0x7fdc20031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb945584a0a6950c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc18bfe640 1 -- 172.21.15.59:0/1135317570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20040070 con 0x5572a02ab2f0 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc100a2da0 0x7fdc100a5260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c008fd0 tx=0x7fdc1c004ab0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc18bfe640 1 -- 172.21.15.59:0/1135317570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc20005020 con 0x5572a02ab2f0 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.364+0000 7fdc18bfe640 1 -- 172.21.15.59:0/1135317570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20035040 con 0x5572a02ab2f0 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 -- 172.21.15.59:0/1135317570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 msgr2=0x5572a02b9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1135317570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b9b80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdc20033000 tx=0x7fdc20031630 comp rx=0 tx=0).stop 2024-09-10T11:08:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 -- 172.21.15.59:0/1135317570 shutdown_connections 2024-09-10T11:08:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1135317570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02ba0c0 0x5572a02bc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1135317570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b9b80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1135317570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02aa9d0 0x5572a02aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 -- 172.21.15.59:0/1135317570 >> 172.21.15.59:0/1135317570 conn(0x5572a02a7060 msgr2=0x5572a02a7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 -- 172.21.15.59:0/1135317570 shutdown_connections 2024-09-10T11:08:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 -- 172.21.15.59:0/1135317570 wait complete. 2024-09-10T11:08:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 -- start start 2024-09-10T11:08:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.365+0000 7fdc2f441740 1 Processor -- start 2024-09-10T11:08:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2f441740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5572a02bcc90 con 0x5572a02ab2f0 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2f441740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5572a0198290 con 0x5572a02aa9d0 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2f441740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5572a02bce10 con 0x5572a02ba0c0 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2f441740 10 client.0 _ll_register_callbacks cb 0x5572a01c9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc29b5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc29b5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39936/0 (socket says 172.21.15.59:39936) 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc29b5f640 1 -- 172.21.15.59:0/2319164852 learned_addr learned my addr 172.21.15.59:0/2319164852 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2a360640 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc29b5f640 1 -- 172.21.15.59:0/2319164852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 msgr2=0x5572a02b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02b79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc29b5f640 1 -- 172.21.15.59:0/2319164852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 msgr2=0x5572a02b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02b6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc29b5f640 1 -- 172.21.15.59:0/2319164852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729ff22210 con 0x5572a02ab2f0 2024-09-10T11:08:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b7490 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdc140cc6d0 tx=0x7fdc14016500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b83ce2a26d3062 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.366+0000 7fdc0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc0dffb640 1 -- 172.21.15.59:0/2319164852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14020070 con 0x5572a02ab2f0 2024-09-10T11:08:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc0dffb640 1 -- 172.21.15.59:0/2319164852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fdc14018d60 con 0x5572a02ab2f0 2024-09-10T11:08:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2f441740 1 -- 172.21.15.59:0/2319164852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc20005020 con 0x5572a02ab2f0 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc0dffb640 1 -- 172.21.15.59:0/2319164852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdc1409baf0 con 0x5572a02ab2f0 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2f441740 10 client.15783 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2f441740 1 -- 172.21.15.59:0/2319164852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55729ffee620 con 0x5572a02ab2f0 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc0dffb640 1 -- 172.21.15.59:0/2319164852 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc20005020 con 0x5572a02ab2f0 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc0dffb640 1 -- 172.21.15.59:0/2319164852 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdc140cc8a0 con 0x5572a02ab2f0 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2f441740 10 client.15783 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2f441740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2f441740 20 client.15783 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2f441740 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5572a02ca030 0x5572a02cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2f441740 4 client.15783 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2f441740 1 -- 172.21.15.59:0/2319164852 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572a021ca20 con 0x5572a02ca030 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.367+0000 7fdc2a360640 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5572a02ca030 0x5572a02cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.368+0000 7fdc2a360640 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5572a02ca030 0x5572a02cc420 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcdff8a2b4fc170c server_cookie=6ce37147dcbb20f in_seq=0 out_seq=0 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.368+0000 7fdc0dffb640 10 client.15783 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.368+0000 7fdc0dffb640 1 -- 172.21.15.59:0/2319164852 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572a021ca20 con 0x5572a02ca030 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc0dffb640 10 client.15783 handle_command_reply: tid=0 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 client.15783 shutdown 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 -- 172.21.15.59:0/2319164852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 msgr2=0x5572a02b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b7490 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdc140cc6d0 tx=0x7fdc14016500 comp rx=0 tx=0).stop 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 -- 172.21.15.59:0/2319164852 shutdown_connections 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5572a02ca030 0x5572a02cc420 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02b7490 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc0dffb640 0 client.15783 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 --2- 172.21.15.59:0/2319164852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 -- 172.21.15.59:0/2319164852 >> 172.21.15.59:0/2319164852 conn(0x5572a02a7060 msgr2=0x5572a02acd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 -- 172.21.15.59:0/2319164852 shutdown_connections 2024-09-10T11:08:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 1 -- 172.21.15.59:0/2319164852 wait complete. 2024-09-10T11:08:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.369+0000 7fdc2f441740 20 client.15783 trim_cache size 0 max 16384 2024-09-10T11:08:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2f441740 1 Processor -- start 2024-09-10T11:08:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2f441740 1 -- start start 2024-09-10T11:08:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02c6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02d21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2f441740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdc241adf80 con 0x5572a02ab2f0 2024-09-10T11:08:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2f441740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc241ab850 con 0x5572a02aa9d0 2024-09-10T11:08:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2f441740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc241a96a0 con 0x5572a02ba0c0 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc29b5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc29b5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02d1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39938/0 (socket says 172.21.15.59:39938) 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc29b5f640 1 -- 172.21.15.59:0/3667141667 learned_addr learned my addr 172.21.15.59:0/3667141667 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2a360640 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02d21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc29b5f640 1 -- 172.21.15.59:0/3667141667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 msgr2=0x5572a02d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02d21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc29b5f640 1 -- 172.21.15.59:0/3667141667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 msgr2=0x5572a02c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc29b5f640 1 -- 172.21.15.59:0/3667141667 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572a02b5ee0 con 0x5572a02ab2f0 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.384+0000 7fdc2a360640 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02d1cb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdc1409b0f0 tx=0x7fdc14009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ea5f8cb2a6d3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc0ffff640 1 -- 172.21.15.59:0/3667141667 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14020070 con 0x5572a02ab2f0 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc0ffff640 1 -- 172.21.15.59:0/3667141667 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc1409b3f0 con 0x5572a02ab2f0 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc0ffff640 1 -- 172.21.15.59:0/3667141667 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14016170 con 0x5572a02ab2f0 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc2f441740 1 -- 172.21.15.59:0/3667141667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 msgr2=0x5572a02d1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc2f441740 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02d1cb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdc1409b0f0 tx=0x7fdc14009c30 comp rx=0 tx=0).stop 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc2f441740 1 -- 172.21.15.59:0/3667141667 shutdown_connections 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc2f441740 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02d21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc2f441740 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02d1cb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc2f441740 1 --2- 172.21.15.59:0/3667141667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc2f441740 1 -- 172.21.15.59:0/3667141667 >> 172.21.15.59:0/3667141667 conn(0x5572a02a7060 msgr2=0x5572a02b8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc2f441740 1 -- 172.21.15.59:0/3667141667 shutdown_connections 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.385+0000 7fdc2f441740 1 -- 172.21.15.59:0/3667141667 wait complete. 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2f441740 1 -- start start 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2f441740 1 Processor -- start 2024-09-10T11:08:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02c2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2f441740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2f441740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdc241a9d10 con 0x5572a02ab2f0 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2f441740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc241ab180 con 0x5572a02aa9d0 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2f441740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc241aa3e0 con 0x5572a02ba0c0 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2f441740 10 client.0 _ll_register_callbacks cb 0x7fdc14097760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc29b5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc29b5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02c2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39952/0 (socket says 172.21.15.59:39952) 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc29b5f640 1 -- 172.21.15.59:0/1109621346 learned_addr learned my addr 172.21.15.59:0/1109621346 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2a360640 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc29b5f640 1 -- 172.21.15.59:0/1109621346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 msgr2=0x5572a02bd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02bd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc29b5f640 1 -- 172.21.15.59:0/1109621346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 msgr2=0x5572a02c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc29b5f640 1 -- 172.21.15.59:0/1109621346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572a02c2ce0 con 0x5572a02ab2f0 2024-09-10T11:08:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.386+0000 7fdc2ab61640 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:08:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc29b5f640 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02c2620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdc140996a0 tx=0x7fdc1409b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661574b97cf05b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:00.392 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:00 smithi059 ceph-mon[30978]: pgmap v202: 97 pgs: 97 active+clean; 2.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc0dffb640 1 -- 172.21.15.59:0/1109621346 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14014030 con 0x5572a02ab2f0 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc0dffb640 1 -- 172.21.15.59:0/1109621346 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8556+0+0 (secure 0 0 0) 0x7fdc140a3bd0 con 0x5572a02ab2f0 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc2f441740 1 -- 172.21.15.59:0/1109621346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc1409b3f0 con 0x5572a02ab2f0 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc0dffb640 1 -- 172.21.15.59:0/1109621346 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdc14020050 con 0x5572a02ab2f0 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc2f441740 10 client.15789 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc2f441740 1 -- 172.21.15.59:0/1109621346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5572a0335280 con 0x5572a02ab2f0 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc0dffb640 1 -- 172.21.15.59:0/1109621346 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc1409b3f0 con 0x5572a02ab2f0 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc0dffb640 1 -- 172.21.15.59:0/1109621346 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdc1409a3d0 con 0x5572a02ab2f0 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc2f441740 10 client.15789 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc2f441740 10 client.15789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc2f441740 20 client.15789 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5572a0335700 0x5572a0337af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc2f441740 4 client.15789 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:08:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.387+0000 7fdc2f441740 1 -- 172.21.15.59:0/1109621346 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572a0216d70 con 0x5572a0335700 2024-09-10T11:08:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.388+0000 7fdc2a360640 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5572a0335700 0x5572a0337af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.388+0000 7fdc2a360640 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5572a0335700 0x5572a0337af0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c301fb49e22c9843 server_cookie=324715f1e8c7e4d3 in_seq=0 out_seq=0 2024-09-10T11:08:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.388+0000 7fdc0dffb640 10 client.15789 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc0dffb640 1 -- 172.21.15.59:0/1109621346 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572a0216d70 con 0x5572a0335700 2024-09-10T11:08:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc0dffb640 10 client.15789 handle_command_reply: tid=0 2024-09-10T11:08:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 client.15789 shutdown 2024-09-10T11:08:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 -- 172.21.15.59:0/1109621346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 msgr2=0x5572a02c2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02c2620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdc140996a0 tx=0x7fdc1409b2e0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 -- 172.21.15.59:0/1109621346 shutdown_connections 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5572a0335700 0x5572a0337af0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572a02ba0c0 0x5572a02bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc0dffb640 0 client.15789 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572a02ab2f0 0x5572a02c2620 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 --2- 172.21.15.59:0/1109621346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5572a02aa9d0 0x5572a02c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 -- 172.21.15.59:0/1109621346 >> 172.21.15.59:0/1109621346 conn(0x5572a02a7060 msgr2=0x5572a02a59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 -- 172.21.15.59:0/1109621346 shutdown_connections 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 1 -- 172.21.15.59:0/1109621346 wait complete. 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.403+0000 7fdc2f441740 20 client.15789 trim_cache size 0 max 16384 2024-09-10T11:08:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:08:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:08:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:08:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:08:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc100a2da0 msgr2=0x7fdc100a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc100a2da0 0x7fdc100a5260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c008fd0 tx=0x7fdc1c004ab0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24101390 msgr2=0x7fdc24198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24101390 0x7fdc24198920 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400d770 tx=0x7fdc1400dc30 comp rx=0 tx=0).stop 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/3683547614 shutdown_connections 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc24106a00 0x7fdc2419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc24101390 0x7fdc24198920 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc100a2da0 0x7fdc100a5260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 --2- 172.21.15.59:0/3683547614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc241009f0 0x7fdc241983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/3683547614 >> 172.21.15.59:0/3683547614 conn(0x7fdc240fc6b0 msgr2=0x7fdc2406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/3683547614 shutdown_connections 2024-09-10T11:08:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:00.404+0000 7fdc2c5c4640 1 -- 172.21.15.59:0/3683547614 wait complete. 2024-09-10T11:08:00.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:00 smithi181 ceph-mon[35409]: pgmap v202: 97 pgs: 97 active+clean; 2.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-09-10T11:08:00.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:00 smithi115 ceph-mon[34719]: pgmap v202: 97 pgs: 97 active+clean; 2.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-09-10T11:08:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:02 smithi059 ceph-mon[30978]: pgmap v203: 97 pgs: 97 active+clean; 2.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:08:02.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:02 smithi181 ceph-mon[35409]: pgmap v203: 97 pgs: 97 active+clean; 2.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:08:02.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:02 smithi115 ceph-mon[34719]: pgmap v203: 97 pgs: 97 active+clean; 2.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:08:04.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:04 smithi059 ceph-mon[30978]: pgmap v204: 97 pgs: 97 active+clean; 2.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:08:04.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:04 smithi181 ceph-mon[35409]: pgmap v204: 97 pgs: 97 active+clean; 2.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:08:04.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:04 smithi115 ceph-mon[34719]: pgmap v204: 97 pgs: 97 active+clean; 2.8 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-10T11:08:06.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:06 smithi059 ceph-mon[30978]: pgmap v205: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 103 KiB/s wr, 34 op/s 2024-09-10T11:08:06.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:06 smithi181 ceph-mon[35409]: pgmap v205: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 103 KiB/s wr, 34 op/s 2024-09-10T11:08:06.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:06 smithi115 ceph-mon[34719]: pgmap v205: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 103 KiB/s wr, 34 op/s 2024-09-10T11:08:07.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:07 smithi059 ceph-mon[30978]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T11:08:07.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:07 smithi181 ceph-mon[35409]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T11:08:07.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:07 smithi115 ceph-mon[34719]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T11:08:08.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:08 smithi059 ceph-mon[30978]: pgmap v207: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 104 KiB/s wr, 35 op/s 2024-09-10T11:08:08.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:08 smithi181 ceph-mon[35409]: pgmap v207: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 104 KiB/s wr, 35 op/s 2024-09-10T11:08:08.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:08 smithi115 ceph-mon[34719]: pgmap v207: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 104 KiB/s wr, 35 op/s 2024-09-10T11:08:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:10 smithi059 ceph-mon[30978]: pgmap v208: 97 pgs: 97 active+clean; 3.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 106 KiB/s wr, 35 op/s 2024-09-10T11:08:10.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:10 smithi181 ceph-mon[35409]: pgmap v208: 97 pgs: 97 active+clean; 3.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 106 KiB/s wr, 35 op/s 2024-09-10T11:08:10.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:10 smithi115 ceph-mon[34719]: pgmap v208: 97 pgs: 97 active+clean; 3.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 106 KiB/s wr, 35 op/s 2024-09-10T11:08:12.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:12 smithi059 ceph-mon[30978]: pgmap v209: 97 pgs: 97 active+clean; 3.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 106 KiB/s wr, 35 op/s 2024-09-10T11:08:12.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:12 smithi181 ceph-mon[35409]: pgmap v209: 97 pgs: 97 active+clean; 3.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 106 KiB/s wr, 35 op/s 2024-09-10T11:08:12.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:12 smithi115 ceph-mon[34719]: pgmap v209: 97 pgs: 97 active+clean; 3.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 106 KiB/s wr, 35 op/s 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.504+0000 7f8305398640 1 -- 172.21.15.59:0/2727098931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83001009f0 msgr2=0x7f8300100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.504+0000 7f8305398640 1 --2- 172.21.15.59:0/2727098931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83001009f0 0x7f8300100e50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009930 tx=0x7f82f402a420 comp rx=0 tx=0).stop 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.504+0000 7f8305398640 1 -- 172.21.15.59:0/2727098931 shutdown_connections 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.504+0000 7f8305398640 1 --2- 172.21.15.59:0/2727098931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8300101390 0x7f830010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.504+0000 7f8305398640 1 --2- 172.21.15.59:0/2727098931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83001009f0 0x7f8300100e50 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.504+0000 7f8305398640 1 --2- 172.21.15.59:0/2727098931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8300106a00 0x7f8300106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.504+0000 7f8305398640 1 -- 172.21.15.59:0/2727098931 >> 172.21.15.59:0/2727098931 conn(0x7f83000fc6b0 msgr2=0x7f83000fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.504+0000 7f8305398640 1 -- 172.21.15.59:0/2727098931 shutdown_connections 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.504+0000 7f8305398640 1 -- 172.21.15.59:0/2727098931 wait complete. 2024-09-10T11:08:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.505+0000 7f8305398640 1 Processor -- start 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.505+0000 7f8305398640 1 -- start start 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.505+0000 7f8305398640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83001009f0 0x7f83001972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.505+0000 7f8305398640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300101390 0x7f8300197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.505+0000 7f8305398640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8300106a00 0x7f830019bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.505+0000 7f8305398640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8300110e40 con 0x7f8300101390 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.505+0000 7f8305398640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8300110cc0 con 0x7f8300106a00 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.505+0000 7f8305398640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8300110fc0 con 0x7f83001009f0 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82fe7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300101390 0x7f8300197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82fe7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300101390 0x7f8300197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42330/0 (socket says 172.21.15.59:42330) 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82feffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83001009f0 0x7f83001972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82fe7fc640 1 -- 172.21.15.59:0/1894840264 learned_addr learned my addr 172.21.15.59:0/1894840264 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8300106a00 0x7f830019bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82fe7fc640 1 -- 172.21.15.59:0/1894840264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83001009f0 msgr2=0x7f83001972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83001009f0 0x7f83001972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82fe7fc640 1 -- 172.21.15.59:0/1894840264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8300106a00 msgr2=0x7f830019bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8300106a00 0x7f830019bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82fe7fc640 1 -- 172.21.15.59:0/1894840264 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830019c2c0 con 0x7f8300101390 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8300106a00 0x7f830019bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300101390 0x7f8300197810 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009230 tx=0x7f82f4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82e7fff640 1 -- 172.21.15.59:0/1894840264 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f403f030 con 0x7f8300101390 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f8305398640 1 -- 172.21.15.59:0/1894840264 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830019c550 con 0x7f8300101390 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82e7fff640 1 -- 172.21.15.59:0/1894840264 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82f4004440 con 0x7f8300101390 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f82e7fff640 1 -- 172.21.15.59:0/1894840264 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4035070 con 0x7f8300101390 2024-09-10T11:08:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.506+0000 7f8305398640 1 -- 172.21.15.59:0/1894840264 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83001a3e40 con 0x7f8300101390 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.509+0000 7f82e7fff640 1 -- 172.21.15.59:0/1894840264 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f82f4042030 con 0x7f8300101390 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.509+0000 7f830820f740 1 Processor -- start 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.509+0000 7f830820f740 1 -- start start 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.509+0000 7f830820f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c065d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.509+0000 7f830820f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c074d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f830820f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 0x56533c0776a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f830820f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56533bfca2f0 con 0x56533c0662d0 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f830820f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56533bf72270 con 0x56533c0752b0 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f830820f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56533bfc62b0 con 0x56533c0659b0 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82e7fff640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f82e80a2da0 0x7f82e80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82feffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c074d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82feffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c074d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42332/0 (socket says 172.21.15.59:42332) 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82feffd640 1 -- 172.21.15.59:0/2516098962 learned_addr learned my addr 172.21.15.59:0/2516098962 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/2516098962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 0x56533c0776a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/2516098962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c065d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f82e80a2da0 0x7f82e80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82feffd640 1 -- 172.21.15.59:0/2516098962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 msgr2=0x56533c065d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82feffd640 1 --2- 172.21.15.59:0/2516098962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c065d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82feffd640 1 -- 172.21.15.59:0/2516098962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 msgr2=0x56533c0776a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82feffd640 1 --2- 172.21.15.59:0/2516098962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 0x56533c0776a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82e7fff640 1 -- 172.21.15.59:0/1894840264 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8644+0+0 (secure 0 0 0) 0x7f82f40ef800 con 0x7f8300101390 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82feffd640 1 -- 172.21.15.59:0/2516098962 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56533bf71340 con 0x56533c0662d0 2024-09-10T11:08:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82feffd640 1 --2- 172.21.15.59:0/2516098962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c074d70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009c70 tx=0x7f82f0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3331e2f7d3913b80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f82e80a2da0 0x7f82e80a5260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82f80099e0 tx=0x7f82f8009500 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.510+0000 7f82e57fa640 1 -- 172.21.15.59:0/2516098962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0004230 con 0x56533c0662d0 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f82e57fa640 1 -- 172.21.15.59:0/2516098962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82f00043d0 con 0x56533c0662d0 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f82e57fa640 1 -- 172.21.15.59:0/2516098962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f00197c0 con 0x56533c0662d0 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f830820f740 1 -- 172.21.15.59:0/2516098962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 msgr2=0x56533c074d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f830820f740 1 --2- 172.21.15.59:0/2516098962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c074d70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009c70 tx=0x7f82f0011810 comp rx=0 tx=0).stop 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f830820f740 1 -- 172.21.15.59:0/2516098962 shutdown_connections 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f830820f740 1 --2- 172.21.15.59:0/2516098962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 0x56533c0776a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f830820f740 1 --2- 172.21.15.59:0/2516098962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c074d70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f830820f740 1 --2- 172.21.15.59:0/2516098962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c065d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f830820f740 1 -- 172.21.15.59:0/2516098962 >> 172.21.15.59:0/2516098962 conn(0x56533c062060 msgr2=0x56533c062440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f830820f740 1 -- 172.21.15.59:0/2516098962 shutdown_connections 2024-09-10T11:08:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.511+0000 7f830820f740 1 -- 172.21.15.59:0/2516098962 wait complete. 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f830820f740 1 -- start start 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f830820f740 1 Processor -- start 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f830820f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f830820f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 0x56533c072610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f830820f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0752b0 0x56533c072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f830820f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56533c077d00 con 0x56533c0752b0 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f830820f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56533bf53290 con 0x56533c0662d0 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f830820f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56533c077e80 con 0x56533c0659b0 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f830820f740 10 client.0 _ll_register_callbacks cb 0x56533bf84140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f82ff7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0752b0 0x56533c072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f82feffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f82ff7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0752b0 0x56533c072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42336/0 (socket says 172.21.15.59:42336) 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f82ff7fe640 1 -- 172.21.15.59:0/741715131 learned_addr learned my addr 172.21.15.59:0/741715131 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.512+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 0x56533c072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82ff7fe640 1 -- 172.21.15.59:0/741715131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 msgr2=0x56533c0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82ff7fe640 1 -- 172.21.15.59:0/741715131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 msgr2=0x56533c072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 0x56533c072610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82ff7fe640 1 -- 172.21.15.59:0/741715131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56533bcdd210 con 0x56533c0752b0 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82feffd640 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0752b0 0x56533c072b50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f82f8003ed0 tx=0x7f82f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a0ced9ac587fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82e2ff5640 1 -- 172.21.15.59:0/741715131 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f801f690 con 0x56533c0752b0 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82e2ff5640 1 -- 172.21.15.59:0/741715131 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8644+0+0 (secure 0 0 0) 0x7f82f801f830 con 0x56533c0752b0 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f830820f740 1 -- 172.21.15.59:0/741715131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82f00043d0 con 0x56533c0752b0 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82e2ff5640 1 -- 172.21.15.59:0/741715131 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f82f801fa30 con 0x56533c0752b0 2024-09-10T11:08:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f830820f740 10 client.15801 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f830820f740 1 -- 172.21.15.59:0/741715131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56533bda9620 con 0x56533c0752b0 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.513+0000 7f82e2ff5640 1 -- 172.21.15.59:0/741715131 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82f00043d0 con 0x56533c0752b0 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.514+0000 7f82e2ff5640 1 -- 172.21.15.59:0/741715131 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f82f8028020 con 0x56533c0752b0 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.514+0000 7f830820f740 10 client.15801 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.514+0000 7f830820f740 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.514+0000 7f830820f740 20 client.15801 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.514+0000 7f830820f740 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56533c084fc0 0x56533c0873b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.514+0000 7f830820f740 4 client.15801 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.514+0000 7f830820f740 1 -- 172.21.15.59:0/741715131 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56533bfd7a20 con 0x56533c084fc0 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.514+0000 7f82feffd640 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56533c084fc0 0x56533c0873b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f82feffd640 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56533c084fc0 0x56533c0873b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=534d04037d524f8e server_cookie=fc43d2ea208ccc2f in_seq=0 out_seq=0 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f82e2ff5640 10 client.15801 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f82e2ff5640 1 -- 172.21.15.59:0/741715131 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56533bfd7a20 con 0x56533c084fc0 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f82e2ff5640 10 client.15801 handle_command_reply: tid=0 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f830820f740 1 client.15801 shutdown 2024-09-10T11:08:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f830820f740 1 -- 172.21.15.59:0/741715131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0752b0 msgr2=0x56533c072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f830820f740 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0752b0 0x56533c072b50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f82f8003ed0 tx=0x7f82f8004a40 comp rx=0 tx=0).stop 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f830820f740 1 -- 172.21.15.59:0/741715131 shutdown_connections 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f830820f740 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56533c084fc0 0x56533c0873b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f830820f740 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0752b0 0x56533c072b50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f830820f740 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 0x56533c072610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f830820f740 1 --2- 172.21.15.59:0/741715131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f82e2ff5640 0 client.15801 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.515+0000 7f830820f740 1 -- 172.21.15.59:0/741715131 >> 172.21.15.59:0/741715131 conn(0x56533c062060 msgr2=0x56533c0611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.516+0000 7f830820f740 1 -- 172.21.15.59:0/741715131 shutdown_connections 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.516+0000 7f830820f740 1 -- 172.21.15.59:0/741715131 wait complete. 2024-09-10T11:08:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.516+0000 7f830820f740 20 client.15801 trim_cache size 0 max 16384 2024-09-10T11:08:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f830820f740 1 Processor -- start 2024-09-10T11:08:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f830820f740 1 -- start start 2024-09-10T11:08:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f830820f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c08ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f830820f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c08d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f830820f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 0x56533c069580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f830820f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f83001ae0d0 con 0x56533c0662d0 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f830820f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f83001ab9a0 con 0x56533c0752b0 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f830820f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f83001a9810 con 0x56533c0659b0 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f82fe7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c08d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f82fe7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c08d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42340/0 (socket says 172.21.15.59:42340) 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.530+0000 7f82fe7fc640 1 -- 172.21.15.59:0/5485426 learned_addr learned my addr 172.21.15.59:0/5485426 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82feffd640 1 --2- 172.21.15.59:0/5485426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c08ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/5485426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 0x56533c069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82fe7fc640 1 -- 172.21.15.59:0/5485426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 msgr2=0x56533c08ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/5485426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c08ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82fe7fc640 1 -- 172.21.15.59:0/5485426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 msgr2=0x56533c069580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/5485426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 0x56533c069580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82fe7fc640 1 -- 172.21.15.59:0/5485426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56533c087a30 con 0x56533c0662d0 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/5485426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c08d200 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f82f40b86c0 tx=0x7f82f4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5dbbb39e2779f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82e4ff9640 1 -- 172.21.15.59:0/5485426 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4049040 con 0x56533c0662d0 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82e4ff9640 1 -- 172.21.15.59:0/5485426 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82f40bbcf0 con 0x56533c0662d0 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.531+0000 7f82e4ff9640 1 -- 172.21.15.59:0/5485426 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4031bd0 con 0x56533c0662d0 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 -- 172.21.15.59:0/5485426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 msgr2=0x56533c08d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 --2- 172.21.15.59:0/5485426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c08d200 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f82f40b86c0 tx=0x7f82f4009260 comp rx=0 tx=0).stop 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 -- 172.21.15.59:0/5485426 shutdown_connections 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 --2- 172.21.15.59:0/5485426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0752b0 0x56533c069580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 --2- 172.21.15.59:0/5485426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0662d0 0x56533c08d200 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 --2- 172.21.15.59:0/5485426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0659b0 0x56533c08ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 -- 172.21.15.59:0/5485426 >> 172.21.15.59:0/5485426 conn(0x56533c062060 msgr2=0x56533c0709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 -- 172.21.15.59:0/5485426 shutdown_connections 2024-09-10T11:08:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 -- 172.21.15.59:0/5485426 wait complete. 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 -- start start 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 Processor -- start 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0659b0 0x56533c08c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 0x56533c08cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0752b0 0x56533c08d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f83001a9e60 con 0x56533c0659b0 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f83001ab2d0 con 0x56533c0662d0 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f83001aa530 con 0x56533c0752b0 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f830820f740 10 client.0 _ll_register_callbacks cb 0x7f82f8003d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f82feffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0659b0 0x56533c08c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f82feffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0659b0 0x56533c08c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42356/0 (socket says 172.21.15.59:42356) 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.532+0000 7f82feffd640 1 -- 172.21.15.59:0/2699897682 learned_addr learned my addr 172.21.15.59:0/2699897682 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 0x56533c08cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82ff7fe640 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0752b0 0x56533c08d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82feffd640 1 -- 172.21.15.59:0/2699897682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0752b0 msgr2=0x56533c08d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82feffd640 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0752b0 0x56533c08d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82feffd640 1 -- 172.21.15.59:0/2699897682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 msgr2=0x56533c08cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82feffd640 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 0x56533c08cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82feffd640 1 -- 172.21.15.59:0/2699897682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56533c0eec90 con 0x56533c0659b0 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82feffd640 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0659b0 0x56533c08c840 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f82f0011d10 tx=0x7f82f0005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df62229bca1cef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82e2ff5640 1 -- 172.21.15.59:0/2699897682 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0005330 con 0x56533c0659b0 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82e2ff5640 1 -- 172.21.15.59:0/2699897682 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8644+0+0 (secure 0 0 0) 0x7f82f00054d0 con 0x56533c0659b0 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f830820f740 1 -- 172.21.15.59:0/2699897682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82f40bbcf0 con 0x56533c0659b0 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82e2ff5640 1 -- 172.21.15.59:0/2699897682 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f82f00035f0 con 0x56533c0659b0 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f830820f740 10 client.15807 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f830820f740 1 -- 172.21.15.59:0/2699897682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56533c0eff30 con 0x56533c0659b0 2024-09-10T11:08:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.533+0000 7f82e2ff5640 1 -- 172.21.15.59:0/2699897682 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82f40bbcf0 con 0x56533c0659b0 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f82e2ff5640 1 -- 172.21.15.59:0/2699897682 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f82f0018070 con 0x56533c0659b0 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f830820f740 10 client.15807 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f830820f740 10 client.15807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f830820f740 20 client.15807 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f830820f740 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56533c0f04c0 0x56533c0f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f830820f740 4 client.15807 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f830820f740 1 -- 172.21.15.59:0/2699897682 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56533bfd1d70 con 0x56533c0f04c0 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56533c0f04c0 0x56533c0f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f82e2ff5640 10 client.15807 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.534+0000 7f82fe7fc640 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56533c0f04c0 0x56533c0f28b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2f6a923d3ddc9b4 server_cookie=6f63e940533f28a6 in_seq=0 out_seq=0 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.548+0000 7f82e2ff5640 1 -- 172.21.15.59:0/2699897682 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56533bfd1d70 con 0x56533c0f04c0 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.548+0000 7f82e2ff5640 10 client.15807 handle_command_reply: tid=0 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.548+0000 7f830820f740 1 client.15807 shutdown 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 -- 172.21.15.59:0/2699897682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0659b0 msgr2=0x56533c08c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0659b0 0x56533c08c840 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f82f0011d10 tx=0x7f82f0005f10 comp rx=0 tx=0).stop 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 -- 172.21.15.59:0/2699897682 shutdown_connections 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56533c0f04c0 0x56533c0f28b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56533c0752b0 0x56533c08d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56533c0662d0 0x56533c08cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f82e2ff5640 0 client.15807 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 --2- 172.21.15.59:0/2699897682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56533c0659b0 0x56533c08c840 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 -- 172.21.15.59:0/2699897682 >> 172.21.15.59:0/2699897682 conn(0x56533c062060 msgr2=0x56533c069580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:13.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 -- 172.21.15.59:0/2699897682 shutdown_connections 2024-09-10T11:08:13.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 1 -- 172.21.15.59:0/2699897682 wait complete. 2024-09-10T11:08:13.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f830820f740 20 client.15807 trim_cache size 0 max 16384 2024-09-10T11:08:13.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:08:13.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:08:13.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:08:13.551 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:08:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f8305398640 1 -- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f82e80a2da0 msgr2=0x7f82e80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f8305398640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f82e80a2da0 0x7f82e80a5260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82f80099e0 tx=0x7f82f8009500 comp rx=0 tx=0).stop 2024-09-10T11:08:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f8305398640 1 -- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300101390 msgr2=0x7f8300197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.549+0000 7f8305398640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300101390 0x7f8300197810 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009230 tx=0x7f82f4004040 comp rx=0 tx=0).stop 2024-09-10T11:08:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.550+0000 7f8305398640 1 -- 172.21.15.59:0/1894840264 shutdown_connections 2024-09-10T11:08:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.550+0000 7f8305398640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8300106a00 0x7f830019bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.550+0000 7f8305398640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300101390 0x7f8300197810 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.550+0000 7f8305398640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f82e80a2da0 0x7f82e80a5260 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.550+0000 7f8305398640 1 --2- 172.21.15.59:0/1894840264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83001009f0 0x7f83001972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:13.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.550+0000 7f8305398640 1 -- 172.21.15.59:0/1894840264 >> 172.21.15.59:0/1894840264 conn(0x7f83000fc6b0 msgr2=0x7f83000fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:13.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.550+0000 7f8305398640 1 -- 172.21.15.59:0/1894840264 shutdown_connections 2024-09-10T11:08:13.553 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:13.550+0000 7f8305398640 1 -- 172.21.15.59:0/1894840264 wait complete. 2024-09-10T11:08:14.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:14 smithi059 ceph-mon[30978]: pgmap v210: 97 pgs: 97 active+clean; 3.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 106 KiB/s wr, 35 op/s 2024-09-10T11:08:14.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:14 smithi059 ceph-mon[30978]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T11:08:14.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:14 smithi181 ceph-mon[35409]: pgmap v210: 97 pgs: 97 active+clean; 3.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 106 KiB/s wr, 35 op/s 2024-09-10T11:08:14.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:14 smithi181 ceph-mon[35409]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T11:08:14.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:14 smithi115 ceph-mon[34719]: pgmap v210: 97 pgs: 97 active+clean; 3.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 106 KiB/s wr, 35 op/s 2024-09-10T11:08:14.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:14 smithi115 ceph-mon[34719]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T11:08:16.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:16 smithi059 ceph-mon[30978]: pgmap v212: 97 pgs: 97 active+clean; 3.5 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-09-10T11:08:16.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:16 smithi181 ceph-mon[35409]: pgmap v212: 97 pgs: 97 active+clean; 3.5 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-09-10T11:08:16.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:16 smithi115 ceph-mon[34719]: pgmap v212: 97 pgs: 97 active+clean; 3.5 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-09-10T11:08:18.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:18 smithi059 ceph-mon[30978]: pgmap v213: 97 pgs: 97 active+clean; 3.5 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-09-10T11:08:18.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:18 smithi181 ceph-mon[35409]: pgmap v213: 97 pgs: 97 active+clean; 3.5 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-09-10T11:08:18.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:18 smithi115 ceph-mon[34719]: pgmap v213: 97 pgs: 97 active+clean; 3.5 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-09-10T11:08:20.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:20 smithi059 ceph-mon[30978]: pgmap v214: 97 pgs: 97 active+clean; 3.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:08:20.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:20 smithi181 ceph-mon[35409]: pgmap v214: 97 pgs: 97 active+clean; 3.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:08:20.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:20 smithi115 ceph-mon[34719]: pgmap v214: 97 pgs: 97 active+clean; 3.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:08:22.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:22 smithi059 ceph-mon[30978]: pgmap v215: 97 pgs: 97 active+clean; 3.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:08:22.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:22 smithi181 ceph-mon[35409]: pgmap v215: 97 pgs: 97 active+clean; 3.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:08:22.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:22 smithi115 ceph-mon[34719]: pgmap v215: 97 pgs: 97 active+clean; 3.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:08:24.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:24 smithi059 ceph-mon[30978]: pgmap v216: 97 pgs: 97 active+clean; 3.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:08:24.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:24 smithi181 ceph-mon[35409]: pgmap v216: 97 pgs: 97 active+clean; 3.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:08:24.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:24 smithi115 ceph-mon[34719]: pgmap v216: 97 pgs: 97 active+clean; 3.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:08:26.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:26 smithi059 ceph-mon[30978]: pgmap v217: 97 pgs: 97 active+clean; 3.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-10T11:08:26.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:26 smithi181 ceph-mon[35409]: pgmap v217: 97 pgs: 97 active+clean; 3.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-10T11:08:26.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:26 smithi115 ceph-mon[34719]: pgmap v217: 97 pgs: 97 active+clean; 3.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-10T11:08:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 -- 172.21.15.59:0/3236657820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b8102cc0 msgr2=0x7f23b81030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 --2- 172.21.15.59:0/3236657820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b8102cc0 0x7f23b81030a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009900 tx=0x7f23a802a480 comp rx=0 tx=0).stop 2024-09-10T11:08:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 -- 172.21.15.59:0/3236657820 shutdown_connections 2024-09-10T11:08:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 --2- 172.21.15.59:0/3236657820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23b810c110 0x7f23b810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 --2- 172.21.15.59:0/3236657820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23b81035e0 0x7f23b810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 --2- 172.21.15.59:0/3236657820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b8102cc0 0x7f23b81030a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 -- 172.21.15.59:0/3236657820 >> 172.21.15.59:0/3236657820 conn(0x7f23b80fc6b0 msgr2=0x7f23b80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 -- 172.21.15.59:0/3236657820 shutdown_connections 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 -- 172.21.15.59:0/3236657820 wait complete. 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.649+0000 7f23bde27640 1 Processor -- start 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23bde27640 1 -- start start 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23bde27640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23b8102cc0 0x7f23b8100910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23bde27640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b81035e0 0x7f23b8100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23bde27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23b810c110 0x7f23b8101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23bde27640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f23b8111ef0 con 0x7f23b81035e0 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23bde27640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f23b8111d70 con 0x7f23b8102cc0 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23bde27640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f23b8112070 con 0x7f23b810c110 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b81035e0 0x7f23b8100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b81035e0 0x7f23b8100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37920/0 (socket says 172.21.15.59:37920) 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b6ffd640 1 -- 172.21.15.59:0/1871169686 learned_addr learned my addr 172.21.15.59:0/1871169686 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b77fe640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23b8102cc0 0x7f23b8100910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b7fff640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23b810c110 0x7f23b8101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b6ffd640 1 -- 172.21.15.59:0/1871169686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23b810c110 msgr2=0x7f23b8101390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23b810c110 0x7f23b8101390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b6ffd640 1 -- 172.21.15.59:0/1871169686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23b8102cc0 msgr2=0x7f23b8100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23b8102cc0 0x7f23b8100910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.650+0000 7f23b6ffd640 1 -- 172.21.15.59:0/1871169686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b81a6960 con 0x7f23b81035e0 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.651+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b81035e0 0x7f23b8100e50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00d740 tx=0x7f23ac00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.651+0000 7f23b4ff9640 1 -- 172.21.15.59:0/1871169686 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac017070 con 0x7f23b81035e0 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.651+0000 7f23b4ff9640 1 -- 172.21.15.59:0/1871169686 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23ac00de50 con 0x7f23b81035e0 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.651+0000 7f23bde27640 1 -- 172.21.15.59:0/1871169686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b81a6c50 con 0x7f23b81035e0 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.651+0000 7f23b4ff9640 1 -- 172.21.15.59:0/1871169686 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac00f620 con 0x7f23b81035e0 2024-09-10T11:08:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.651+0000 7f23bde27640 1 -- 172.21.15.59:0/1871169686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b81a71a0 con 0x7f23b81035e0 2024-09-10T11:08:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.654+0000 7f23b4ff9640 1 -- 172.21.15.59:0/1871169686 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f23ac009c30 con 0x7f23b81035e0 2024-09-10T11:08:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.654+0000 7f23c0bc5740 1 Processor -- start 2024-09-10T11:08:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.654+0000 7f23c0bc5740 1 -- start start 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.654+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 0x564fc8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.654+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 0x564fc8042770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.654+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8042cb0 0x564fc80450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.654+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564fc7f9c2f0 con 0x564fc8042cb0 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564fc7f44270 con 0x564fc8037af0 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564fc7f982b0 con 0x564fc8038410 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8042cb0 0x564fc80450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8042cb0 0x564fc80450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37934/0 (socket says 172.21.15.59:37934) 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b6ffd640 1 -- 172.21.15.59:0/3603429849 learned_addr learned my addr 172.21.15.59:0/3603429849 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b77fe640 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 0x564fc8042770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b7fff640 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 0x564fc8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b4ff9640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f23a00a2da0 0x7f23a00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b6ffd640 1 -- 172.21.15.59:0/3603429849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 msgr2=0x564fc8042770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 0x564fc8042770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b6ffd640 1 -- 172.21.15.59:0/3603429849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 msgr2=0x564fc8037ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 0x564fc8037ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b6ffd640 1 -- 172.21.15.59:0/3603429849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fc7f43340 con 0x564fc8042cb0 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b7fff640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f23a00a2da0 0x7f23a00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b77fe640 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 0x564fc8042770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b4ff9640 1 -- 172.21.15.59:0/1871169686 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7f23ac0cefb0 con 0x7f23b81035e0 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.655+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8042cb0 0x564fc80450a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0cc620 tx=0x7f23ac022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477f37cac4540ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23b7fff640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f23a00a2da0 0x7f23a00a5260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23b0005fd0 tx=0x7f23b0004ab0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f239dffb640 1 -- 172.21.15.59:0/3603429849 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac09b070 con 0x564fc8042cb0 2024-09-10T11:08:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f239dffb640 1 -- 172.21.15.59:0/3603429849 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23ac01e120 con 0x564fc8042cb0 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f239dffb640 1 -- 172.21.15.59:0/3603429849 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac09ae90 con 0x564fc8042cb0 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3603429849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8042cb0 msgr2=0x564fc80450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8042cb0 0x564fc80450a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0cc620 tx=0x7f23ac022000 comp rx=0 tx=0).stop 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3603429849 shutdown_connections 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8042cb0 0x564fc80450a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 0x564fc8042770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3603429849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 0x564fc8037ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3603429849 >> 172.21.15.59:0/3603429849 conn(0x564fc8034060 msgr2=0x564fc8034440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3603429849 shutdown_connections 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.656+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3603429849 wait complete. 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.657+0000 7f23c0bc5740 1 -- start start 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.657+0000 7f23c0bc5740 1 Processor -- start 2024-09-10T11:08:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.657+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 0x564fc803fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.657+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc8040060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.657+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8042cb0 0x564fc80405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.657+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564fc8045820 con 0x564fc8038410 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.657+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564fc7f25290 con 0x564fc8037af0 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.657+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564fc80459a0 con 0x564fc8042cb0 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.657+0000 7f23c0bc5740 10 client.0 _ll_register_callbacks cb 0x564fc7f56140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc8040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc8040060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37940/0 (socket says 172.21.15.59:37940) 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b6ffd640 1 -- 172.21.15.59:0/1657014874 learned_addr learned my addr 172.21.15.59:0/1657014874 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b77fe640 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 0x564fc803fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b7fff640 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8042cb0 0x564fc80405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b6ffd640 1 -- 172.21.15.59:0/1657014874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8042cb0 msgr2=0x564fc80405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8042cb0 0x564fc80405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b6ffd640 1 -- 172.21.15.59:0/1657014874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 msgr2=0x564fc803fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 0x564fc803fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b6ffd640 1 -- 172.21.15.59:0/1657014874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fc7caf210 con 0x564fc8038410 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b7fff640 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8042cb0 0x564fc80405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b77fe640 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 0x564fc803fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc8040060 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0cccb0 tx=0x7f23ac097140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5a651e5de29553 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f2396ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f2396ffd640 1 -- 172.21.15.59:0/1657014874 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac09ae90 con 0x564fc8038410 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f2396ffd640 1 -- 172.21.15.59:0/1657014874 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7f23ac0d2790 con 0x564fc8038410 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23c0bc5740 1 -- 172.21.15.59:0/1657014874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23ac01e120 con 0x564fc8038410 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f2396ffd640 1 -- 172.21.15.59:0/1657014874 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f23ac020020 con 0x564fc8038410 2024-09-10T11:08:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23c0bc5740 10 client.15819 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.658+0000 7f23c0bc5740 1 -- 172.21.15.59:0/1657014874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564fc7d7b620 con 0x564fc8038410 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f2396ffd640 1 -- 172.21.15.59:0/1657014874 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23ac01e120 con 0x564fc8038410 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f2396ffd640 1 -- 172.21.15.59:0/1657014874 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f23ac097ba0 con 0x564fc8038410 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f23c0bc5740 10 client.15819 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f23c0bc5740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f23c0bc5740 20 client.15819 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564fc80529b0 0x564fc8054da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f23c0bc5740 4 client.15819 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f23c0bc5740 1 -- 172.21.15.59:0/1657014874 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fc7fa9a20 con 0x564fc80529b0 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f23b77fe640 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564fc80529b0 0x564fc8054da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f2396ffd640 10 client.15819 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.659+0000 7f23b77fe640 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564fc80529b0 0x564fc8054da0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39b4101bd24bba95 server_cookie=29a6b0e256b37559 in_seq=0 out_seq=0 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f2396ffd640 1 -- 172.21.15.59:0/1657014874 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fc7fa9a20 con 0x564fc80529b0 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f2396ffd640 10 client.15819 handle_command_reply: tid=0 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f23c0bc5740 1 client.15819 shutdown 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f23c0bc5740 1 -- 172.21.15.59:0/1657014874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 msgr2=0x564fc8040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc8040060 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0cccb0 tx=0x7f23ac097140 comp rx=0 tx=0).stop 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f23c0bc5740 1 -- 172.21.15.59:0/1657014874 shutdown_connections 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564fc80529b0 0x564fc8054da0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8042cb0 0x564fc80405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc8040060 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f2396ffd640 0 client.15819 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/1657014874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8037af0 0x564fc803fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.660+0000 7f23c0bc5740 1 -- 172.21.15.59:0/1657014874 >> 172.21.15.59:0/1657014874 conn(0x564fc8034060 msgr2=0x564fc8039dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.661+0000 7f23c0bc5740 1 -- 172.21.15.59:0/1657014874 shutdown_connections 2024-09-10T11:08:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.661+0000 7f23c0bc5740 1 -- 172.21.15.59:0/1657014874 wait complete. 2024-09-10T11:08:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.661+0000 7f23c0bc5740 20 client.15819 trim_cache size 0 max 16384 2024-09-10T11:08:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.675+0000 7f23c0bc5740 1 Processor -- start 2024-09-10T11:08:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.675+0000 7f23c0bc5740 1 -- start start 2024-09-10T11:08:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8037af0 0x564fc80403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 0x564fc805a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 0x564fc805a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81b2400 con 0x564fc8037af0 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81afcd0 con 0x564fc8042cb0 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81adb40 con 0x564fc8038410 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8037af0 0x564fc80403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8037af0 0x564fc80403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37956/0 (socket says 172.21.15.59:37956) 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b77fe640 1 -- 172.21.15.59:0/2565553984 learned_addr learned my addr 172.21.15.59:0/2565553984 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b7fff640 1 --2- 172.21.15.59:0/2565553984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 0x564fc805a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b77fe640 1 -- 172.21.15.59:0/2565553984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 msgr2=0x564fc805a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b77fe640 1 --2- 172.21.15.59:0/2565553984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 0x564fc805a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b77fe640 1 -- 172.21.15.59:0/2565553984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 msgr2=0x564fc805a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b77fe640 1 --2- 172.21.15.59:0/2565553984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 0x564fc805a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b77fe640 1 -- 172.21.15.59:0/2565553984 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fc8038240 con 0x564fc8037af0 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f23b77fe640 1 --2- 172.21.15.59:0/2565553984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8037af0 0x564fc80403d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000c00 tx=0x7f23a80058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b5c3399574345c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f239d7fa640 1 -- 172.21.15.59:0/2565553984 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a804a070 con 0x564fc8037af0 2024-09-10T11:08:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f239d7fa640 1 -- 172.21.15.59:0/2565553984 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23a8005500 con 0x564fc8037af0 2024-09-10T11:08:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.676+0000 7f239d7fa640 1 -- 172.21.15.59:0/2565553984 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a8035040 con 0x564fc8037af0 2024-09-10T11:08:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 -- 172.21.15.59:0/2565553984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8037af0 msgr2=0x564fc80403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/2565553984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8037af0 0x564fc80403d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000c00 tx=0x7f23a80058d0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 -- 172.21.15.59:0/2565553984 shutdown_connections 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/2565553984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 0x564fc805a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/2565553984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8038410 0x564fc805a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/2565553984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8037af0 0x564fc80403d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 -- 172.21.15.59:0/2565553984 >> 172.21.15.59:0/2565553984 conn(0x564fc8034060 msgr2=0x564fc8041ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 -- 172.21.15.59:0/2565553984 shutdown_connections 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 -- 172.21.15.59:0/2565553984 wait complete. 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.677+0000 7f23c0bc5740 1 -- start start 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23c0bc5740 1 Processor -- start 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8037af0 0x564fc804b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc803c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23c0bc5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 0x564fc803d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81ae190 con 0x564fc8038410 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81af600 con 0x564fc8042cb0 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23c0bc5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81ae860 con 0x564fc8037af0 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23c0bc5740 10 client.0 _ll_register_callbacks cb 0x7f23b0009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc803c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc803c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37962/0 (socket says 172.21.15.59:37962) 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b6ffd640 1 -- 172.21.15.59:0/3212541128 learned_addr learned my addr 172.21.15.59:0/3212541128 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b77fe640 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8037af0 0x564fc804b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b7fff640 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 0x564fc803d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b6ffd640 1 -- 172.21.15.59:0/3212541128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8037af0 msgr2=0x564fc804b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8037af0 0x564fc804b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b6ffd640 1 -- 172.21.15.59:0/3212541128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 msgr2=0x564fc803d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 0x564fc803d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b6ffd640 1 -- 172.21.15.59:0/3212541128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fc80bc310 con 0x564fc8038410 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b7fff640 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 0x564fc803d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f23b6ffd640 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc803c9b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0975d0 tx=0x7f23ac0ccbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367210c41b8f69c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.678+0000 7f2396ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f2396ffd640 1 -- 172.21.15.59:0/3212541128 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac09b070 con 0x564fc8038410 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f2396ffd640 1 -- 172.21.15.59:0/3212541128 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7f23ac0d2790 con 0x564fc8038410 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3212541128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23a8005500 con 0x564fc8038410 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f2396ffd640 1 -- 172.21.15.59:0/3212541128 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f23ac09ae90 con 0x564fc8038410 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f23c0bc5740 10 client.15825 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3212541128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564fc80bd4c0 con 0x564fc8038410 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f2396ffd640 1 -- 172.21.15.59:0/3212541128 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23a8005500 con 0x564fc8038410 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f2396ffd640 1 -- 172.21.15.59:0/3212541128 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f23ac09a980 con 0x564fc8038410 2024-09-10T11:08:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f23c0bc5740 10 client.15825 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f23c0bc5740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f23c0bc5740 20 client.15825 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564fc80529b0 0x564fc80bfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f23c0bc5740 4 client.15825 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:08:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.679+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3212541128 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564fc7fa3d70 con 0x564fc80529b0 2024-09-10T11:08:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.680+0000 7f23b77fe640 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564fc80529b0 0x564fc80bfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.680+0000 7f23b77fe640 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564fc80529b0 0x564fc80bfa60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c294ff8bfdd9da8d server_cookie=7ee23da172f13f94 in_seq=0 out_seq=0 2024-09-10T11:08:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.680+0000 7f2396ffd640 10 client.15825 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:26.696 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f2396ffd640 1 -- 172.21.15.59:0/3212541128 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564fc7fa3d70 con 0x564fc80529b0 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f2396ffd640 10 client.15825 handle_command_reply: tid=0 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 client.15825 shutdown 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3212541128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 msgr2=0x564fc803c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc803c9b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0975d0 tx=0x7f23ac0ccbf0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3212541128 shutdown_connections 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564fc80529b0 0x564fc80bfa60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564fc8042cb0 0x564fc803d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f2396ffd640 0 client.15825 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fc8038410 0x564fc803c9b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 --2- 172.21.15.59:0/3212541128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564fc8037af0 0x564fc804b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3212541128 >> 172.21.15.59:0/3212541128 conn(0x564fc8034060 msgr2=0x564fc8039550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.694+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3212541128 shutdown_connections 2024-09-10T11:08:26.697 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23c0bc5740 1 -- 172.21.15.59:0/3212541128 wait complete. 2024-09-10T11:08:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23c0bc5740 20 client.15825 trim_cache size 0 max 16384 2024-09-10T11:08:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:08:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:08:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:08:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:08:26.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 -- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f23a00a2da0 msgr2=0x7f23a00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:26.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f23a00a2da0 0x7f23a00a5260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23b0005fd0 tx=0x7f23b0004ab0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 -- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b81035e0 msgr2=0x7f23b8100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:26.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b81035e0 0x7f23b8100e50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00d740 tx=0x7f23ac00dc00 comp rx=0 tx=0).stop 2024-09-10T11:08:26.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 -- 172.21.15.59:0/1871169686 shutdown_connections 2024-09-10T11:08:26.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f23a00a2da0 0x7f23a00a5260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23b810c110 0x7f23b8101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23b81035e0 0x7f23b8100e50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.699 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 --2- 172.21.15.59:0/1871169686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23b8102cc0 0x7f23b8100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:26.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 -- 172.21.15.59:0/1871169686 >> 172.21.15.59:0/1871169686 conn(0x7f23b80fc6b0 msgr2=0x7f23b80fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:26.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 -- 172.21.15.59:0/1871169686 shutdown_connections 2024-09-10T11:08:26.700 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:26.695+0000 7f23bde27640 1 -- 172.21.15.59:0/1871169686 wait complete. 2024-09-10T11:08:28.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:28 smithi059 ceph-mon[30978]: pgmap v218: 97 pgs: 97 active+clean; 3.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:28.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:28 smithi181 ceph-mon[35409]: pgmap v218: 97 pgs: 97 active+clean; 3.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:28 smithi115 ceph-mon[34719]: pgmap v218: 97 pgs: 97 active+clean; 3.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:30.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:30 smithi059 ceph-mon[30978]: pgmap v219: 97 pgs: 97 active+clean; 4.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-10T11:08:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:30 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:08:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:30 smithi181 ceph-mon[35409]: pgmap v219: 97 pgs: 97 active+clean; 4.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-10T11:08:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:30 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:08:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:30 smithi115 ceph-mon[34719]: pgmap v219: 97 pgs: 97 active+clean; 4.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-10T11:08:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:30 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:08:31.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:08:31.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:08:31.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:08:31.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:08:31.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:08:31.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:08:31.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:08:31.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:08:31.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:08:32.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:32 smithi059 ceph-mon[30978]: pgmap v220: 97 pgs: 97 active+clean; 4.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:32.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:32 smithi181 ceph-mon[35409]: pgmap v220: 97 pgs: 97 active+clean; 4.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:32.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:32 smithi115 ceph-mon[34719]: pgmap v220: 97 pgs: 97 active+clean; 4.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:34 smithi059 ceph-mon[30978]: pgmap v221: 97 pgs: 97 active+clean; 4.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:34.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:34 smithi181 ceph-mon[35409]: pgmap v221: 97 pgs: 97 active+clean; 4.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:34 smithi115 ceph-mon[34719]: pgmap v221: 97 pgs: 97 active+clean; 4.2 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:36.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:36 smithi059 ceph-mon[30978]: pgmap v222: 97 pgs: 97 active+clean; 4.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:08:36.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:36 smithi181 ceph-mon[35409]: pgmap v222: 97 pgs: 97 active+clean; 4.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:08:36.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:36 smithi115 ceph-mon[34719]: pgmap v222: 97 pgs: 97 active+clean; 4.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:08:38.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:38 smithi059 ceph-mon[30978]: pgmap v223: 97 pgs: 97 active+clean; 4.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:08:38.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:38 smithi181 ceph-mon[35409]: pgmap v223: 97 pgs: 97 active+clean; 4.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:08:38.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:38 smithi115 ceph-mon[34719]: pgmap v223: 97 pgs: 97 active+clean; 4.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:08:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 -- 172.21.15.59:0/3576702237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c1009f0 msgr2=0x7fe80c100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 --2- 172.21.15.59:0/3576702237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c1009f0 0x7fe80c100e50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe800009930 tx=0x7fe80002a420 comp rx=0 tx=0).stop 2024-09-10T11:08:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 -- 172.21.15.59:0/3576702237 shutdown_connections 2024-09-10T11:08:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 --2- 172.21.15.59:0/3576702237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe80c101390 0x7fe80c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 --2- 172.21.15.59:0/3576702237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c1009f0 0x7fe80c100e50 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 --2- 172.21.15.59:0/3576702237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe80c106a00 0x7fe80c106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 -- 172.21.15.59:0/3576702237 >> 172.21.15.59:0/3576702237 conn(0x7fe80c0fc6b0 msgr2=0x7fe80c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 -- 172.21.15.59:0/3576702237 shutdown_connections 2024-09-10T11:08:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 -- 172.21.15.59:0/3576702237 wait complete. 2024-09-10T11:08:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 Processor -- start 2024-09-10T11:08:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.796+0000 7fe8126af640 1 -- start start 2024-09-10T11:08:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe8126af640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe80c1009f0 0x7fe80c199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe8126af640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe80c101390 0x7fe80c199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe8126af640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c106a00 0x7fe80c1a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe8126af640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c110e90 con 0x7fe80c106a00 2024-09-10T11:08:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe8126af640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c110d10 con 0x7fe80c1009f0 2024-09-10T11:08:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe8126af640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c111010 con 0x7fe80c101390 2024-09-10T11:08:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe810c4c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c106a00 0x7fe80c1a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe810c4c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c106a00 0x7fe80c1a42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46992/0 (socket says 172.21.15.59:46992) 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe810c4c640 1 -- 172.21.15.59:0/2446496098 learned_addr learned my addr 172.21.15.59:0/2446496098 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe80bfff640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe80c1009f0 0x7fe80c199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe80c101390 0x7fe80c199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe810c4c640 1 -- 172.21.15.59:0/2446496098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe80c101390 msgr2=0x7fe80c199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe810c4c640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe80c101390 0x7fe80c199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe810c4c640 1 -- 172.21.15.59:0/2446496098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe80c1009f0 msgr2=0x7fe80c199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe810c4c640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe80c1009f0 0x7fe80c199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe810c4c640 1 -- 172.21.15.59:0/2446496098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c1a47e0 con 0x7fe80c106a00 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.797+0000 7fe80bfff640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe80c1009f0 0x7fe80c199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.798+0000 7fe810c4c640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c106a00 0x7fe80c1a42a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe80400eaa0 tx=0x7fe80400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.798+0000 7fe8097fa640 1 -- 172.21.15.59:0/2446496098 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80400cdb0 con 0x7fe80c106a00 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.798+0000 7fe8126af640 1 -- 172.21.15.59:0/2446496098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80c1a49b0 con 0x7fe80c106a00 2024-09-10T11:08:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.798+0000 7fe8097fa640 1 -- 172.21.15.59:0/2446496098 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe804005020 con 0x7fe80c106a00 2024-09-10T11:08:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.798+0000 7fe8097fa640 1 -- 172.21.15.59:0/2446496098 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040116b0 con 0x7fe80c106a00 2024-09-10T11:08:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.798+0000 7fe8126af640 1 -- 172.21.15.59:0/2446496098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80c1a4e80 con 0x7fe80c106a00 2024-09-10T11:08:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.800+0000 7fe8097fa640 1 -- 172.21.15.59:0/2446496098 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe804005560 con 0x7fe80c106a00 2024-09-10T11:08:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe815441740 1 Processor -- start 2024-09-10T11:08:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe815441740 1 -- start start 2024-09-10T11:08:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe815441740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f060f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe815441740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f0619b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe815441740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f061a0c0 0x55f5f061c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe815441740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f5f056f2f0 con 0x55f5f061a0c0 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe815441740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f5f0517270 con 0x55f5f060f820 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe815441740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f5f056b2b0 con 0x55f5f060ef00 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe80b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f061a0c0 0x55f5f061c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe80b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f061a0c0 0x55f5f061c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46996/0 (socket says 172.21.15.59:46996) 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe80b7fe640 1 -- 172.21.15.59:0/3249286545 learned_addr learned my addr 172.21.15.59:0/3249286545 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe8097fa640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe7f40a2da0 0x7fe7f40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe80bfff640 1 --2- 172.21.15.59:0/3249286545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f0619b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/3249286545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f060f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe810c4c640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe7f40a2da0 0x7fe7f40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.801+0000 7fe8097fa640 1 -- 172.21.15.59:0/2446496098 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7fe8040cf6f0 con 0x7fe80c106a00 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe80b7fe640 1 -- 172.21.15.59:0/3249286545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 msgr2=0x55f5f060f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/3249286545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f060f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe80b7fe640 1 -- 172.21.15.59:0/3249286545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 msgr2=0x55f5f0619b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/3249286545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f0619b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe80b7fe640 1 -- 172.21.15.59:0/3249286545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f0516340 con 0x55f5f061a0c0 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/3249286545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f061a0c0 0x55f5f061c4b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe80002aa10 tx=0x7fe80002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d12db3ccda55f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe810c4c640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe7f40a2da0 0x7fe7f40a5260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe804009270 tx=0x7fe804015840 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe7f27fc640 1 -- 172.21.15.59:0/3249286545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800035030 con 0x55f5f061a0c0 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe7f27fc640 1 -- 172.21.15.59:0/3249286545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8000046c0 con 0x55f5f061a0c0 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.802+0000 7fe7f27fc640 1 -- 172.21.15.59:0/3249286545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800003810 con 0x55f5f061a0c0 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 -- 172.21.15.59:0/3249286545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f061a0c0 msgr2=0x55f5f061c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 --2- 172.21.15.59:0/3249286545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f061a0c0 0x55f5f061c4b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe80002aa10 tx=0x7fe80002a420 comp rx=0 tx=0).stop 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 -- 172.21.15.59:0/3249286545 shutdown_connections 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 --2- 172.21.15.59:0/3249286545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f061a0c0 0x55f5f061c4b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 --2- 172.21.15.59:0/3249286545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f0619b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 --2- 172.21.15.59:0/3249286545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f060f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 -- 172.21.15.59:0/3249286545 >> 172.21.15.59:0/3249286545 conn(0x55f5f060b470 msgr2=0x55f5f060b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 -- 172.21.15.59:0/3249286545 shutdown_connections 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 -- 172.21.15.59:0/3249286545 wait complete. 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.803+0000 7fe815441740 1 -- start start 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe815441740 1 Processor -- start 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe815441740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f0616fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe815441740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060f820 0x55f5f0617510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe815441740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f061a0c0 0x55f5f0617a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe815441740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f5f061cc90 con 0x55f5f060f820 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe815441740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f5f04f8290 con 0x55f5f061a0c0 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe815441740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f5f061ce10 con 0x55f5f060ef00 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe815441740 10 client.0 _ll_register_callbacks cb 0x55f5f0529140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060f820 0x55f5f0617510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060f820 0x55f5f0617510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47012/0 (socket says 172.21.15.59:47012) 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80bfff640 1 -- 172.21.15.59:0/3589406108 learned_addr learned my addr 172.21.15.59:0/3589406108 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f061a0c0 0x55f5f0617a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f0616fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80bfff640 1 -- 172.21.15.59:0/3589406108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 msgr2=0x55f5f0616fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80bfff640 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f0616fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80bfff640 1 -- 172.21.15.59:0/3589406108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f061a0c0 msgr2=0x55f5f0617a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80bfff640 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f061a0c0 0x55f5f0617a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80bfff640 1 -- 172.21.15.59:0/3589406108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f0282210 con 0x55f5f060f820 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f061a0c0 0x55f5f0617a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe80bfff640 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060f820 0x55f5f0617510 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0136e0 tx=0x7fe7fc013ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5908df0146b1ebc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.804+0000 7fe7eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/3589406108 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc020060 con 0x55f5f060f820 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/3589406108 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7fe7fc011c20 con 0x55f5f060f820 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe815441740 1 -- 172.21.15.59:0/3589406108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8000046c0 con 0x55f5f060f820 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/3589406108 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7fc011e20 con 0x55f5f060f820 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe815441740 10 client.15837 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe815441740 1 -- 172.21.15.59:0/3589406108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f5f034e620 con 0x55f5f060f820 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/3589406108 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8000046c0 con 0x55f5f060f820 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/3589406108 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe7fc01a030 con 0x55f5f060f820 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe815441740 10 client.15837 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe815441740 10 client.15837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe815441740 20 client.15837 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe815441740 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5f062a0e0 0x55f5f062c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe815441740 4 client.15837 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.805+0000 7fe815441740 1 -- 172.21.15.59:0/3589406108 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5f057ca20 con 0x55f5f062a0e0 2024-09-10T11:08:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.806+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5f062a0e0 0x55f5f062c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.806+0000 7fe7eb7fe640 10 client.15837 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.806+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5f062a0e0 0x55f5f062c4d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5930a11baa81482e server_cookie=3f4c3109491ecd79 in_seq=0 out_seq=0 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/3589406108 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5f057ca20 con 0x55f5f062a0e0 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe7eb7fe640 10 client.15837 handle_command_reply: tid=0 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 client.15837 shutdown 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 -- 172.21.15.59:0/3589406108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060f820 msgr2=0x55f5f0617510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060f820 0x55f5f0617510 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0136e0 tx=0x7fe7fc013ba0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 -- 172.21.15.59:0/3589406108 shutdown_connections 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5f062a0e0 0x55f5f062c4d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f061a0c0 0x55f5f0617a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060f820 0x55f5f0617510 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 --2- 172.21.15.59:0/3589406108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f0616fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe7eb7fe640 0 client.15837 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 -- 172.21.15.59:0/3589406108 >> 172.21.15.59:0/3589406108 conn(0x55f5f060b470 msgr2=0x55f5f06061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 -- 172.21.15.59:0/3589406108 shutdown_connections 2024-09-10T11:08:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 1 -- 172.21.15.59:0/3589406108 wait complete. 2024-09-10T11:08:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.807+0000 7fe815441740 20 client.15837 trim_cache size 0 max 16384 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe815441740 1 Processor -- start 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe815441740 1 -- start start 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe815441740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060b470 0x55f5f06060b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe815441740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f0617880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe815441740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f0631d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe815441740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c1ae0a0 con 0x55f5f060b470 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe815441740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c1ab970 con 0x55f5f060f820 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe815441740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c1a97e0 con 0x55f5f060ef00 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060b470 0x55f5f06060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060b470 0x55f5f06060b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47014/0 (socket says 172.21.15.59:47014) 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80b7fe640 1 -- 172.21.15.59:0/885840641 learned_addr learned my addr 172.21.15.59:0/885840641 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80bfff640 1 --2- 172.21.15.59:0/885840641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f0617880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80b7fe640 1 -- 172.21.15.59:0/885840641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 msgr2=0x55f5f0617880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/885840641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f0617880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80b7fe640 1 -- 172.21.15.59:0/885840641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 msgr2=0x55f5f0631d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/885840641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f0631d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80b7fe640 1 -- 172.21.15.59:0/885840641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f060f650 con 0x55f5f060b470 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80bfff640 1 --2- 172.21.15.59:0/885840641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f0617880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.822+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/885840641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060b470 0x55f5f06060b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe800004500 tx=0x7fe80002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396cd566caaa22fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe7f1ffb640 1 -- 172.21.15.59:0/885840641 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800035040 con 0x55f5f060b470 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe7f1ffb640 1 -- 172.21.15.59:0/885840641 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe800031c90 con 0x55f5f060b470 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe7f1ffb640 1 -- 172.21.15.59:0/885840641 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800003ca0 con 0x55f5f060b470 2024-09-10T11:08:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe815441740 1 -- 172.21.15.59:0/885840641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060b470 msgr2=0x55f5f06060b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe815441740 1 --2- 172.21.15.59:0/885840641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060b470 0x55f5f06060b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe800004500 tx=0x7fe80002a420 comp rx=0 tx=0).stop 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe815441740 1 -- 172.21.15.59:0/885840641 shutdown_connections 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe815441740 1 --2- 172.21.15.59:0/885840641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f0631d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe815441740 1 --2- 172.21.15.59:0/885840641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060ef00 0x55f5f0617880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe815441740 1 --2- 172.21.15.59:0/885840641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060b470 0x55f5f06060b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe815441740 1 -- 172.21.15.59:0/885840641 >> 172.21.15.59:0/885840641 conn(0x55f5f0612980 msgr2=0x55f5f06059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe815441740 1 -- 172.21.15.59:0/885840641 shutdown_connections 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.823+0000 7fe815441740 1 -- 172.21.15.59:0/885840641 wait complete. 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe815441740 1 -- start start 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe815441740 1 Processor -- start 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe815441740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060b470 0x55f5f06224e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe815441740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060ef00 0x55f5f061d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe815441740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f061dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe815441740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c1a9e30 con 0x55f5f060ef00 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe815441740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c1ab2a0 con 0x55f5f060f820 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe815441740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c1aa500 con 0x55f5f060b470 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe815441740 10 client.0 _ll_register_callbacks cb 0x7fe7fc0097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe80bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060ef00 0x55f5f061d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe80bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060ef00 0x55f5f061d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47030/0 (socket says 172.21.15.59:47030) 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe80bfff640 1 -- 172.21.15.59:0/859437007 learned_addr learned my addr 172.21.15.59:0/859437007 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.824+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060b470 0x55f5f06224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f061dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe80bfff640 1 -- 172.21.15.59:0/859437007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060b470 msgr2=0x55f5f06224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe80bfff640 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060b470 0x55f5f06224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe80bfff640 1 -- 172.21.15.59:0/859437007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 msgr2=0x55f5f061dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe80bfff640 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f061dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe80bfff640 1 -- 172.21.15.59:0/859437007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f061e280 con 0x55f5f060ef00 2024-09-10T11:08:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe80bfff640 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060ef00 0x55f5f061d800 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc000c00 tx=0x7fe7fc010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2153dd888c9b8871 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe7eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/859437007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc020020 con 0x55f5f060ef00 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/859437007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7fe7fc011c20 con 0x55f5f060ef00 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe815441740 1 -- 172.21.15.59:0/859437007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe800031c90 con 0x55f5f060ef00 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/859437007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7fc009e90 con 0x55f5f060ef00 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe815441740 10 client.15843 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe815441740 1 -- 172.21.15.59:0/859437007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f5f06949d0 con 0x55f5f060ef00 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/859437007 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe800031c90 con 0x55f5f060ef00 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/859437007 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe7fc01a040 con 0x55f5f060ef00 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.825+0000 7fe815441740 10 client.15843 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.826+0000 7fe815441740 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.826+0000 7fe815441740 20 client.15843 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.826+0000 7fe815441740 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5f061a0c0 0x55f5f0697210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.826+0000 7fe815441740 4 client.15843 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:08:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.826+0000 7fe815441740 1 -- 172.21.15.59:0/859437007 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f5f0576d70 con 0x55f5f061a0c0 2024-09-10T11:08:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.826+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5f061a0c0 0x55f5f0697210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.826+0000 7fe80b7fe640 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5f061a0c0 0x55f5f0697210 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=855ecc568ff9a8da server_cookie=6de19162309cb0e in_seq=0 out_seq=0 2024-09-10T11:08:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.826+0000 7fe7eb7fe640 10 client.15843 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe7eb7fe640 1 -- 172.21.15.59:0/859437007 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f5f0576d70 con 0x55f5f061a0c0 2024-09-10T11:08:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe7eb7fe640 10 client.15843 handle_command_reply: tid=0 2024-09-10T11:08:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 client.15843 shutdown 2024-09-10T11:08:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 -- 172.21.15.59:0/859437007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060ef00 msgr2=0x55f5f061d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060ef00 0x55f5f061d800 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc000c00 tx=0x7fe7fc010f90 comp rx=0 tx=0).stop 2024-09-10T11:08:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 -- 172.21.15.59:0/859437007 shutdown_connections 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55f5f061a0c0 0x55f5f0697210 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5f060f820 0x55f5f061dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5f060ef00 0x55f5f061d800 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe7eb7fe640 0 client.15843 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 --2- 172.21.15.59:0/859437007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f5f060b470 0x55f5f06224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 -- 172.21.15.59:0/859437007 >> 172.21.15.59:0/859437007 conn(0x55f5f0612980 msgr2=0x55f5f0615450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 -- 172.21.15.59:0/859437007 shutdown_connections 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 1 -- 172.21.15.59:0/859437007 wait complete. 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.840+0000 7fe815441740 20 client.15843 trim_cache size 0 max 16384 2024-09-10T11:08:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:08:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:08:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:08:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 -- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe7f40a2da0 msgr2=0x7fe7f40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe7f40a2da0 0x7fe7f40a5260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe804009270 tx=0x7fe804015840 comp rx=0 tx=0).stop 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 -- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c106a00 msgr2=0x7fe80c1a42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c106a00 0x7fe80c1a42a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe80400eaa0 tx=0x7fe80400ef60 comp rx=0 tx=0).stop 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 -- 172.21.15.59:0/2446496098 shutdown_connections 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c106a00 0x7fe80c1a42a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe7f40a2da0 0x7fe7f40a5260 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe80c101390 0x7fe80c199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 --2- 172.21.15.59:0/2446496098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe80c1009f0 0x7fe80c199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 -- 172.21.15.59:0/2446496098 >> 172.21.15.59:0/2446496098 conn(0x7fe80c0fc6b0 msgr2=0x7fe80c0fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 -- 172.21.15.59:0/2446496098 shutdown_connections 2024-09-10T11:08:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:39.841+0000 7fe8126af640 1 -- 172.21.15.59:0/2446496098 wait complete. 2024-09-10T11:08:40.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:40 smithi059 ceph-mon[30978]: pgmap v224: 97 pgs: 97 active+clean; 4.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:08:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:40 smithi181 ceph-mon[35409]: pgmap v224: 97 pgs: 97 active+clean; 4.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:08:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:40 smithi115 ceph-mon[34719]: pgmap v224: 97 pgs: 97 active+clean; 4.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:08:42.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:42 smithi059 ceph-mon[30978]: pgmap v225: 97 pgs: 97 active+clean; 4.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:08:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:42 smithi181 ceph-mon[35409]: pgmap v225: 97 pgs: 97 active+clean; 4.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:08:42.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:42 smithi115 ceph-mon[34719]: pgmap v225: 97 pgs: 97 active+clean; 4.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:08:44.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:44 smithi059 ceph-mon[30978]: pgmap v226: 97 pgs: 97 active+clean; 4.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:08:44.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:44 smithi181 ceph-mon[35409]: pgmap v226: 97 pgs: 97 active+clean; 4.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:08:44.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:44 smithi115 ceph-mon[34719]: pgmap v226: 97 pgs: 97 active+clean; 4.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:08:46.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:46 smithi059 ceph-mon[30978]: pgmap v227: 97 pgs: 97 active+clean; 4.8 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:08:46.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:46 smithi181 ceph-mon[35409]: pgmap v227: 97 pgs: 97 active+clean; 4.8 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:08:46.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:46 smithi115 ceph-mon[34719]: pgmap v227: 97 pgs: 97 active+clean; 4.8 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:08:46.786 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.786 INFO:tasks.workunit.client.0.smithi059.stdout:313/600: open fd = 3 2024-09-10T11:08:46.786 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.786 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.786 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.786 INFO:tasks.workunit.client.0.smithi059.stdout:314/600: open fd = 3 2024-09-10T11:08:46.786 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.786 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:315/600: open fd = 3 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:316/600: open fd = 3 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:317/600: open fd = 3 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:318/600: open fd = 3 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:319/600: open fd = 3 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:320/600: open fd = 3 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.788 INFO:tasks.workunit.client.0.smithi059.stdout:321/600: open fd = 3 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:322/600: open fd = 3 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:323/600: open fd = 3 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:324/600: open fd = 3 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:325/600: open fd = 3 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:326/600: open fd = 3 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:327/600: open fd = 3 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.790 INFO:tasks.workunit.client.0.smithi059.stdout:328/600: open fd = 3 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:329/600: open fd = 3 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:330/600: open fd = 3 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:331/600: open fd = 3 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:332/600: open fd = 3 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:333/600: open fd = 3 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:334/600: open fd = 3 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:335/600: open fd = 3 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:336/600: open fd = 3 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:337/600: open fd = 3 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:338/600: open fd = 3 2024-09-10T11:08:46.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:339/600: open fd = 3 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:340/600: open fd = 3 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:341/600: open fd = 3 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.794 INFO:tasks.workunit.client.0.smithi059.stdout:342/600: open fd = 3 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:343/600: open fd = 3 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:344/600: open fd = 3 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:345/600: open fd = 3 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:346/600: open fd = 3 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:347/600: open fd = 3 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:348/600: open fd = 3 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:349/600: open fd = 3 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:350/600: open fd = 3 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:351/600: open fd = 3 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:352/600: open fd = 3 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.797 INFO:tasks.workunit.client.0.smithi059.stdout:353/600: open fd = 3 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:354/600: open fd = 3 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:355/600: open fd = 3 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:356/600: open fd = 3 2024-09-10T11:08:46.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:357/600: open fd = 3 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:358/600: open fd = 3 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:359/600: open fd = 3 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.799 INFO:tasks.workunit.client.0.smithi059.stdout:360/600: open fd = 3 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:361/600: open fd = 3 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:362/600: open fd = 3 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:363/600: open fd = 3 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:364/600: open fd = 3 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:365/600: open fd = 3 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:366/600: open fd = 3 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:367/600: open fd = 3 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:368/600: open fd = 3 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:369/600: open fd = 3 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:370/600: open fd = 3 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.802 INFO:tasks.workunit.client.0.smithi059.stdout:371/600: open fd = 3 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:372/600: open fd = 3 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:373/600: open fd = 3 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:374/600: open fd = 3 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:08:46.804 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:08:48.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:48 smithi059 ceph-mon[30978]: pgmap v228: 97 pgs: 97 active+clean; 4.8 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:48.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:48 smithi181 ceph-mon[35409]: pgmap v228: 97 pgs: 97 active+clean; 4.8 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:48.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:48 smithi115 ceph-mon[34719]: pgmap v228: 97 pgs: 97 active+clean; 4.8 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:50.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:50 smithi059 ceph-mon[30978]: pgmap v229: 97 pgs: 97 active+clean; 5.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-09-10T11:08:50.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:50 smithi181 ceph-mon[35409]: pgmap v229: 97 pgs: 97 active+clean; 5.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-09-10T11:08:50.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:50 smithi115 ceph-mon[34719]: pgmap v229: 97 pgs: 97 active+clean; 5.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-09-10T11:08:52.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:52 smithi059 ceph-mon[30978]: pgmap v230: 97 pgs: 97 active+clean; 5.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:52.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:52 smithi181 ceph-mon[35409]: pgmap v230: 97 pgs: 97 active+clean; 5.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:52.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:52 smithi115 ceph-mon[34719]: pgmap v230: 97 pgs: 97 active+clean; 5.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.941+0000 7f5c52e17640 1 -- 172.21.15.59:0/1988608602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c106220 msgr2=0x7f5c4c106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.941+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1988608602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c106220 0x7f5c4c106600 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009930 tx=0x7f5c3402a420 comp rx=0 tx=0).stop 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.941+0000 7f5c52e17640 1 -- 172.21.15.59:0/1988608602 shutdown_connections 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.941+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1988608602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c100fd0 0x7f5c4c10d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.941+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1988608602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c4c100630 0x7f5c4c100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.941+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1988608602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c106220 0x7f5c4c106600 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.941+0000 7f5c52e17640 1 -- 172.21.15.59:0/1988608602 >> 172.21.15.59:0/1988608602 conn(0x7f5c4c075ef0 msgr2=0x7f5c4c076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.941+0000 7f5c52e17640 1 -- 172.21.15.59:0/1988608602 shutdown_connections 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.941+0000 7f5c52e17640 1 -- 172.21.15.59:0/1988608602 wait complete. 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c52e17640 1 Processor -- start 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c52e17640 1 -- start start 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c52e17640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c100630 0x7f5c4c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c52e17640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c100fd0 0x7f5c4c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c52e17640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c4c106220 0x7f5c4c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c52e17640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c10fd30 con 0x7f5c4c100630 2024-09-10T11:08:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c52e17640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c10fbb0 con 0x7f5c4c100fd0 2024-09-10T11:08:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c52e17640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c10feb0 con 0x7f5c4c106220 2024-09-10T11:08:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c50bb3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c100630 0x7f5c4c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c50bb3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c100630 0x7f5c4c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38182/0 (socket says 172.21.15.59:38182) 2024-09-10T11:08:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c50bb3640 1 -- 172.21.15.59:0/1981727887 learned_addr learned my addr 172.21.15.59:0/1981727887 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c4c106220 0x7f5c4c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.942+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c100fd0 0x7f5c4c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c50bb3640 1 -- 172.21.15.59:0/1981727887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c4c106220 msgr2=0x7f5c4c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c4c106220 0x7f5c4c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c50bb3640 1 -- 172.21.15.59:0/1981727887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c100fd0 msgr2=0x7f5c4c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c100fd0 0x7f5c4c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c50bb3640 1 -- 172.21.15.59:0/1981727887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c19d3e0 con 0x7f5c4c100630 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c100fd0 0x7f5c4c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c4c106220 0x7f5c4c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c100630 0x7f5c4c1983f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009230 tx=0x7f5c34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c49ffb640 1 -- 172.21.15.59:0/1981727887 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3403f030 con 0x7f5c4c100630 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c49ffb640 1 -- 172.21.15.59:0/1981727887 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c34003ad0 con 0x7f5c4c100630 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c52e17640 1 -- 172.21.15.59:0/1981727887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c19d670 con 0x7f5c4c100630 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c49ffb640 1 -- 172.21.15.59:0/1981727887 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34035070 con 0x7f5c4c100630 2024-09-10T11:08:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.943+0000 7f5c52e17640 1 -- 172.21.15.59:0/1981727887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c1a4f60 con 0x7f5c4c100630 2024-09-10T11:08:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c49ffb640 1 -- 172.21.15.59:0/1981727887 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5c34042030 con 0x7f5c4c100630 2024-09-10T11:08:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c55c89740 1 Processor -- start 2024-09-10T11:08:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c55c89740 1 -- start start 2024-09-10T11:08:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4ddaf0 0x564d9e4dded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 0x564d9e4e8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 0x564d9e4eb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c55c89740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564d9e4422f0 con 0x564d9e4ddaf0 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c55c89740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564d9e3ea270 con 0x564d9e4e8cb0 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c55c89740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564d9e43e2b0 con 0x564d9e4de410 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c513b4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4ddaf0 0x564d9e4dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c513b4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4ddaf0 0x564d9e4dded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38192/0 (socket says 172.21.15.59:38192) 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.946+0000 7f5c513b4640 1 -- 172.21.15.59:0/1211111087 learned_addr learned my addr 172.21.15.59:0/1211111087 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c49ffb640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c380a2e20 0x7f5c380a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 0x564d9e4eb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 0x564d9e4e8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c380a2e20 0x7f5c380a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c49ffb640 1 -- 172.21.15.59:0/1981727887 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7f5c340ef990 con 0x7f5c4c100630 2024-09-10T11:08:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c513b4640 1 -- 172.21.15.59:0/1211111087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 msgr2=0x564d9e4e8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 0x564d9e4e8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c513b4640 1 -- 172.21.15.59:0/1211111087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 msgr2=0x564d9e4eb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 0x564d9e4eb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c513b4640 1 -- 172.21.15.59:0/1211111087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d9e3e9340 con 0x564d9e4ddaf0 2024-09-10T11:08:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 0x564d9e4e8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4ddaf0 0x564d9e4dded0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5c44012940 tx=0x7f5c44012e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aec07b0102aacbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c380a2e20 0x7f5c380a52e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5c44010740 tx=0x7f5c4401b000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c42ffd640 1 -- 172.21.15.59:0/1211111087 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44004d20 con 0x564d9e4ddaf0 2024-09-10T11:08:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c42ffd640 1 -- 172.21.15.59:0/1211111087 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c44004310 con 0x564d9e4ddaf0 2024-09-10T11:08:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.947+0000 7f5c42ffd640 1 -- 172.21.15.59:0/1211111087 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c440054f0 con 0x564d9e4ddaf0 2024-09-10T11:08:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.948+0000 7f5c55c89740 1 -- 172.21.15.59:0/1211111087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4ddaf0 msgr2=0x564d9e4dded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.948+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4ddaf0 0x564d9e4dded0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5c44012940 tx=0x7f5c44012e00 comp rx=0 tx=0).stop 2024-09-10T11:08:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.948+0000 7f5c55c89740 1 -- 172.21.15.59:0/1211111087 shutdown_connections 2024-09-10T11:08:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.948+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 0x564d9e4eb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.948+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 0x564d9e4e8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.948+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1211111087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4ddaf0 0x564d9e4dded0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.948+0000 7f5c55c89740 1 -- 172.21.15.59:0/1211111087 >> 172.21.15.59:0/1211111087 conn(0x564d9e4da060 msgr2=0x564d9e4da440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.948+0000 7f5c55c89740 1 -- 172.21.15.59:0/1211111087 shutdown_connections 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.948+0000 7f5c55c89740 1 -- 172.21.15.59:0/1211111087 wait complete. 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c55c89740 1 -- start start 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c55c89740 1 Processor -- start 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 0x564d9e4e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 0x564d9e4e60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4e8cb0 0x564d9e4e6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c55c89740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564d9e4eb820 con 0x564d9e4e8cb0 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c55c89740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564d9e3cb290 con 0x564d9e4ddaf0 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c55c89740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564d9e4eb9a0 con 0x564d9e4de410 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c55c89740 10 client.0 _ll_register_callbacks cb 0x564d9e3fc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c513b4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4e8cb0 0x564d9e4e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c513b4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4e8cb0 0x564d9e4e6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38196/0 (socket says 172.21.15.59:38196) 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.949+0000 7f5c513b4640 1 -- 172.21.15.59:0/1134166459 learned_addr learned my addr 172.21.15.59:0/1134166459 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 0x564d9e4e60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 0x564d9e4e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c513b4640 1 -- 172.21.15.59:0/1134166459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 msgr2=0x564d9e4e60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 0x564d9e4e60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c513b4640 1 -- 172.21.15.59:0/1134166459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 msgr2=0x564d9e4e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 0x564d9e4e5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c513b4640 1 -- 172.21.15.59:0/1134166459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d9e155210 con 0x564d9e4e8cb0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 0x564d9e4e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c513b4640 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4e8cb0 0x564d9e4e6610 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5c44004140 tx=0x7f5c44007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4108173570381d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c2bfff640 1 -- 172.21.15.59:0/1134166459 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44004a40 con 0x564d9e4e8cb0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c2bfff640 1 -- 172.21.15.59:0/1134166459 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7f5c44004be0 con 0x564d9e4e8cb0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c55c89740 1 -- 172.21.15.59:0/1134166459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c44004310 con 0x564d9e4e8cb0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c2bfff640 1 -- 172.21.15.59:0/1134166459 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5c44004de0 con 0x564d9e4e8cb0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c55c89740 10 client.15855 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.950+0000 7f5c55c89740 1 -- 172.21.15.59:0/1134166459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564d9e221620 con 0x564d9e4e8cb0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.951+0000 7f5c2bfff640 1 -- 172.21.15.59:0/1134166459 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c44004310 con 0x564d9e4e8cb0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.951+0000 7f5c2bfff640 1 -- 172.21.15.59:0/1134166459 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5c4402e070 con 0x564d9e4e8cb0 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.951+0000 7f5c55c89740 10 client.15855 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.951+0000 7f5c55c89740 10 client.15855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.951+0000 7f5c55c89740 20 client.15855 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.951+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564d9e4f8b70 0x564d9e4faf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.951+0000 7f5c55c89740 4 client.15855 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.951+0000 7f5c55c89740 1 -- 172.21.15.59:0/1134166459 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d9e44fa20 con 0x564d9e4f8b70 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.951+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564d9e4f8b70 0x564d9e4faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564d9e4f8b70 0x564d9e4faf60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f62d009c32aa09 server_cookie=ef644faa07c6ccd5 in_seq=0 out_seq=0 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c2bfff640 10 client.15855 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c2bfff640 1 -- 172.21.15.59:0/1134166459 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d9e44fa20 con 0x564d9e4f8b70 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c2bfff640 10 client.15855 handle_command_reply: tid=0 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c55c89740 1 client.15855 shutdown 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c55c89740 1 -- 172.21.15.59:0/1134166459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4e8cb0 msgr2=0x564d9e4e6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4e8cb0 0x564d9e4e6610 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5c44004140 tx=0x7f5c44007500 comp rx=0 tx=0).stop 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c55c89740 1 -- 172.21.15.59:0/1134166459 shutdown_connections 2024-09-10T11:08:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564d9e4f8b70 0x564d9e4faf60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4e8cb0 0x564d9e4e6610 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c2bfff640 0 client.15855 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4de410 0x564d9e4e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.952+0000 7f5c55c89740 1 --2- 172.21.15.59:0/1134166459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 0x564d9e4e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.953+0000 7f5c55c89740 1 -- 172.21.15.59:0/1134166459 >> 172.21.15.59:0/1134166459 conn(0x564d9e4da060 msgr2=0x564d9e4dfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.953+0000 7f5c55c89740 1 -- 172.21.15.59:0/1134166459 shutdown_connections 2024-09-10T11:08:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.953+0000 7f5c55c89740 1 -- 172.21.15.59:0/1134166459 wait complete. 2024-09-10T11:08:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.953+0000 7f5c55c89740 20 client.15855 trim_cache size 0 max 16384 2024-09-10T11:08:52.974 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.967+0000 7f5c55c89740 1 Processor -- start 2024-09-10T11:08:52.974 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.967+0000 7f5c55c89740 1 -- start start 2024-09-10T11:08:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 0x564d9e4e6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e500760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4e8cb0 0x564d9e500ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c55c89740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1b0220 con 0x564d9e4de410 2024-09-10T11:08:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c55c89740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1adaf0 con 0x564d9e4ddaf0 2024-09-10T11:08:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c55c89740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1ab960 con 0x564d9e4e8cb0 2024-09-10T11:08:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c4bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e500760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c4bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e500760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38200/0 (socket says 172.21.15.59:38200) 2024-09-10T11:08:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c4bfff640 1 -- 172.21.15.59:0/2355833453 learned_addr learned my addr 172.21.15.59:0/2355833453 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 0x564d9e4e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c513b4640 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4e8cb0 0x564d9e500ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c4bfff640 1 -- 172.21.15.59:0/2355833453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4e8cb0 msgr2=0x564d9e500ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4e8cb0 0x564d9e500ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c4bfff640 1 -- 172.21.15.59:0/2355833453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 msgr2=0x564d9e4e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 0x564d9e4e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c4bfff640 1 -- 172.21.15.59:0/2355833453 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d9e4fb4f0 con 0x564d9e4de410 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c513b4640 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4e8cb0 0x564d9e500ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.968+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e500760 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c005fd0 tx=0x7f5c3c00e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac505e056f5abc08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c427fc640 1 -- 172.21.15.59:0/2355833453 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c005020 con 0x564d9e4de410 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c427fc640 1 -- 172.21.15.59:0/2355833453 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c3c0047a0 con 0x564d9e4de410 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c427fc640 1 -- 172.21.15.59:0/2355833453 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00d8b0 con 0x564d9e4de410 2024-09-10T11:08:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c55c89740 1 -- 172.21.15.59:0/2355833453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 msgr2=0x564d9e500760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c55c89740 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e500760 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c005fd0 tx=0x7f5c3c00e820 comp rx=0 tx=0).stop 2024-09-10T11:08:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c55c89740 1 -- 172.21.15.59:0/2355833453 shutdown_connections 2024-09-10T11:08:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c55c89740 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4e8cb0 0x564d9e500ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c55c89740 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e500760 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c55c89740 1 --2- 172.21.15.59:0/2355833453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4ddaf0 0x564d9e4e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c55c89740 1 -- 172.21.15.59:0/2355833453 >> 172.21.15.59:0/2355833453 conn(0x564d9e4da060 msgr2=0x564d9e4e7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c55c89740 1 -- 172.21.15.59:0/2355833453 shutdown_connections 2024-09-10T11:08:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.969+0000 7f5c55c89740 1 -- 172.21.15.59:0/2355833453 wait complete. 2024-09-10T11:08:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c55c89740 1 -- start start 2024-09-10T11:08:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c55c89740 1 Processor -- start 2024-09-10T11:08:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4ddaf0 0x564d9e4f1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e4ec630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c55c89740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 0x564d9e4ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c55c89740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1abfb0 con 0x564d9e4de410 2024-09-10T11:08:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c55c89740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1ad420 con 0x564d9e4e8cb0 2024-09-10T11:08:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c55c89740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1ac680 con 0x564d9e4ddaf0 2024-09-10T11:08:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c55c89740 10 client.0 _ll_register_callbacks cb 0x7f5c3c00b4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:08:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c4bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e4ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c4bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e4ec630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38212/0 (socket says 172.21.15.59:38212) 2024-09-10T11:08:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c4bfff640 1 -- 172.21.15.59:0/4204392532 learned_addr learned my addr 172.21.15.59:0/4204392532 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:08:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4ddaf0 0x564d9e4f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.970+0000 7f5c513b4640 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 0x564d9e4ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c4bfff640 1 -- 172.21.15.59:0/4204392532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4ddaf0 msgr2=0x564d9e4f1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4ddaf0 0x564d9e4f1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c4bfff640 1 -- 172.21.15.59:0/4204392532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 msgr2=0x564d9e4ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:08:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 0x564d9e4ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c4bfff640 1 -- 172.21.15.59:0/4204392532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d9e4ed370 con 0x564d9e4de410 2024-09-10T11:08:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c513b4640 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 0x564d9e4ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:08:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c4bfff640 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e4ec630 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c005bc0 tx=0x7f5c3c005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f49f30b62bf8592 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:08:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:08:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c2bfff640 1 -- 172.21.15.59:0/4204392532 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00ba30 con 0x564d9e4de410 2024-09-10T11:08:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c2bfff640 1 -- 172.21.15.59:0/4204392532 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7f5c3c00d650 con 0x564d9e4de410 2024-09-10T11:08:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c55c89740 1 -- 172.21.15.59:0/4204392532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c3c0047a0 con 0x564d9e4de410 2024-09-10T11:08:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c2bfff640 1 -- 172.21.15.59:0/4204392532 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5c3c032050 con 0x564d9e4de410 2024-09-10T11:08:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c55c89740 10 client.15861 fetch_fsmap learned FSMap version 26 2024-09-10T11:08:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c55c89740 1 -- 172.21.15.59:0/4204392532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564d9e563620 con 0x564d9e4de410 2024-09-10T11:08:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c2bfff640 1 -- 172.21.15.59:0/4204392532 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c3c0047a0 con 0x564d9e4de410 2024-09-10T11:08:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c2bfff640 1 -- 172.21.15.59:0/4204392532 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5c3c00b040 con 0x564d9e4de410 2024-09-10T11:08:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.971+0000 7f5c55c89740 10 client.15861 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:08:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.972+0000 7f5c55c89740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:08:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.972+0000 7f5c55c89740 20 client.15861 populate_metadata read hostname 'smithi059' 2024-09-10T11:08:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.972+0000 7f5c55c89740 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564d9e563d60 0x564d9e566180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:08:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.972+0000 7f5c55c89740 4 client.15861 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:08:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.972+0000 7f5c55c89740 1 -- 172.21.15.59:0/4204392532 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d9e449d70 con 0x564d9e563d60 2024-09-10T11:08:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.972+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564d9e563d60 0x564d9e566180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:08:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.972+0000 7f5c50bb3640 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564d9e563d60 0x564d9e566180 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1ce8285127e8d05 server_cookie=ce8b6365082de26 in_seq=0 out_seq=0 2024-09-10T11:08:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.972+0000 7f5c2bfff640 10 client.15861 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c2bfff640 1 -- 172.21.15.59:0/4204392532 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d9e449d70 con 0x564d9e563d60 2024-09-10T11:08:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c2bfff640 10 client.15861 handle_command_reply: tid=0 2024-09-10T11:08:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 client.15861 shutdown 2024-09-10T11:08:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 -- 172.21.15.59:0/4204392532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 msgr2=0x564d9e4ec630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e4ec630 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c005bc0 tx=0x7f5c3c005250 comp rx=0 tx=0).stop 2024-09-10T11:08:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 -- 172.21.15.59:0/4204392532 shutdown_connections 2024-09-10T11:08:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x564d9e563d60 0x564d9e566180 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564d9e4e8cb0 0x564d9e4ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c2bfff640 0 client.15861 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:08:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9e4de410 0x564d9e4ec630 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 --2- 172.21.15.59:0/4204392532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d9e4ddaf0 0x564d9e4f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 -- 172.21.15.59:0/4204392532 >> 172.21.15.59:0/4204392532 conn(0x564d9e4da060 msgr2=0x564d9e4df550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 -- 172.21.15.59:0/4204392532 shutdown_connections 2024-09-10T11:08:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 1 -- 172.21.15.59:0/4204392532 wait complete. 2024-09-10T11:08:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.987+0000 7f5c55c89740 20 client.15861 trim_cache size 0 max 16384 2024-09-10T11:08:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:08:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:08:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:08:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:08:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 -- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c380a2e20 msgr2=0x7f5c380a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c380a2e20 0x7f5c380a52e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5c44010740 tx=0x7f5c4401b000 comp rx=0 tx=0).stop 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 -- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c100630 msgr2=0x7f5c4c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c100630 0x7f5c4c1983f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009230 tx=0x7f5c34004270 comp rx=0 tx=0).stop 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 -- 172.21.15.59:0/1981727887 shutdown_connections 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c380a2e20 0x7f5c380a52e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c4c106220 0x7f5c4c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c100fd0 0x7f5c4c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 --2- 172.21.15.59:0/1981727887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c4c100630 0x7f5c4c1983f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 -- 172.21.15.59:0/1981727887 >> 172.21.15.59:0/1981727887 conn(0x7f5c4c075ef0 msgr2=0x7f5c4c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 -- 172.21.15.59:0/1981727887 shutdown_connections 2024-09-10T11:08:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:08:52.988+0000 7f5c52e17640 1 -- 172.21.15.59:0/1981727887 wait complete. 2024-09-10T11:08:54.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:54 smithi059 ceph-mon[30978]: pgmap v231: 97 pgs: 97 active+clean; 5.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:54.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:54 smithi181 ceph-mon[35409]: pgmap v231: 97 pgs: 97 active+clean; 5.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:54 smithi115 ceph-mon[34719]: pgmap v231: 97 pgs: 97 active+clean; 5.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:56.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:56 smithi059 ceph-mon[30978]: pgmap v232: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-10T11:08:56.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:56 smithi181 ceph-mon[35409]: pgmap v232: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-10T11:08:56.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:56 smithi115 ceph-mon[34719]: pgmap v232: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-10T11:08:57.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:57 smithi059 ceph-mon[30978]: pgmap v233: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:57.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:57 smithi181 ceph-mon[35409]: pgmap v233: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:57.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:57 smithi115 ceph-mon[34719]: pgmap v233: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:08:59.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:08:59 smithi181 ceph-mon[35409]: pgmap v234: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 17 op/s 2024-09-10T11:08:59.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:08:59 smithi115 ceph-mon[34719]: pgmap v234: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 17 op/s 2024-09-10T11:08:59.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:08:59 smithi059 ceph-mon[30978]: pgmap v234: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 17 op/s 2024-09-10T11:09:01.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:01 smithi181 ceph-mon[35409]: pgmap v235: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:09:01.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:01 smithi115 ceph-mon[34719]: pgmap v235: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:09:01.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:01 smithi059 ceph-mon[30978]: pgmap v235: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:09:02.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:02 smithi181 ceph-mon[35409]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T11:09:02.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:02 smithi115 ceph-mon[34719]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T11:09:02.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:02 smithi059 ceph-mon[30978]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T11:09:03.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:03 smithi181 ceph-mon[35409]: pgmap v237: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-09-10T11:09:03.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:03 smithi115 ceph-mon[34719]: pgmap v237: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-09-10T11:09:03.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:03 smithi059 ceph-mon[30978]: pgmap v237: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-09-10T11:09:05.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:05 smithi181 ceph-mon[35409]: pgmap v238: 97 pgs: 97 active+clean; 5.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 33 op/s 2024-09-10T11:09:05.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:05 smithi115 ceph-mon[34719]: pgmap v238: 97 pgs: 97 active+clean; 5.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 33 op/s 2024-09-10T11:09:05.887 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:05 smithi059 ceph-mon[30978]: pgmap v238: 97 pgs: 97 active+clean; 5.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 33 op/s 2024-09-10T11:09:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3041097545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 msgr2=0x7f5f8c100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3041097545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 0x7f5f8c100e50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009930 tx=0x7f5f7c02a420 comp rx=0 tx=0).stop 2024-09-10T11:09:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3041097545 shutdown_connections 2024-09-10T11:09:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3041097545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f8c101390 0x7f5f8c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3041097545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 0x7f5f8c100e50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3041097545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f8c106a00 0x7f5f8c106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3041097545 >> 172.21.15.59:0/3041097545 conn(0x7f5f8c0fc6b0 msgr2=0x7f5f8c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3041097545 shutdown_connections 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3041097545 wait complete. 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.089+0000 7f5f93c9b640 1 Processor -- start 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f93c9b640 1 -- start start 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f93c9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 0x7f5f8c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f93c9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f8c101390 0x7f5f8c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f93c9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f8c106a00 0x7f5f8c1a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f93c9b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c110e40 con 0x7f5f8c1009f0 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f93c9b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c110cc0 con 0x7f5f8c106a00 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f93c9b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c110fc0 con 0x7f5f8c101390 2024-09-10T11:09:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91a37640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 0x7f5f8c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91a37640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 0x7f5f8c1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58180/0 (socket says 172.21.15.59:58180) 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91a37640 1 -- 172.21.15.59:0/3779992863 learned_addr learned my addr 172.21.15.59:0/3779992863 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f92238640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f8c106a00 0x7f5f8c1a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91236640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f8c101390 0x7f5f8c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91a37640 1 -- 172.21.15.59:0/3779992863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f8c101390 msgr2=0x7f5f8c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91a37640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f8c101390 0x7f5f8c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91a37640 1 -- 172.21.15.59:0/3779992863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f8c106a00 msgr2=0x7f5f8c1a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91a37640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f8c106a00 0x7f5f8c1a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91a37640 1 -- 172.21.15.59:0/3779992863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8c1a47b0 con 0x7f5f8c1009f0 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91236640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f8c101390 0x7f5f8c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.090+0000 7f5f91a37640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 0x7f5f8c1991f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800e9f0 tx=0x7f5f8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.091+0000 7f5f82ffd640 1 -- 172.21.15.59:0/3779992863 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800cd80 con 0x7f5f8c1009f0 2024-09-10T11:09:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.091+0000 7f5f82ffd640 1 -- 172.21.15.59:0/3779992863 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f88010910 con 0x7f5f8c1009f0 2024-09-10T11:09:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.091+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3779992863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f8c1a4980 con 0x7f5f8c1009f0 2024-09-10T11:09:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.091+0000 7f5f82ffd640 1 -- 172.21.15.59:0/3779992863 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88018990 con 0x7f5f8c1009f0 2024-09-10T11:09:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.091+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3779992863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f8c1a4ea0 con 0x7f5f8c1009f0 2024-09-10T11:09:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.093+0000 7f5f82ffd640 1 -- 172.21.15.59:0/3779992863 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5f88010ac0 con 0x7f5f8c1009f0 2024-09-10T11:09:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f96a32740 1 Processor -- start 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f96a32740 1 -- start start 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 0x558e6f43aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f445770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f96a32740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558e6f39f2f0 con 0x558e6f43b410 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f96a32740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558e6f347270 con 0x558e6f445cb0 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f96a32740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558e6f39b2b0 con 0x558e6f43aaf0 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f82ffd640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5f780a2da0 0x7f5f780a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f91a37640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f445770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f91a37640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f445770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58184/0 (socket says 172.21.15.59:58184) 2024-09-10T11:09:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.094+0000 7f5f91a37640 1 -- 172.21.15.59:0/3058253426 learned_addr learned my addr 172.21.15.59:0/3058253426 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f91236640 1 --2- 172.21.15.59:0/3058253426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f92238640 1 --2- 172.21.15.59:0/3058253426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 0x558e6f43aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f92238640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5f780a2da0 0x7f5f780a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f82ffd640 1 -- 172.21.15.59:0/3779992863 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8644+0+0 (secure 0 0 0) 0x7f5f880cf870 con 0x7f5f8c1009f0 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f91236640 1 -- 172.21.15.59:0/3058253426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 msgr2=0x558e6f43aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f91236640 1 --2- 172.21.15.59:0/3058253426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 0x558e6f43aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f91236640 1 -- 172.21.15.59:0/3058253426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 msgr2=0x558e6f445770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f91236640 1 --2- 172.21.15.59:0/3058253426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f445770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f91236640 1 -- 172.21.15.59:0/3058253426 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6f346340 con 0x558e6f445cb0 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f91236640 1 --2- 172.21.15.59:0/3058253426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4480a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c02a940 tx=0x7f5f7c009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e7cb3dc00335fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f92238640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5f780a2da0 0x7f5f780a5260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009fd0 tx=0x7f5f84009600 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f77fff640 1 -- 172.21.15.59:0/3058253426 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c03f070 con 0x558e6f445cb0 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f77fff640 1 -- 172.21.15.59:0/3058253426 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f7c004030 con 0x558e6f445cb0 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.095+0000 7f5f77fff640 1 -- 172.21.15.59:0/3058253426 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c035070 con 0x558e6f445cb0 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.096+0000 7f5f96a32740 1 -- 172.21.15.59:0/3058253426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 msgr2=0x558e6f4480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.096+0000 7f5f96a32740 1 --2- 172.21.15.59:0/3058253426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4480a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c02a940 tx=0x7f5f7c009680 comp rx=0 tx=0).stop 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.096+0000 7f5f96a32740 1 -- 172.21.15.59:0/3058253426 shutdown_connections 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.096+0000 7f5f96a32740 1 --2- 172.21.15.59:0/3058253426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4480a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.096+0000 7f5f96a32740 1 --2- 172.21.15.59:0/3058253426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f445770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.096+0000 7f5f96a32740 1 --2- 172.21.15.59:0/3058253426 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 0x558e6f43aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.096+0000 7f5f96a32740 1 -- 172.21.15.59:0/3058253426 >> 172.21.15.59:0/3058253426 conn(0x558e6f437060 msgr2=0x558e6f437440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.096+0000 7f5f96a32740 1 -- 172.21.15.59:0/3058253426 shutdown_connections 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.096+0000 7f5f96a32740 1 -- 172.21.15.59:0/3058253426 wait complete. 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f96a32740 1 -- start start 2024-09-10T11:09:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f96a32740 1 Processor -- start 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 0x558e6f442b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f443040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f443580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f96a32740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558e6f448880 con 0x558e6f43b410 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f96a32740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558e6f328290 con 0x558e6f445cb0 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f96a32740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x558e6f448a00 con 0x558e6f43aaf0 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f96a32740 10 client.0 _ll_register_callbacks cb 0x558e6f359140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f91236640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f443040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f91236640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f443040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58190/0 (socket says 172.21.15.59:58190) 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.097+0000 7f5f91236640 1 -- 172.21.15.59:0/37703268 learned_addr learned my addr 172.21.15.59:0/37703268 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f91a37640 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 0x558e6f442b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f92238640 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f443580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f91236640 1 -- 172.21.15.59:0/37703268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 msgr2=0x558e6f442b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f91236640 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 0x558e6f442b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f91236640 1 -- 172.21.15.59:0/37703268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 msgr2=0x558e6f443580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f91236640 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f443580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f91236640 1 -- 172.21.15.59:0/37703268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6f0b2210 con 0x558e6f43b410 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f92238640 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f443580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f91236640 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f443040 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009900 tx=0x7f5f7c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426777b0a429353b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f757fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f757fa640 1 -- 172.21.15.59:0/37703268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c04b020 con 0x558e6f43b410 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f96a32740 1 -- 172.21.15.59:0/37703268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f7c004030 con 0x558e6f43b410 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f757fa640 1 -- 172.21.15.59:0/37703268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8644+0+0 (secure 0 0 0) 0x7f5f7c0315b0 con 0x558e6f43b410 2024-09-10T11:09:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f757fa640 1 -- 172.21.15.59:0/37703268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5f7c056050 con 0x558e6f43b410 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f96a32740 10 client.15873 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.098+0000 7f5f96a32740 1 -- 172.21.15.59:0/37703268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558e6f17e620 con 0x558e6f43b410 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.099+0000 7f5f757fa640 1 -- 172.21.15.59:0/37703268 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f7c004030 con 0x558e6f43b410 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.099+0000 7f5f757fa640 1 -- 172.21.15.59:0/37703268 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5f7c03b460 con 0x558e6f43b410 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.099+0000 7f5f96a32740 10 client.15873 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.099+0000 7f5f96a32740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.099+0000 7f5f96a32740 20 client.15873 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.099+0000 7f5f96a32740 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558e6f455a00 0x558e6f457df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.099+0000 7f5f96a32740 4 client.15873 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.099+0000 7f5f96a32740 1 -- 172.21.15.59:0/37703268 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e6f3aca20 con 0x558e6f455a00 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.099+0000 7f5f91a37640 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558e6f455a00 0x558e6f457df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.100+0000 7f5f91a37640 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558e6f455a00 0x558e6f457df0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13554602b97a1b5a server_cookie=b6c17765d4087e23 in_seq=0 out_seq=0 2024-09-10T11:09:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.100+0000 7f5f757fa640 10 client.15873 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.100+0000 7f5f757fa640 1 -- 172.21.15.59:0/37703268 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e6f3aca20 con 0x558e6f455a00 2024-09-10T11:09:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.100+0000 7f5f757fa640 10 client.15873 handle_command_reply: tid=0 2024-09-10T11:09:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.100+0000 7f5f96a32740 1 client.15873 shutdown 2024-09-10T11:09:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.100+0000 7f5f96a32740 1 -- 172.21.15.59:0/37703268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 msgr2=0x558e6f443040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.100+0000 7f5f96a32740 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f443040 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009900 tx=0x7f5f7c0054e0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f96a32740 1 -- 172.21.15.59:0/37703268 shutdown_connections 2024-09-10T11:09:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f96a32740 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558e6f455a00 0x558e6f457df0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f96a32740 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f443580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f96a32740 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43b410 0x558e6f443040 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f96a32740 1 --2- 172.21.15.59:0/37703268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43aaf0 0x558e6f442b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f757fa640 0 client.15873 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f96a32740 1 -- 172.21.15.59:0/37703268 >> 172.21.15.59:0/37703268 conn(0x558e6f437060 msgr2=0x558e6f43cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f96a32740 1 -- 172.21.15.59:0/37703268 shutdown_connections 2024-09-10T11:09:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f96a32740 1 -- 172.21.15.59:0/37703268 wait complete. 2024-09-10T11:09:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.101+0000 7f5f96a32740 20 client.15873 trim_cache size 0 max 16384 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.115+0000 7f5f96a32740 1 Processor -- start 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.115+0000 7f5f96a32740 1 -- start start 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.115+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f43d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.115+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 0x558e6f4433b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.115+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f44e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.115+0000 7f5f96a32740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1b0370 con 0x558e6f43aaf0 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.115+0000 7f5f96a32740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1adc40 con 0x558e6f445cb0 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.115+0000 7f5f96a32740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1abab0 con 0x558e6f43b410 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91a37640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f43d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91a37640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f43d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58192/0 (socket says 172.21.15.59:58192) 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91a37640 1 -- 172.21.15.59:0/861148257 learned_addr learned my addr 172.21.15.59:0/861148257 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91236640 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 0x558e6f4433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f92238640 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f44e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91a37640 1 -- 172.21.15.59:0/861148257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 msgr2=0x558e6f4433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91a37640 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 0x558e6f4433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91a37640 1 -- 172.21.15.59:0/861148257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 msgr2=0x558e6f44e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91a37640 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f44e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91a37640 1 -- 172.21.15.59:0/861148257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6f436e90 con 0x558e6f43aaf0 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f92238640 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f44e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f91a37640 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f43d560 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c6a0 tx=0x7f5f880c6840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828e5e13174d3bf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f777fe640 1 -- 172.21.15.59:0/861148257 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88099fb0 con 0x558e6f43aaf0 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f777fe640 1 -- 172.21.15.59:0/861148257 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f88098320 con 0x558e6f43aaf0 2024-09-10T11:09:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.116+0000 7f5f777fe640 1 -- 172.21.15.59:0/861148257 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8809b100 con 0x558e6f43aaf0 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 -- 172.21.15.59:0/861148257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 msgr2=0x558e6f43d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f43d560 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c6a0 tx=0x7f5f880c6840 comp rx=0 tx=0).stop 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 -- 172.21.15.59:0/861148257 shutdown_connections 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f44e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 0x558e6f4433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 --2- 172.21.15.59:0/861148257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f43d560 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 -- 172.21.15.59:0/861148257 >> 172.21.15.59:0/861148257 conn(0x558e6f437060 msgr2=0x558e6f444b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 -- 172.21.15.59:0/861148257 shutdown_connections 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 -- 172.21.15.59:0/861148257 wait complete. 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 -- start start 2024-09-10T11:09:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.117+0000 7f5f96a32740 1 Processor -- start 2024-09-10T11:09:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f4b8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 0x558e6f4b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f96a32740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f96a32740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1ac100 con 0x558e6f43aaf0 2024-09-10T11:09:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f96a32740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1ad570 con 0x558e6f445cb0 2024-09-10T11:09:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f96a32740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8c1ac7d0 con 0x558e6f43b410 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f96a32740 10 client.0 _ll_register_callbacks cb 0x7f5f88009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91a37640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f4b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91a37640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f4b8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58204/0 (socket says 172.21.15.59:58204) 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91a37640 1 -- 172.21.15.59:0/1453772633 learned_addr learned my addr 172.21.15.59:0/1453772633 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f92238640 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91236640 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 0x558e6f4b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91a37640 1 -- 172.21.15.59:0/1453772633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 msgr2=0x558e6f4b89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91a37640 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 0x558e6f4b89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91a37640 1 -- 172.21.15.59:0/1453772633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 msgr2=0x558e6f4c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91a37640 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91a37640 1 -- 172.21.15.59:0/1453772633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6f4322d0 con 0x558e6f43aaf0 2024-09-10T11:09:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91236640 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 0x558e6f4b89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f92238640 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f91a37640 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f4b8470 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5f880097b0 tx=0x7f5f880a4aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4275ccf97df23764 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.118+0000 7f5f757fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f757fa640 1 -- 172.21.15.59:0/1453772633 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8809a070 con 0x558e6f43aaf0 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f757fa640 1 -- 172.21.15.59:0/1453772633 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8644+0+0 (secure 0 0 0) 0x7f5f8809b100 con 0x558e6f43aaf0 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f96a32740 1 -- 172.21.15.59:0/1453772633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f88098320 con 0x558e6f43aaf0 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f757fa640 1 -- 172.21.15.59:0/1453772633 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5f8809b340 con 0x558e6f43aaf0 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f96a32740 10 client.15879 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f96a32740 1 -- 172.21.15.59:0/1453772633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558e6f437cf0 con 0x558e6f43aaf0 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f757fa640 1 -- 172.21.15.59:0/1453772633 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f88098320 con 0x558e6f43aaf0 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f757fa640 1 -- 172.21.15.59:0/1453772633 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5f8809ada0 con 0x558e6f43aaf0 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f96a32740 10 client.15879 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f96a32740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f96a32740 20 client.15879 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f96a32740 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558e6f4c4e00 0x558e6f4c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f96a32740 4 client.15879 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:09:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.119+0000 7f5f96a32740 1 -- 172.21.15.59:0/1453772633 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558e6f3a6d70 con 0x558e6f4c4e00 2024-09-10T11:09:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.120+0000 7f5f91236640 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558e6f4c4e00 0x558e6f4c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.120+0000 7f5f757fa640 10 client.15879 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.120+0000 7f5f91236640 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558e6f4c4e00 0x558e6f4c7220 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5a6a484285ed7db server_cookie=cd16c9c671da49bd in_seq=0 out_seq=0 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.133+0000 7f5f757fa640 1 -- 172.21.15.59:0/1453772633 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558e6f3a6d70 con 0x558e6f4c4e00 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.133+0000 7f5f757fa640 10 client.15879 handle_command_reply: tid=0 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.133+0000 7f5f96a32740 1 client.15879 shutdown 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 -- 172.21.15.59:0/1453772633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 msgr2=0x558e6f4b8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f4b8470 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5f880097b0 tx=0x7f5f880a4aa0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 -- 172.21.15.59:0/1453772633 shutdown_connections 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x558e6f4c4e00 0x558e6f4c7220 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558e6f445cb0 0x558e6f4c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e6f43b410 0x558e6f4b89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f757fa640 0 client.15879 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 --2- 172.21.15.59:0/1453772633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e6f43aaf0 0x558e6f4b8470 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 -- 172.21.15.59:0/1453772633 >> 172.21.15.59:0/1453772633 conn(0x558e6f437060 msgr2=0x558e6f4359a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 -- 172.21.15.59:0/1453772633 shutdown_connections 2024-09-10T11:09:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 1 -- 172.21.15.59:0/1453772633 wait complete. 2024-09-10T11:09:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f96a32740 20 client.15879 trim_cache size 0 max 16384 2024-09-10T11:09:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:09:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:09:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:09:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:09:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5f780a2da0 msgr2=0x7f5f780a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5f780a2da0 0x7f5f780a5260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009fd0 tx=0x7f5f84009600 comp rx=0 tx=0).stop 2024-09-10T11:09:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 msgr2=0x7f5f8c1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 0x7f5f8c1991f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800e9f0 tx=0x7f5f8800eeb0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3779992863 shutdown_connections 2024-09-10T11:09:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.134+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f8c106a00 0x7f5f8c1a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.135+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5f780a2da0 0x7f5f780a5260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.135+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f8c101390 0x7f5f8c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.135+0000 7f5f93c9b640 1 --2- 172.21.15.59:0/3779992863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c1009f0 0x7f5f8c1991f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.135+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3779992863 >> 172.21.15.59:0/3779992863 conn(0x7f5f8c0fc6b0 msgr2=0x7f5f8c0fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.135+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3779992863 shutdown_connections 2024-09-10T11:09:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:06.135+0000 7f5f93c9b640 1 -- 172.21.15.59:0/3779992863 wait complete. 2024-09-10T11:09:07.686 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:07 smithi181 ceph-mon[35409]: pgmap v239: 97 pgs: 97 active+clean; 5.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 33 op/s 2024-09-10T11:09:07.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:07 smithi115 ceph-mon[34719]: pgmap v239: 97 pgs: 97 active+clean; 5.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 33 op/s 2024-09-10T11:09:07.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:07 smithi059 ceph-mon[30978]: pgmap v239: 97 pgs: 97 active+clean; 5.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 33 op/s 2024-09-10T11:09:09.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:09 smithi181 ceph-mon[35409]: pgmap v240: 97 pgs: 97 active+clean; 1.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 108 KiB/s wr, 36 op/s 2024-09-10T11:09:09.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:09 smithi181 ceph-mon[35409]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T11:09:09.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:09 smithi115 ceph-mon[34719]: pgmap v240: 97 pgs: 97 active+clean; 1.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 108 KiB/s wr, 36 op/s 2024-09-10T11:09:09.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:09 smithi115 ceph-mon[34719]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T11:09:10.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:09 smithi059 ceph-mon[30978]: pgmap v240: 97 pgs: 97 active+clean; 1.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 108 KiB/s wr, 36 op/s 2024-09-10T11:09:10.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:09 smithi059 ceph-mon[30978]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T11:09:11.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:11 smithi181 ceph-mon[35409]: pgmap v242: 97 pgs: 97 active+clean; 1.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 121 KiB/s wr, 40 op/s 2024-09-10T11:09:11.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:11 smithi115 ceph-mon[34719]: pgmap v242: 97 pgs: 97 active+clean; 1.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 121 KiB/s wr, 40 op/s 2024-09-10T11:09:12.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:11 smithi059 ceph-mon[30978]: pgmap v242: 97 pgs: 97 active+clean; 1.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 121 KiB/s wr, 40 op/s 2024-09-10T11:09:13.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:13 smithi115 ceph-mon[34719]: pgmap v243: 97 pgs: 97 active+clean; 1.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 108 KiB/s wr, 36 op/s 2024-09-10T11:09:14.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:13 smithi059 ceph-mon[30978]: pgmap v243: 97 pgs: 97 active+clean; 1.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 108 KiB/s wr, 36 op/s 2024-09-10T11:09:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:13 smithi181 ceph-mon[35409]: pgmap v243: 97 pgs: 97 active+clean; 1.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 108 KiB/s wr, 36 op/s 2024-09-10T11:09:15.940 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:15 smithi059 ceph-mon[30978]: pgmap v244: 97 pgs: 97 active+clean; 2.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:09:15.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:15 smithi115 ceph-mon[34719]: pgmap v244: 97 pgs: 97 active+clean; 2.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:09:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:15 smithi181 ceph-mon[35409]: pgmap v244: 97 pgs: 97 active+clean; 2.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:09:17.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:17 smithi115 ceph-mon[34719]: pgmap v245: 97 pgs: 97 active+clean; 2.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:09:18.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:17 smithi059 ceph-mon[30978]: pgmap v245: 97 pgs: 97 active+clean; 2.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:09:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:17 smithi181 ceph-mon[35409]: pgmap v245: 97 pgs: 97 active+clean; 2.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:09:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.234+0000 7f2648f9f640 1 -- 172.21.15.59:0/3932950139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26441035e0 msgr2=0x7f264410bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.234+0000 7f2648f9f640 1 --2- 172.21.15.59:0/3932950139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26441035e0 0x7f264410bac0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f262c009900 tx=0x7f262c02a480 comp rx=0 tx=0).stop 2024-09-10T11:09:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.234+0000 7f2648f9f640 1 -- 172.21.15.59:0/3932950139 shutdown_connections 2024-09-10T11:09:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.234+0000 7f2648f9f640 1 --2- 172.21.15.59:0/3932950139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f264410c110 0x7f264410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.234+0000 7f2648f9f640 1 --2- 172.21.15.59:0/3932950139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26441035e0 0x7f264410bac0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.234+0000 7f2648f9f640 1 --2- 172.21.15.59:0/3932950139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2644102cc0 0x7f26441030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.234+0000 7f2648f9f640 1 -- 172.21.15.59:0/3932950139 >> 172.21.15.59:0/3932950139 conn(0x7f26440fc6b0 msgr2=0x7f26440fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.234+0000 7f2648f9f640 1 -- 172.21.15.59:0/3932950139 shutdown_connections 2024-09-10T11:09:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.234+0000 7f2648f9f640 1 -- 172.21.15.59:0/3932950139 wait complete. 2024-09-10T11:09:19.237 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.235+0000 7f2648f9f640 1 Processor -- start 2024-09-10T11:09:19.237 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.235+0000 7f2648f9f640 1 -- start start 2024-09-10T11:09:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.235+0000 7f2648f9f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2644102cc0 0x7f2644198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.235+0000 7f2648f9f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26441035e0 0x7f2644198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f2648f9f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f264410c110 0x7f264419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f2648f9f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2644111ef0 con 0x7f2644102cc0 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f2648f9f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2644111d70 con 0x7f264410c110 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f2648f9f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2644112070 con 0x7f26441035e0 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f264259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2644102cc0 0x7f2644198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f264259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2644102cc0 0x7f2644198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52518/0 (socket says 172.21.15.59:52518) 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f264259c640 1 -- 172.21.15.59:0/370868363 learned_addr learned my addr 172.21.15.59:0/370868363 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f2641d9b640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26441035e0 0x7f2644198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f2642d9d640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f264410c110 0x7f264419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f264259c640 1 -- 172.21.15.59:0/370868363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26441035e0 msgr2=0x7f2644198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f264259c640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26441035e0 0x7f2644198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f264259c640 1 -- 172.21.15.59:0/370868363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f264410c110 msgr2=0x7f264419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f264259c640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f264410c110 0x7f264419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f264259c640 1 -- 172.21.15.59:0/370868363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264419d410 con 0x7f2644102cc0 2024-09-10T11:09:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f264259c640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2644102cc0 0x7f2644198420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f263400e9f0 tx=0x7f263400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f263b7fe640 1 -- 172.21.15.59:0/370868363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263400cd80 con 0x7f2644102cc0 2024-09-10T11:09:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f2648f9f640 1 -- 172.21.15.59:0/370868363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264419d700 con 0x7f2644102cc0 2024-09-10T11:09:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f263b7fe640 1 -- 172.21.15.59:0/370868363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2634010910 con 0x7f2644102cc0 2024-09-10T11:09:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.236+0000 7f263b7fe640 1 -- 172.21.15.59:0/370868363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26340188f0 con 0x7f2644102cc0 2024-09-10T11:09:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.237+0000 7f2648f9f640 1 -- 172.21.15.59:0/370868363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26441a4f90 con 0x7f2644102cc0 2024-09-10T11:09:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.239+0000 7f263b7fe640 1 -- 172.21.15.59:0/370868363 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2634010ac0 con 0x7f2644102cc0 2024-09-10T11:09:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.239+0000 7f264be1a740 1 Processor -- start 2024-09-10T11:09:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264be1a740 1 -- start start 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264be1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 0x55c2c806aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264be1a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8075770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264be1a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 0x55c2c80780a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264be1a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c2c7fcf2f0 con 0x55c2c806b410 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264be1a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c2c7f77270 con 0x55c2c8075cb0 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264be1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c2c7fcb2b0 con 0x55c2c806aaf0 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8075770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52534/0 (socket says 172.21.15.59:52534) 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f264259c640 1 -- 172.21.15.59:0/1643059340 learned_addr learned my addr 172.21.15.59:0/1643059340 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f2642d9d640 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 0x55c2c806aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f2641d9b640 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 0x55c2c80780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.240+0000 7f263b7fe640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f26300a2da0 0x7f26300a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2642d9d640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f26300a2da0 0x7f26300a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2641d9b640 1 -- 172.21.15.59:0/1643059340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 msgr2=0x55c2c806aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2641d9b640 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 0x55c2c806aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2641d9b640 1 -- 172.21.15.59:0/1643059340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 msgr2=0x55c2c8075770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f263b7fe640 1 -- 172.21.15.59:0/370868363 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f26340cf960 con 0x7f2644102cc0 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2641d9b640 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8075770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2641d9b640 1 -- 172.21.15.59:0/1643059340 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c7f76340 con 0x55c2c8075cb0 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f264259c640 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2642d9d640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f26300a2da0 0x7f26300a5260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f263c005fd0 tx=0x7f263c004ab0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2641d9b640 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 0x55c2c80780a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f262c005940 tx=0x7f262c005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c079ba83eda48a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2638ff9640 1 -- 172.21.15.59:0/1643059340 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c040070 con 0x55c2c8075cb0 2024-09-10T11:09:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2638ff9640 1 -- 172.21.15.59:0/1643059340 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f262c031870 con 0x55c2c8075cb0 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.241+0000 7f2638ff9640 1 -- 172.21.15.59:0/1643059340 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c035040 con 0x55c2c8075cb0 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.242+0000 7f264be1a740 1 -- 172.21.15.59:0/1643059340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 msgr2=0x55c2c80780a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.242+0000 7f264be1a740 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 0x55c2c80780a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f262c005940 tx=0x7f262c005be0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.242+0000 7f264be1a740 1 -- 172.21.15.59:0/1643059340 shutdown_connections 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.242+0000 7f264be1a740 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 0x55c2c80780a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.242+0000 7f264be1a740 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.242+0000 7f264be1a740 1 --2- 172.21.15.59:0/1643059340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 0x55c2c806aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.242+0000 7f264be1a740 1 -- 172.21.15.59:0/1643059340 >> 172.21.15.59:0/1643059340 conn(0x55c2c8067060 msgr2=0x55c2c8067440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.242+0000 7f264be1a740 1 -- 172.21.15.59:0/1643059340 shutdown_connections 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.242+0000 7f264be1a740 1 -- 172.21.15.59:0/1643059340 wait complete. 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264be1a740 1 -- start start 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264be1a740 1 Processor -- start 2024-09-10T11:09:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264be1a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806aaf0 0x55c2c8072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264be1a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806b410 0x55c2c8073000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264be1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 0x55c2c8073540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264be1a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c2c8078880 con 0x55c2c806aaf0 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264be1a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c2c7f58290 con 0x55c2c806b410 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264be1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c2c8078a00 con 0x55c2c8075cb0 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264be1a740 10 client.0 _ll_register_callbacks cb 0x55c2c7f89140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806aaf0 0x55c2c8072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806aaf0 0x55c2c8072ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52546/0 (socket says 172.21.15.59:52546) 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264259c640 1 -- 172.21.15.59:0/2642807889 learned_addr learned my addr 172.21.15.59:0/2642807889 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f2642d9d640 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 0x55c2c8073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f2641d9b640 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806b410 0x55c2c8073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264259c640 1 -- 172.21.15.59:0/2642807889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 msgr2=0x55c2c8073540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264259c640 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 0x55c2c8073540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264259c640 1 -- 172.21.15.59:0/2642807889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806b410 msgr2=0x55c2c8073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264259c640 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806b410 0x55c2c8073000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f264259c640 1 -- 172.21.15.59:0/2642807889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c7ce2210 con 0x55c2c806aaf0 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.243+0000 7f2642d9d640 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 0x55c2c8073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f264259c640 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806aaf0 0x55c2c8072ac0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f263400e9c0 tx=0x7f263409b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea25093ca272634c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f2629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f2629ffb640 1 -- 172.21.15.59:0/2642807889 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26340a0180 con 0x55c2c806aaf0 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f2629ffb640 1 -- 172.21.15.59:0/2642807889 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f26340ccbc0 con 0x55c2c806aaf0 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f264be1a740 1 -- 172.21.15.59:0/2642807889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f262c031870 con 0x55c2c806aaf0 2024-09-10T11:09:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f2629ffb640 1 -- 172.21.15.59:0/2642807889 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f26340a4a40 con 0x55c2c806aaf0 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f264be1a740 10 client.15891 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f264be1a740 1 -- 172.21.15.59:0/2642807889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c2c7dae620 con 0x55c2c806aaf0 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f2629ffb640 1 -- 172.21.15.59:0/2642807889 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f262c031870 con 0x55c2c806aaf0 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f2629ffb640 1 -- 172.21.15.59:0/2642807889 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f26340b1060 con 0x55c2c806aaf0 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f264be1a740 10 client.15891 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.244+0000 7f264be1a740 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.245+0000 7f264be1a740 20 client.15891 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.245+0000 7f264be1a740 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c2c8085b50 0x55c2c8087f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.245+0000 7f264be1a740 4 client.15891 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.245+0000 7f264be1a740 1 -- 172.21.15.59:0/2642807889 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2c7fdca20 con 0x55c2c8085b50 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.245+0000 7f2641d9b640 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c2c8085b50 0x55c2c8087f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.245+0000 7f2641d9b640 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c2c8085b50 0x55c2c8087f40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf49e71d1ca3b86f server_cookie=8b0a35c76a7afc55 in_seq=0 out_seq=0 2024-09-10T11:09:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.245+0000 7f2629ffb640 10 client.15891 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f2629ffb640 1 -- 172.21.15.59:0/2642807889 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2c7fdca20 con 0x55c2c8085b50 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f2629ffb640 10 client.15891 handle_command_reply: tid=0 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 client.15891 shutdown 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 -- 172.21.15.59:0/2642807889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806aaf0 msgr2=0x55c2c8072ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806aaf0 0x55c2c8072ac0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f263400e9c0 tx=0x7f263409b7b0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 -- 172.21.15.59:0/2642807889 shutdown_connections 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c2c8085b50 0x55c2c8087f40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 0x55c2c8073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806b410 0x55c2c8073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f2629ffb640 0 client.15891 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 --2- 172.21.15.59:0/2642807889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806aaf0 0x55c2c8072ac0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 -- 172.21.15.59:0/2642807889 >> 172.21.15.59:0/2642807889 conn(0x55c2c8067060 msgr2=0x55c2c806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 -- 172.21.15.59:0/2642807889 shutdown_connections 2024-09-10T11:09:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 1 -- 172.21.15.59:0/2642807889 wait complete. 2024-09-10T11:09:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.246+0000 7f264be1a740 20 client.15891 trim_cache size 0 max 16384 2024-09-10T11:09:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f264be1a740 1 Processor -- start 2024-09-10T11:09:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f264be1a740 1 -- start start 2024-09-10T11:09:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f264be1a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806aaf0 0x55c2c8071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f264be1a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8073340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f264be1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 0x55c2c808d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f264be1a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26441b0280 con 0x55c2c806b410 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f264be1a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f26441adb50 con 0x55c2c806aaf0 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f264be1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f26441ab9c0 con 0x55c2c8075cb0 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f2641d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8073340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f2641d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8073340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52550/0 (socket says 172.21.15.59:52550) 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f2641d9b640 1 -- 172.21.15.59:0/2053445273 learned_addr learned my addr 172.21.15.59:0/2053445273 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f2641d9b640 1 -- 172.21.15.59:0/2053445273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 msgr2=0x55c2c808d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f2641d9b640 1 --2- 172.21.15.59:0/2053445273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 0x55c2c808d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f2641d9b640 1 -- 172.21.15.59:0/2053445273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806aaf0 msgr2=0x55c2c8071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.261+0000 7f264259c640 1 --2- 172.21.15.59:0/2053445273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806aaf0 0x55c2c8071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f2641d9b640 1 --2- 172.21.15.59:0/2053445273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806aaf0 0x55c2c8071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f2641d9b640 1 -- 172.21.15.59:0/2053445273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c806b240 con 0x55c2c806b410 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f264259c640 1 --2- 172.21.15.59:0/2053445273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806aaf0 0x55c2c8071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f2641d9b640 1 --2- 172.21.15.59:0/2053445273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8073340 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f262c005440 tx=0x7f262c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798dd12eb50e9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f262bfff640 1 -- 172.21.15.59:0/2053445273 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c040040 con 0x55c2c806b410 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f262bfff640 1 -- 172.21.15.59:0/2053445273 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f262c004230 con 0x55c2c806b410 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f262bfff640 1 -- 172.21.15.59:0/2053445273 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c035040 con 0x55c2c806b410 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f264be1a740 1 -- 172.21.15.59:0/2053445273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 msgr2=0x55c2c8073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f264be1a740 1 --2- 172.21.15.59:0/2053445273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8073340 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f262c005440 tx=0x7f262c0058d0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f264be1a740 1 -- 172.21.15.59:0/2053445273 shutdown_connections 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f264be1a740 1 --2- 172.21.15.59:0/2053445273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c8075cb0 0x55c2c808d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f264be1a740 1 --2- 172.21.15.59:0/2053445273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c8073340 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f264be1a740 1 --2- 172.21.15.59:0/2053445273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c806aaf0 0x55c2c8071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.262+0000 7f264be1a740 1 -- 172.21.15.59:0/2053445273 >> 172.21.15.59:0/2053445273 conn(0x55c2c8067060 msgr2=0x55c2c8074b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 -- 172.21.15.59:0/2053445273 shutdown_connections 2024-09-10T11:09:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 -- 172.21.15.59:0/2053445273 wait complete. 2024-09-10T11:09:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 -- start start 2024-09-10T11:09:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 Processor -- start 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 0x55c2c8076ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c80773e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 0x55c2c8077920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26441ac010 con 0x55c2c806b410 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f26441ad480 con 0x55c2c8075cb0 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f26441ac6e0 con 0x55c2c806aaf0 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264be1a740 10 client.0 _ll_register_callbacks cb 0x7f263400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f2641d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c80773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f2641d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c80773e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52562/0 (socket says 172.21.15.59:52562) 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f2641d9b640 1 -- 172.21.15.59:0/3347883510 learned_addr learned my addr 172.21.15.59:0/3347883510 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.263+0000 7f264259c640 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 0x55c2c8076ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2642d9d640 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 0x55c2c8077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2641d9b640 1 -- 172.21.15.59:0/3347883510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 msgr2=0x55c2c8076ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2641d9b640 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 0x55c2c8076ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2641d9b640 1 -- 172.21.15.59:0/3347883510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 msgr2=0x55c2c8077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2641d9b640 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 0x55c2c8077920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2641d9b640 1 -- 172.21.15.59:0/3347883510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c807c280 con 0x55c2c806b410 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f264259c640 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 0x55c2c8076ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2641d9b640 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c80773e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f262c031440 tx=0x7f262c031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adce2ab9bd780597 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2629ffb640 1 -- 172.21.15.59:0/3347883510 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c035040 con 0x55c2c806b410 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2629ffb640 1 -- 172.21.15.59:0/3347883510 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f262c003bd0 con 0x55c2c806b410 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f264be1a740 1 -- 172.21.15.59:0/3347883510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f262c004230 con 0x55c2c806b410 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2629ffb640 1 -- 172.21.15.59:0/3347883510 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f262c068050 con 0x55c2c806b410 2024-09-10T11:09:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f264be1a740 10 client.15897 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f264be1a740 1 -- 172.21.15.59:0/3347883510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c2c80f0a70 con 0x55c2c806b410 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.264+0000 7f2629ffb640 1 -- 172.21.15.59:0/3347883510 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f262c004230 con 0x55c2c806b410 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f2629ffb640 1 -- 172.21.15.59:0/3347883510 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f262c063030 con 0x55c2c806b410 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f264be1a740 10 client.15897 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f264be1a740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f264be1a740 20 client.15897 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f264be1a740 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c2c80f0cf0 0x55c2c80f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f264be1a740 4 client.15897 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f264be1a740 1 -- 172.21.15.59:0/3347883510 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2c7fd6d70 con 0x55c2c80f0cf0 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f264259c640 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c2c80f0cf0 0x55c2c80f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f2629ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.265+0000 7f264259c640 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c2c80f0cf0 0x55c2c80f30e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab6f50378455338 server_cookie=f4f829becd1c9ba0 in_seq=0 out_seq=0 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.279+0000 7f2629ffb640 1 -- 172.21.15.59:0/3347883510 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2c7fd6d70 con 0x55c2c80f0cf0 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.279+0000 7f2629ffb640 10 client.15897 handle_command_reply: tid=0 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.279+0000 7f264be1a740 1 client.15897 shutdown 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.279+0000 7f264be1a740 1 -- 172.21.15.59:0/3347883510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 msgr2=0x55c2c80773e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.279+0000 7f264be1a740 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c80773e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f262c031440 tx=0x7f262c031700 comp rx=0 tx=0).stop 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f264be1a740 1 -- 172.21.15.59:0/3347883510 shutdown_connections 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f264be1a740 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c2c80f0cf0 0x55c2c80f30e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f264be1a740 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2c8075cb0 0x55c2c8077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f264be1a740 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c2c806b410 0x55c2c80773e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f2629ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f264be1a740 1 --2- 172.21.15.59:0/3347883510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c2c806aaf0 0x55c2c8076ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f264be1a740 1 -- 172.21.15.59:0/3347883510 >> 172.21.15.59:0/3347883510 conn(0x55c2c8067060 msgr2=0x55c2c80659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f264be1a740 1 -- 172.21.15.59:0/3347883510 shutdown_connections 2024-09-10T11:09:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f264be1a740 1 -- 172.21.15.59:0/3347883510 wait complete. 2024-09-10T11:09:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f264be1a740 20 client.15897 trim_cache size 0 max 16384 2024-09-10T11:09:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:09:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:09:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:09:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:09:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f2648f9f640 1 -- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f26300a2da0 msgr2=0x7f26300a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f2648f9f640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f26300a2da0 0x7f26300a5260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f263c005fd0 tx=0x7f263c004ab0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f2648f9f640 1 -- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2644102cc0 msgr2=0x7f2644198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.280+0000 7f2648f9f640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2644102cc0 0x7f2644198420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f263400e9f0 tx=0x7f263400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.281+0000 7f2648f9f640 1 -- 172.21.15.59:0/370868363 shutdown_connections 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.281+0000 7f2648f9f640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f264410c110 0x7f264419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.281+0000 7f2648f9f640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f26300a2da0 0x7f26300a5260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.281+0000 7f2648f9f640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26441035e0 0x7f2644198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.281+0000 7f2648f9f640 1 --2- 172.21.15.59:0/370868363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2644102cc0 0x7f2644198420 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.281+0000 7f2648f9f640 1 -- 172.21.15.59:0/370868363 >> 172.21.15.59:0/370868363 conn(0x7f26440fc6b0 msgr2=0x7f26440fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.281+0000 7f2648f9f640 1 -- 172.21.15.59:0/370868363 shutdown_connections 2024-09-10T11:09:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:19.281+0000 7f2648f9f640 1 -- 172.21.15.59:0/370868363 wait complete. 2024-09-10T11:09:19.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:19 smithi115 ceph-mon[34719]: pgmap v246: 97 pgs: 97 active+clean; 2.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-09-10T11:09:20.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:19 smithi059 ceph-mon[30978]: pgmap v246: 97 pgs: 97 active+clean; 2.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-09-10T11:09:20.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:19 smithi181 ceph-mon[35409]: pgmap v246: 97 pgs: 97 active+clean; 2.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-09-10T11:09:21.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:21 smithi115 ceph-mon[34719]: pgmap v247: 97 pgs: 97 active+clean; 2.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:09:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:21 smithi059 ceph-mon[30978]: pgmap v247: 97 pgs: 97 active+clean; 2.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:09:22.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:21 smithi181 ceph-mon[35409]: pgmap v247: 97 pgs: 97 active+clean; 2.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:09:23.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:23 smithi115 ceph-mon[34719]: pgmap v248: 97 pgs: 97 active+clean; 2.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:09:23.989 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:23 smithi181 ceph-mon[35409]: pgmap v248: 97 pgs: 97 active+clean; 2.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:09:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:23 smithi059 ceph-mon[30978]: pgmap v248: 97 pgs: 97 active+clean; 2.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:09:25.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:25 smithi115 ceph-mon[34719]: pgmap v249: 97 pgs: 97 active+clean; 2.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:09:26.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:25 smithi059 ceph-mon[30978]: pgmap v249: 97 pgs: 97 active+clean; 2.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:09:26.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:25 smithi181 ceph-mon[35409]: pgmap v249: 97 pgs: 97 active+clean; 2.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:09:27.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:27 smithi115 ceph-mon[34719]: pgmap v250: 97 pgs: 97 active+clean; 2.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 42 KiB/s wr, 11 op/s 2024-09-10T11:09:28.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:27 smithi059 ceph-mon[30978]: pgmap v250: 97 pgs: 97 active+clean; 2.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 42 KiB/s wr, 11 op/s 2024-09-10T11:09:28.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:27 smithi181 ceph-mon[35409]: pgmap v250: 97 pgs: 97 active+clean; 2.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 42 KiB/s wr, 11 op/s 2024-09-10T11:09:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:29 smithi059 ceph-mon[30978]: pgmap v251: 97 pgs: 97 active+clean; 2.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:09:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:29 smithi181 ceph-mon[35409]: pgmap v251: 97 pgs: 97 active+clean; 2.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:09:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:29 smithi115 ceph-mon[34719]: pgmap v251: 97 pgs: 97 active+clean; 2.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:09:31.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:30 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:09:31.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:30 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:09:31.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:30 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:09:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:31 smithi059 ceph-mon[30978]: pgmap v252: 97 pgs: 97 active+clean; 2.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:09:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:09:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:09:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:31 smithi181 ceph-mon[35409]: pgmap v252: 97 pgs: 97 active+clean; 2.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:09:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:09:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:09:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:31 smithi115 ceph-mon[34719]: pgmap v252: 97 pgs: 97 active+clean; 2.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:09:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:09:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:09:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.381+0000 7f42128af640 1 -- 172.21.15.59:0/1708471089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c101ac0 msgr2=0x7f420c101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.381+0000 7f42128af640 1 --2- 172.21.15.59:0/1708471089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c101ac0 0x7f420c101f20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4200009930 tx=0x7f420002a420 comp rx=0 tx=0).stop 2024-09-10T11:09:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.381+0000 7f42128af640 1 -- 172.21.15.59:0/1708471089 shutdown_connections 2024-09-10T11:09:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.381+0000 7f42128af640 1 --2- 172.21.15.59:0/1708471089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f420c102460 0x7f420c10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.381+0000 7f42128af640 1 --2- 172.21.15.59:0/1708471089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c101ac0 0x7f420c101f20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.381+0000 7f42128af640 1 --2- 172.21.15.59:0/1708471089 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f420c107ad0 0x7f420c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.381+0000 7f42128af640 1 -- 172.21.15.59:0/1708471089 >> 172.21.15.59:0/1708471089 conn(0x7f420c0fd7e0 msgr2=0x7f420c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.381+0000 7f42128af640 1 -- 172.21.15.59:0/1708471089 shutdown_connections 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.381+0000 7f42128af640 1 -- 172.21.15.59:0/1708471089 wait complete. 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.382+0000 7f42128af640 1 Processor -- start 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.382+0000 7f42128af640 1 -- start start 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.382+0000 7f42128af640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f420c101ac0 0x7f420c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f42128af640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f420c102460 0x7f420c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f42128af640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c107ad0 0x7f420c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f42128af640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f420c111f20 con 0x7f420c107ad0 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f42128af640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f420c111da0 con 0x7f420c102460 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f42128af640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1120a0 con 0x7f420c101ac0 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f4210e4c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c107ad0 0x7f420c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f4210e4c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c107ad0 0x7f420c19cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58604/0 (socket says 172.21.15.59:58604) 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f4210e4c640 1 -- 172.21.15.59:0/2380895937 learned_addr learned my addr 172.21.15.59:0/2380895937 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f420bfff640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f420c101ac0 0x7f420c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f420b7fe640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f420c102460 0x7f420c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f4210e4c640 1 -- 172.21.15.59:0/2380895937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f420c101ac0 msgr2=0x7f420c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f4210e4c640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f420c101ac0 0x7f420c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f4210e4c640 1 -- 172.21.15.59:0/2380895937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f420c102460 msgr2=0x7f420c198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f4210e4c640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f420c102460 0x7f420c198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f4210e4c640 1 -- 172.21.15.59:0/2380895937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c19d340 con 0x7f420c107ad0 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f4210e4c640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c107ad0 0x7f420c19cc10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f420400eaa0 tx=0x7f420400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f42097fa640 1 -- 172.21.15.59:0/2380895937 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420400cdb0 con 0x7f420c107ad0 2024-09-10T11:09:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f42097fa640 1 -- 172.21.15.59:0/2380895937 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4204005020 con 0x7f420c107ad0 2024-09-10T11:09:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f42097fa640 1 -- 172.21.15.59:0/2380895937 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42040116b0 con 0x7f420c107ad0 2024-09-10T11:09:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.383+0000 7f42128af640 1 -- 172.21.15.59:0/2380895937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420c19d630 con 0x7f420c107ad0 2024-09-10T11:09:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.384+0000 7f42128af640 1 -- 172.21.15.59:0/2380895937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f420c1a4ec0 con 0x7f420c107ad0 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.386+0000 7f42097fa640 1 -- 172.21.15.59:0/2380895937 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4204005560 con 0x7f420c107ad0 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.386+0000 7f421563d740 1 Processor -- start 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.386+0000 7f421563d740 1 -- start start 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f421563d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790013af0 0x555790013ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f421563d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790014410 0x55579001e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f421563d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55579001ecb0 0x5557900210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f421563d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55578ff782f0 con 0x55579001ecb0 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f421563d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55578ff20270 con 0x555790014410 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f421563d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55578ff742b0 con 0x555790013af0 2024-09-10T11:09:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f42097fa640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f41f40a2e20 0x7f41f40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55579001ecb0 0x5557900210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55579001ecb0 0x5557900210a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58614/0 (socket says 172.21.15.59:58614) 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 -- 172.21.15.59:0/1389645189 learned_addr learned my addr 172.21.15.59:0/1389645189 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f4210e4c640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f41f40a2e20 0x7f41f40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420bfff640 1 --2- 172.21.15.59:0/1389645189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790014410 0x55579001e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 --2- 172.21.15.59:0/1389645189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790013af0 0x555790013ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f42097fa640 1 -- 172.21.15.59:0/2380895937 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f42040cf7a0 con 0x7f420c107ad0 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 -- 172.21.15.59:0/1389645189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790013af0 msgr2=0x555790013ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 --2- 172.21.15.59:0/1389645189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790013af0 0x555790013ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 -- 172.21.15.59:0/1389645189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790014410 msgr2=0x55579001e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 --2- 172.21.15.59:0/1389645189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790014410 0x55579001e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 -- 172.21.15.59:0/1389645189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55578ff1f340 con 0x55579001ecb0 2024-09-10T11:09:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f420b7fe640 1 --2- 172.21.15.59:0/1389645189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55579001ecb0 0x5557900210a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f420002a940 tx=0x7f4200000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38da60372e5cf429 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.387+0000 7f4210e4c640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f41f40a2e20 0x7f41f40a52e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42040ccd50 tx=0x7f420406d040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f41f27fc640 1 -- 172.21.15.59:0/1389645189 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200035040 con 0x55579001ecb0 2024-09-10T11:09:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f41f27fc640 1 -- 172.21.15.59:0/1389645189 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4200045070 con 0x55579001ecb0 2024-09-10T11:09:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f41f27fc640 1 -- 172.21.15.59:0/1389645189 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200031a70 con 0x55579001ecb0 2024-09-10T11:09:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f421563d740 1 -- 172.21.15.59:0/1389645189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55579001ecb0 msgr2=0x5557900210a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f421563d740 1 --2- 172.21.15.59:0/1389645189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55579001ecb0 0x5557900210a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f420002a940 tx=0x7f4200000bc0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f421563d740 1 -- 172.21.15.59:0/1389645189 shutdown_connections 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f421563d740 1 --2- 172.21.15.59:0/1389645189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55579001ecb0 0x5557900210a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f421563d740 1 --2- 172.21.15.59:0/1389645189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790014410 0x55579001e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f421563d740 1 --2- 172.21.15.59:0/1389645189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790013af0 0x555790013ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f421563d740 1 -- 172.21.15.59:0/1389645189 >> 172.21.15.59:0/1389645189 conn(0x555790010060 msgr2=0x555790010440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f421563d740 1 -- 172.21.15.59:0/1389645189 shutdown_connections 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.388+0000 7f421563d740 1 -- 172.21.15.59:0/1389645189 wait complete. 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f421563d740 1 -- start start 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f421563d740 1 Processor -- start 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f421563d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790013af0 0x55579001bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f421563d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x55579001c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f421563d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 0x55579001c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f421563d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555790021880 con 0x555790014410 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f421563d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55578ff01290 con 0x555790013af0 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f421563d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x555790021a00 con 0x55579001ecb0 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f421563d740 10 client.0 _ll_register_callbacks cb 0x55578ff32140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f420bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x55579001c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.389+0000 7f420bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x55579001c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58618/0 (socket says 172.21.15.59:58618) 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420bfff640 1 -- 172.21.15.59:0/938542721 learned_addr learned my addr 172.21.15.59:0/938542721 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420b7fe640 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790013af0 0x55579001bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420b7fe640 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 0x55579001c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420bfff640 1 -- 172.21.15.59:0/938542721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 msgr2=0x55579001c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420bfff640 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 0x55579001c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420bfff640 1 -- 172.21.15.59:0/938542721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790013af0 msgr2=0x55579001bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420bfff640 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790013af0 0x55579001bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420bfff640 1 -- 172.21.15.59:0/938542721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55578fc8b210 con 0x555790014410 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420b7fe640 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 0x55579001c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f420bfff640 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x55579001c140 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00d9a0 tx=0x7f41fc00de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f5ddb21184ea34 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f41eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f41eb7fe640 1 -- 172.21.15.59:0/938542721 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc01b640 con 0x555790014410 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f41eb7fe640 1 -- 172.21.15.59:0/938542721 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f41fc011440 con 0x555790014410 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f421563d740 1 -- 172.21.15.59:0/938542721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4200045070 con 0x555790014410 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f41eb7fe640 1 -- 172.21.15.59:0/938542721 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f41fc003e40 con 0x555790014410 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f421563d740 10 client.15909 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.390+0000 7f421563d740 1 -- 172.21.15.59:0/938542721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55578fd57620 con 0x555790014410 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.391+0000 7f41eb7fe640 1 -- 172.21.15.59:0/938542721 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4200045070 con 0x555790014410 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.391+0000 7f41eb7fe640 1 -- 172.21.15.59:0/938542721 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f41fc019020 con 0x555790014410 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.391+0000 7f421563d740 10 client.15909 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.391+0000 7f421563d740 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.391+0000 7f421563d740 20 client.15909 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.391+0000 7f421563d740 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55579002ed30 0x555790031120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.391+0000 7f421563d740 4 client.15909 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.391+0000 7f421563d740 1 -- 172.21.15.59:0/938542721 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55578ff85a20 con 0x55579002ed30 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.391+0000 7f420b7fe640 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55579002ed30 0x555790031120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.392+0000 7f41eb7fe640 10 client.15909 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.392+0000 7f420b7fe640 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55579002ed30 0x555790031120 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e005b220abcfd6d2 server_cookie=e6fc927683f8b8d3 in_seq=0 out_seq=0 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.392+0000 7f41eb7fe640 1 -- 172.21.15.59:0/938542721 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55578ff85a20 con 0x55579002ed30 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.392+0000 7f41eb7fe640 10 client.15909 handle_command_reply: tid=0 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.392+0000 7f421563d740 1 client.15909 shutdown 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 -- 172.21.15.59:0/938542721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 msgr2=0x55579001c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x55579001c140 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00d9a0 tx=0x7f41fc00de60 comp rx=0 tx=0).stop 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 -- 172.21.15.59:0/938542721 shutdown_connections 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55579002ed30 0x555790031120 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 0x55579001c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f41eb7fe640 0 client.15909 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x55579001c140 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 --2- 172.21.15.59:0/938542721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790013af0 0x55579001bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 -- 172.21.15.59:0/938542721 >> 172.21.15.59:0/938542721 conn(0x555790010060 msgr2=0x555790015d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 -- 172.21.15.59:0/938542721 shutdown_connections 2024-09-10T11:09:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 1 -- 172.21.15.59:0/938542721 wait complete. 2024-09-10T11:09:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.393+0000 7f421563d740 20 client.15909 trim_cache size 0 max 16384 2024-09-10T11:09:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.407+0000 7f421563d740 1 Processor -- start 2024-09-10T11:09:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.407+0000 7f421563d740 1 -- start start 2024-09-10T11:09:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f421563d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790013af0 0x55579001c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f421563d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x555790036a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f421563d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 0x555790036f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f421563d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1b0240 con 0x555790014410 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f421563d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1adb10 con 0x555790013af0 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f421563d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1ab980 con 0x55579001ecb0 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f420bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x555790036a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f420bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x555790036a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58620/0 (socket says 172.21.15.59:58620) 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f420bfff640 1 -- 172.21.15.59:0/1253695658 learned_addr learned my addr 172.21.15.59:0/1253695658 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f420bfff640 1 -- 172.21.15.59:0/1253695658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 msgr2=0x555790036f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f420bfff640 1 --2- 172.21.15.59:0/1253695658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 0x555790036f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f420bfff640 1 -- 172.21.15.59:0/1253695658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790013af0 msgr2=0x55579001c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f420bfff640 1 --2- 172.21.15.59:0/1253695658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790013af0 0x55579001c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f420bfff640 1 -- 172.21.15.59:0/1253695658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555790014240 con 0x555790014410 2024-09-10T11:09:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f420bfff640 1 --2- 172.21.15.59:0/1253695658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x555790036a30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f41fc011d00 tx=0x7f41fc004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c284ed3c40b3b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f41f1ffb640 1 -- 172.21.15.59:0/1253695658 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc027040 con 0x555790014410 2024-09-10T11:09:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f41f1ffb640 1 -- 172.21.15.59:0/1253695658 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41fc011920 con 0x555790014410 2024-09-10T11:09:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.408+0000 7f41f1ffb640 1 -- 172.21.15.59:0/1253695658 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc022c20 con 0x555790014410 2024-09-10T11:09:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 -- 172.21.15.59:0/1253695658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 msgr2=0x555790036a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 --2- 172.21.15.59:0/1253695658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x555790036a30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f41fc011d00 tx=0x7f41fc004280 comp rx=0 tx=0).stop 2024-09-10T11:09:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 -- 172.21.15.59:0/1253695658 shutdown_connections 2024-09-10T11:09:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 --2- 172.21.15.59:0/1253695658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55579001ecb0 0x555790036f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 --2- 172.21.15.59:0/1253695658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790014410 0x555790036a30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 --2- 172.21.15.59:0/1253695658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555790013af0 0x55579001c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 -- 172.21.15.59:0/1253695658 >> 172.21.15.59:0/1253695658 conn(0x555790010060 msgr2=0x55579001dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 -- 172.21.15.59:0/1253695658 shutdown_connections 2024-09-10T11:09:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 -- 172.21.15.59:0/1253695658 wait complete. 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.409+0000 7f421563d740 1 -- start start 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f421563d740 1 Processor -- start 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f421563d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790013af0 0x555790027490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f421563d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790014410 0x5557900227b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f421563d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55579001ecb0 0x555790022cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f421563d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1abfd0 con 0x555790013af0 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f421563d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1ad440 con 0x55579001ecb0 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f421563d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1ac6a0 con 0x555790014410 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f421563d740 10 client.0 _ll_register_callbacks cb 0x7f41fc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790013af0 0x555790027490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790013af0 0x555790027490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58632/0 (socket says 172.21.15.59:58632) 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420b7fe640 1 -- 172.21.15.59:0/2582901492 learned_addr learned my addr 172.21.15.59:0/2582901492 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420bfff640 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790014410 0x5557900227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420b7fe640 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55579001ecb0 0x555790022cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420b7fe640 1 -- 172.21.15.59:0/2582901492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790014410 msgr2=0x5557900227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420b7fe640 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790014410 0x5557900227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420b7fe640 1 -- 172.21.15.59:0/2582901492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55579001ecb0 msgr2=0x555790022cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420b7fe640 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55579001ecb0 0x555790022cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420b7fe640 1 -- 172.21.15.59:0/2582901492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555790023520 con 0x555790013af0 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.410+0000 7f420bfff640 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790014410 0x5557900227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f420b7fe640 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790013af0 0x555790027490 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x555790016690 tx=0x7f420002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fcc71102f0fa0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f41eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f41eb7fe640 1 -- 172.21.15.59:0/2582901492 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200035040 con 0x555790013af0 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f41eb7fe640 1 -- 172.21.15.59:0/2582901492 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f4200031830 con 0x555790013af0 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f421563d740 1 -- 172.21.15.59:0/2582901492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41fc011920 con 0x555790013af0 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f41eb7fe640 1 -- 172.21.15.59:0/2582901492 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4200031a30 con 0x555790013af0 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f421563d740 10 client.15915 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f421563d740 1 -- 172.21.15.59:0/2582901492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555790099a70 con 0x555790013af0 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f41eb7fe640 1 -- 172.21.15.59:0/2582901492 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41fc011920 con 0x555790013af0 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f41eb7fe640 1 -- 172.21.15.59:0/2582901492 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f420003a070 con 0x555790013af0 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f421563d740 10 client.15915 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f421563d740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f421563d740 20 client.15915 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f421563d740 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55579009a120 0x55579009c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f421563d740 4 client.15915 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:09:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.411+0000 7f421563d740 1 -- 172.21.15.59:0/2582901492 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55578ff7fd70 con 0x55579009a120 2024-09-10T11:09:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.412+0000 7f420bfff640 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55579009a120 0x55579009c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.412+0000 7f420bfff640 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55579009a120 0x55579009c510 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95531f6cb31dffa server_cookie=4dc4eca040039c9e in_seq=0 out_seq=0 2024-09-10T11:09:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.412+0000 7f41eb7fe640 10 client.15915 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f41eb7fe640 1 -- 172.21.15.59:0/2582901492 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55578ff7fd70 con 0x55579009a120 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f41eb7fe640 10 client.15915 handle_command_reply: tid=0 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f421563d740 1 client.15915 shutdown 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f421563d740 1 -- 172.21.15.59:0/2582901492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790013af0 msgr2=0x555790027490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f421563d740 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790013af0 0x555790027490 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x555790016690 tx=0x7f420002a420 comp rx=0 tx=0).stop 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f421563d740 1 -- 172.21.15.59:0/2582901492 shutdown_connections 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f421563d740 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55579009a120 0x55579009c510 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f421563d740 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55579001ecb0 0x555790022cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f421563d740 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555790014410 0x5557900227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f41eb7fe640 0 client.15915 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.426+0000 7f421563d740 1 --2- 172.21.15.59:0/2582901492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555790013af0 0x555790027490 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f421563d740 1 -- 172.21.15.59:0/2582901492 >> 172.21.15.59:0/2582901492 conn(0x555790010060 msgr2=0x555790015550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:32.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f421563d740 1 -- 172.21.15.59:0/2582901492 shutdown_connections 2024-09-10T11:09:32.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f421563d740 1 -- 172.21.15.59:0/2582901492 wait complete. 2024-09-10T11:09:32.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f421563d740 20 client.15915 trim_cache size 0 max 16384 2024-09-10T11:09:32.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:09:32.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:09:32.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:09:32.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:09:32.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 -- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f41f40a2e20 msgr2=0x7f41f40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:32.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f41f40a2e20 0x7f41f40a52e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42040ccd50 tx=0x7f420406d040 comp rx=0 tx=0).stop 2024-09-10T11:09:32.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 -- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c107ad0 msgr2=0x7f420c19cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c107ad0 0x7f420c19cc10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f420400eaa0 tx=0x7f420400ef60 comp rx=0 tx=0).stop 2024-09-10T11:09:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 -- 172.21.15.59:0/2380895937 shutdown_connections 2024-09-10T11:09:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c107ad0 0x7f420c19cc10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f420c102460 0x7f420c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f41f40a2e20 0x7f41f40a52e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 --2- 172.21.15.59:0/2380895937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f420c101ac0 0x7f420c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 -- 172.21.15.59:0/2380895937 >> 172.21.15.59:0/2380895937 conn(0x7f420c0fd7e0 msgr2=0x7f420c0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 -- 172.21.15.59:0/2380895937 shutdown_connections 2024-09-10T11:09:32.432 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:32.427+0000 7f42128af640 1 -- 172.21.15.59:0/2380895937 wait complete. 2024-09-10T11:09:34.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:33 smithi059 ceph-mon[30978]: pgmap v253: 97 pgs: 97 active+clean; 2.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:34.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:33 smithi181 ceph-mon[35409]: pgmap v253: 97 pgs: 97 active+clean; 2.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:33 smithi115 ceph-mon[34719]: pgmap v253: 97 pgs: 97 active+clean; 2.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:36.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:35 smithi059 ceph-mon[30978]: pgmap v254: 97 pgs: 97 active+clean; 3.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 67 KiB/s wr, 19 op/s 2024-09-10T11:09:36.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:35 smithi181 ceph-mon[35409]: pgmap v254: 97 pgs: 97 active+clean; 3.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 67 KiB/s wr, 19 op/s 2024-09-10T11:09:36.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:35 smithi115 ceph-mon[34719]: pgmap v254: 97 pgs: 97 active+clean; 3.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 67 KiB/s wr, 19 op/s 2024-09-10T11:09:38.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:37 smithi059 ceph-mon[30978]: pgmap v255: 97 pgs: 97 active+clean; 3.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-09-10T11:09:38.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:37 smithi181 ceph-mon[35409]: pgmap v255: 97 pgs: 97 active+clean; 3.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-09-10T11:09:38.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:37 smithi115 ceph-mon[34719]: pgmap v255: 97 pgs: 97 active+clean; 3.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-09-10T11:09:40.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:39 smithi059 ceph-mon[30978]: pgmap v256: 97 pgs: 97 active+clean; 3.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:09:40.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:39 smithi181 ceph-mon[35409]: pgmap v256: 97 pgs: 97 active+clean; 3.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:09:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:39 smithi115 ceph-mon[34719]: pgmap v256: 97 pgs: 97 active+clean; 3.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:09:42.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:41 smithi059 ceph-mon[30978]: pgmap v257: 97 pgs: 97 active+clean; 3.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:09:42.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:41 smithi181 ceph-mon[35409]: pgmap v257: 97 pgs: 97 active+clean; 3.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:09:42.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:41 smithi115 ceph-mon[34719]: pgmap v257: 97 pgs: 97 active+clean; 3.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:09:44.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:43 smithi059 ceph-mon[30978]: pgmap v258: 97 pgs: 97 active+clean; 3.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:09:44.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:43 smithi181 ceph-mon[35409]: pgmap v258: 97 pgs: 97 active+clean; 3.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:09:44.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:43 smithi115 ceph-mon[34719]: pgmap v258: 97 pgs: 97 active+clean; 3.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:09:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/4089768753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e4102d80 msgr2=0x7fb5e4103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/4089768753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e4102d80 0x7fb5e4103160 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009900 tx=0x7fb5e002a480 comp rx=0 tx=0).stop 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/4089768753 shutdown_connections 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/4089768753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e410c150 0x7fb5e410e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/4089768753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5e41036a0 0x7fb5e410bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/4089768753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e4102d80 0x7fb5e4103160 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/4089768753 >> 172.21.15.59:0/4089768753 conn(0x7fb5e40fc6b0 msgr2=0x7fb5e40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/4089768753 shutdown_connections 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/4089768753 wait complete. 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 Processor -- start 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.527+0000 7fb5ec0ae640 1 -- start start 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5ec0ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5e4102d80 0x7fb5e4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5ec0ae640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e41036a0 0x7fb5e4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5ec0ae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e410c150 0x7fb5e419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5ec0ae640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4111ef0 con 0x7fb5e41036a0 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5ec0ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4111d70 con 0x7fb5e4102d80 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5ec0ae640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4112070 con 0x7fb5e410c150 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9649640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e41036a0 0x7fb5e4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9649640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e41036a0 0x7fb5e4198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49490/0 (socket says 172.21.15.59:49490) 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9649640 1 -- 172.21.15.59:0/3718756509 learned_addr learned my addr 172.21.15.59:0/3718756509 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e410c150 0x7fb5e419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5e4102d80 0x7fb5e4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9649640 1 -- 172.21.15.59:0/3718756509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e410c150 msgr2=0x7fb5e419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9649640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e410c150 0x7fb5e419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9649640 1 -- 172.21.15.59:0/3718756509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5e4102d80 msgr2=0x7fb5e4198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9649640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5e4102d80 0x7fb5e4198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9649640 1 -- 172.21.15.59:0/3718756509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e419d2f0 con 0x7fb5e41036a0 2024-09-10T11:09:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.528+0000 7fb5e9649640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e41036a0 0x7fb5e4198840 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c920 tx=0x7fb5d400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.529+0000 7fb5daffd640 1 -- 172.21.15.59:0/3718756509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4007c70 con 0x7fb5e41036a0 2024-09-10T11:09:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.529+0000 7fb5daffd640 1 -- 172.21.15.59:0/3718756509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5d4007e10 con 0x7fb5e41036a0 2024-09-10T11:09:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.529+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/3718756509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e419d5e0 con 0x7fb5e41036a0 2024-09-10T11:09:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.529+0000 7fb5daffd640 1 -- 172.21.15.59:0/3718756509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4018890 con 0x7fb5e41036a0 2024-09-10T11:09:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.529+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/3718756509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e41a4e70 con 0x7fb5e41036a0 2024-09-10T11:09:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.531+0000 7fb5daffd640 1 -- 172.21.15.59:0/3718756509 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb5d4018a70 con 0x7fb5e41036a0 2024-09-10T11:09:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.531+0000 7fb5eee48740 1 Processor -- start 2024-09-10T11:09:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5eee48740 1 -- start start 2024-09-10T11:09:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9de9d0 0x5618ab9dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618ab9edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5eee48740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5618ab9432f0 con 0x5618ab9de9d0 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5eee48740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5618ab8eb270 con 0x5618ab9df2f0 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5eee48740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5618ab93f2b0 con 0x5618ab9ee0c0 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5ea64b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9de9d0 0x5618ab9dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5ea64b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9de9d0 0x5618ab9dedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49502/0 (socket says 172.21.15.59:49502) 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5ea64b640 1 -- 172.21.15.59:0/1733492149 learned_addr learned my addr 172.21.15.59:0/1733492149 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5daffd640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb5d00a2da0 0x7fb5d00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/1733492149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618ab9edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5e9649640 1 --2- 172.21.15.59:0/1733492149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.532+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb5d00a2da0 0x7fb5d00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5ea64b640 1 -- 172.21.15.59:0/1733492149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9ee0c0 msgr2=0x5618ab9f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/1733492149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5ea64b640 1 -- 172.21.15.59:0/1733492149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 msgr2=0x5618ab9edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/1733492149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618ab9edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5ea64b640 1 -- 172.21.15.59:0/1733492149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618ab8ea340 con 0x5618ab9de9d0 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5daffd640 1 -- 172.21.15.59:0/3718756509 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7fb5d40cf6a0 con 0x7fb5e41036a0 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/1733492149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9de9d0 0x5618ab9dedb0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc012840 tx=0x7fb5dc012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e5be998ef2f431 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5cffff640 1 -- 172.21.15.59:0/1733492149 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc003d40 con 0x5618ab9de9d0 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5cffff640 1 -- 172.21.15.59:0/1733492149 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5dc004500 con 0x5618ab9de9d0 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.533+0000 7fb5cffff640 1 -- 172.21.15.59:0/1733492149 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc01c7f0 con 0x5618ab9de9d0 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 -- 172.21.15.59:0/1733492149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9de9d0 msgr2=0x5618ab9dedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 --2- 172.21.15.59:0/1733492149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9de9d0 0x5618ab9dedb0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc012840 tx=0x7fb5dc012d00 comp rx=0 tx=0).stop 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb5d00a2da0 0x7fb5d00a5260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc01f000 tx=0x7fb5dc01e000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 -- 172.21.15.59:0/1733492149 shutdown_connections 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 --2- 172.21.15.59:0/1733492149 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 --2- 172.21.15.59:0/1733492149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618ab9edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 --2- 172.21.15.59:0/1733492149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9de9d0 0x5618ab9dedb0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 -- 172.21.15.59:0/1733492149 >> 172.21.15.59:0/1733492149 conn(0x5618ab9db060 msgr2=0x5618ab9db440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 -- 172.21.15.59:0/1733492149 shutdown_connections 2024-09-10T11:09:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 -- 172.21.15.59:0/1733492149 wait complete. 2024-09-10T11:09:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.534+0000 7fb5eee48740 1 -- start start 2024-09-10T11:09:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5eee48740 1 Processor -- start 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9df2f0 0x5618ab9eb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9ee0c0 0x5618ab9eba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5eee48740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5618ab9f0cf0 con 0x5618ab9df2f0 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5eee48740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5618ab8cc290 con 0x5618ab9ee0c0 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5eee48740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5618ab9f0e70 con 0x5618ab9de9d0 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5eee48740 10 client.0 _ll_register_callbacks cb 0x5618ab8fd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5e9649640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9df2f0 0x5618ab9eb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5e9649640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9df2f0 0x5618ab9eb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49512/0 (socket says 172.21.15.59:49512) 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5e9649640 1 -- 172.21.15.59:0/502669263 learned_addr learned my addr 172.21.15.59:0/502669263 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.535+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9ee0c0 0x5618ab9eba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5e9649640 1 -- 172.21.15.59:0/502669263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 msgr2=0x5618ab9eafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5e9649640 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9eafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5e9649640 1 -- 172.21.15.59:0/502669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9ee0c0 msgr2=0x5618ab9eba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5e9649640 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9ee0c0 0x5618ab9eba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5e9649640 1 -- 172.21.15.59:0/502669263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618ab656210 con 0x5618ab9df2f0 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9eafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9ee0c0 0x5618ab9eba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5e9649640 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9df2f0 0x5618ab9eb520 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40cce00 tx=0x7fb5d409b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718552be89e32341 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/502669263 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400de20 con 0x5618ab9df2f0 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/502669263 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7fb5d40981e0 con 0x5618ab9df2f0 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5eee48740 1 -- 172.21.15.59:0/502669263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5dc004500 con 0x5618ab9df2f0 2024-09-10T11:09:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/502669263 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb5d409ff20 con 0x5618ab9df2f0 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5eee48740 10 client.15927 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5eee48740 1 -- 172.21.15.59:0/502669263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5618ab722620 con 0x5618ab9df2f0 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.536+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/502669263 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5dc004500 con 0x5618ab9df2f0 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.537+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/502669263 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb5d40cfb50 con 0x5618ab9df2f0 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.537+0000 7fb5eee48740 10 client.15927 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.537+0000 7fb5eee48740 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.537+0000 7fb5eee48740 20 client.15927 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.537+0000 7fb5eee48740 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5618ab9fe110 0x5618aba00500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.537+0000 7fb5eee48740 4 client.15927 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.537+0000 7fb5eee48740 1 -- 172.21.15.59:0/502669263 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618ab950a20 con 0x5618ab9fe110 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.537+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5618ab9fe110 0x5618aba00500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.538+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5618ab9fe110 0x5618aba00500 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d972dac2a133bd7 server_cookie=5d7ab757d14c6dec in_seq=0 out_seq=0 2024-09-10T11:09:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.538+0000 7fb5cd7fa640 10 client.15927 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.538+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/502669263 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618ab950a20 con 0x5618ab9fe110 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.538+0000 7fb5cd7fa640 10 client.15927 handle_command_reply: tid=0 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.538+0000 7fb5eee48740 1 client.15927 shutdown 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 -- 172.21.15.59:0/502669263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9df2f0 msgr2=0x5618ab9eb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9df2f0 0x5618ab9eb520 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40cce00 tx=0x7fb5d409b590 comp rx=0 tx=0).stop 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 -- 172.21.15.59:0/502669263 shutdown_connections 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5618ab9fe110 0x5618aba00500 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9ee0c0 0x5618ab9eba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9df2f0 0x5618ab9eb520 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 --2- 172.21.15.59:0/502669263 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9eafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5cd7fa640 0 client.15927 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 -- 172.21.15.59:0/502669263 >> 172.21.15.59:0/502669263 conn(0x5618ab9db060 msgr2=0x5618ab9e0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 -- 172.21.15.59:0/502669263 shutdown_connections 2024-09-10T11:09:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 1 -- 172.21.15.59:0/502669263 wait complete. 2024-09-10T11:09:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.539+0000 7fb5eee48740 20 client.15927 trim_cache size 0 max 16384 2024-09-10T11:09:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5eee48740 1 Processor -- start 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5eee48740 1 -- start start 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618aba05e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618aba06350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5eee48740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e41ae020 con 0x5618ab9ee0c0 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5eee48740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e41ab8f0 con 0x5618ab9df2f0 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5eee48740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e41a9780 con 0x5618ab9de9d0 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5ea64b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618aba06350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5ea64b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618aba06350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49518/0 (socket says 172.21.15.59:49518) 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5ea64b640 1 -- 172.21.15.59:0/295102139 learned_addr learned my addr 172.21.15.59:0/295102139 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5e9649640 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618aba05e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5ea64b640 1 -- 172.21.15.59:0/295102139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 msgr2=0x5618ab9ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9ecf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5ea64b640 1 -- 172.21.15.59:0/295102139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 msgr2=0x5618aba05e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618aba05e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5ea64b640 1 -- 172.21.15.59:0/295102139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618aba00870 con 0x5618ab9ee0c0 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5e9649640 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618aba05e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.554+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618aba06350 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc012760 tx=0x7fb5dc00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f8621a82035200 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5cf7fe640 1 -- 172.21.15.59:0/295102139 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc008d90 con 0x5618ab9ee0c0 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5cf7fe640 1 -- 172.21.15.59:0/295102139 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5dc02c070 con 0x5618ab9ee0c0 2024-09-10T11:09:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5cf7fe640 1 -- 172.21.15.59:0/295102139 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc025bb0 con 0x5618ab9ee0c0 2024-09-10T11:09:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5eee48740 1 -- 172.21.15.59:0/295102139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 msgr2=0x5618aba06350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5eee48740 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618aba06350 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc012760 tx=0x7fb5dc00e000 comp rx=0 tx=0).stop 2024-09-10T11:09:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5eee48740 1 -- 172.21.15.59:0/295102139 shutdown_connections 2024-09-10T11:09:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5eee48740 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618aba06350 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5eee48740 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618aba05e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5eee48740 1 --2- 172.21.15.59:0/295102139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5eee48740 1 -- 172.21.15.59:0/295102139 >> 172.21.15.59:0/295102139 conn(0x5618ab9db060 msgr2=0x5618ab9ec840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5eee48740 1 -- 172.21.15.59:0/295102139 shutdown_connections 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.555+0000 7fb5eee48740 1 -- 172.21.15.59:0/295102139 wait complete. 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5eee48740 1 -- start start 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5eee48740 1 Processor -- start 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9f6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618ab9f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5eee48740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5eee48740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e41a9dd0 con 0x5618ab9ee0c0 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5eee48740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e41ab220 con 0x5618ab9df2f0 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5eee48740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e41aa480 con 0x5618ab9de9d0 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5eee48740 10 client.0 _ll_register_callbacks cb 0x7fb5d400fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5ea64b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5ea64b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49532/0 (socket says 172.21.15.59:49532) 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5ea64b640 1 -- 172.21.15.59:0/613979636 learned_addr learned my addr 172.21.15.59:0/613979636 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.556+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5e9649640 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618ab9f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5ea64b640 1 -- 172.21.15.59:0/613979636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 msgr2=0x5618ab9f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5ea64b640 1 -- 172.21.15.59:0/613979636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 msgr2=0x5618ab9f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618ab9f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5ea64b640 1 -- 172.21.15.59:0/613979636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618ab9df120 con 0x5618ab9ee0c0 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5ea64b640 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f1fb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc008c80 tx=0x7fb5dc0258d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321a01e3ca7cee99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/613979636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc025cd0 con 0x5618ab9ee0c0 2024-09-10T11:09:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/613979636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7fb5dc021040 con 0x5618ab9ee0c0 2024-09-10T11:09:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5eee48740 1 -- 172.21.15.59:0/613979636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5dc02c070 con 0x5618ab9ee0c0 2024-09-10T11:09:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/613979636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb5dc041020 con 0x5618ab9ee0c0 2024-09-10T11:09:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5eee48740 10 client.15933 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5eee48740 1 -- 172.21.15.59:0/613979636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5618aba68b00 con 0x5618ab9ee0c0 2024-09-10T11:09:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.557+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/613979636 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5dc02c070 con 0x5618ab9ee0c0 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/613979636 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb5dc03da10 con 0x5618ab9ee0c0 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5eee48740 10 client.15933 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5eee48740 10 client.15933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5eee48740 20 client.15933 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5eee48740 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5618aba69010 0x5618aba6b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5eee48740 4 client.15933 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5eee48740 1 -- 172.21.15.59:0/613979636 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618ab94ad70 con 0x5618aba69010 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5618aba69010 0x5618aba6b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5e9e4a640 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5618aba69010 0x5618aba6b400 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d668da19a1f470d server_cookie=2369f2197383af7f in_seq=0 out_seq=0 2024-09-10T11:09:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.558+0000 7fb5cd7fa640 10 client.15933 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5cd7fa640 1 -- 172.21.15.59:0/613979636 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618ab94ad70 con 0x5618aba69010 2024-09-10T11:09:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5cd7fa640 10 client.15933 handle_command_reply: tid=0 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5eee48740 1 client.15933 shutdown 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5eee48740 1 -- 172.21.15.59:0/613979636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 msgr2=0x5618ab9f1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5eee48740 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f1fb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc008c80 tx=0x7fb5dc0258d0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5eee48740 1 -- 172.21.15.59:0/613979636 shutdown_connections 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5eee48740 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5618aba69010 0x5618aba6b400 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5eee48740 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618ab9ee0c0 0x5618ab9f1fb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5eee48740 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618ab9df2f0 0x5618ab9f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5eee48740 1 --2- 172.21.15.59:0/613979636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618ab9de9d0 0x5618ab9f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5cd7fa640 0 client.15933 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.571+0000 7fb5eee48740 1 -- 172.21.15.59:0/613979636 >> 172.21.15.59:0/613979636 conn(0x5618ab9db060 msgr2=0x5618ab9e9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5eee48740 1 -- 172.21.15.59:0/613979636 shutdown_connections 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5eee48740 1 -- 172.21.15.59:0/613979636 wait complete. 2024-09-10T11:09:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5eee48740 20 client.15933 trim_cache size 0 max 16384 2024-09-10T11:09:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:09:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:09:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:09:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb5d00a2da0 msgr2=0x7fb5d00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb5d00a2da0 0x7fb5d00a5260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc01f000 tx=0x7fb5dc01e000 comp rx=0 tx=0).stop 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e41036a0 msgr2=0x7fb5e4198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e41036a0 0x7fb5e4198840 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c920 tx=0x7fb5d400cde0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/3718756509 shutdown_connections 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fb5d00a2da0 0x7fb5d00a5260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5e410c150 0x7fb5e419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e41036a0 0x7fb5e4198840 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 --2- 172.21.15.59:0/3718756509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5e4102d80 0x7fb5e4198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/3718756509 >> 172.21.15.59:0/3718756509 conn(0x7fb5e40fc6b0 msgr2=0x7fb5e40fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/3718756509 shutdown_connections 2024-09-10T11:09:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:45.572+0000 7fb5ec0ae640 1 -- 172.21.15.59:0/3718756509 wait complete. 2024-09-10T11:09:46.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:45 smithi059 ceph-mon[30978]: pgmap v259: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:09:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:45 smithi181 ceph-mon[35409]: pgmap v259: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:09:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:45 smithi115 ceph-mon[34719]: pgmap v259: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:09:48.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:47 smithi059 ceph-mon[30978]: pgmap v260: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:09:48.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:47 smithi181 ceph-mon[35409]: pgmap v260: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:09:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:47 smithi115 ceph-mon[34719]: pgmap v260: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:09:49.286 INFO:tasks.workunit.client.0.smithi059.stdout:375/600: open fd = 3 2024-09-10T11:09:49.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.286 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.286 INFO:tasks.workunit.client.0.smithi059.stdout:376/600: open fd = 3 2024-09-10T11:09:49.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.286 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:377/600: open fd = 3 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:378/600: open fd = 3 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:379/600: open fd = 3 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.287 INFO:tasks.workunit.client.0.smithi059.stdout:380/600: open fd = 3 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:381/600: open fd = 3 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:382/600: open fd = 3 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.288 INFO:tasks.workunit.client.0.smithi059.stdout:383/600: open fd = 3 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:384/600: open fd = 3 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:385/600: open fd = 3 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:386/600: open fd = 3 2024-09-10T11:09:49.289 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:387/600: open fd = 3 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:388/600: open fd = 3 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:389/600: open fd = 3 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.290 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:390/600: open fd = 3 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:391/600: open fd = 3 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:392/600: open fd = 3 2024-09-10T11:09:49.291 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:393/600: open fd = 3 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:394/600: open fd = 3 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.292 INFO:tasks.workunit.client.0.smithi059.stdout:395/600: open fd = 3 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:396/600: open fd = 3 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:397/600: open fd = 3 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.293 INFO:tasks.workunit.client.0.smithi059.stdout:398/600: open fd = 3 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:399/600: open fd = 3 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:400/600: open fd = 3 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.294 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:401/600: open fd = 3 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:402/600: open fd = 3 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:403/600: open fd = 3 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.295 INFO:tasks.workunit.client.0.smithi059.stdout:404/600: open fd = 3 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:405/600: open fd = 3 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:406/600: open fd = 3 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:407/600: open fd = 3 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.296 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.297 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.297 INFO:tasks.workunit.client.0.smithi059.stdout:408/600: open fd = 3 2024-09-10T11:09:49.297 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.297 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.297 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.297 INFO:tasks.workunit.client.0.smithi059.stdout:409/600: open fd = 3 2024-09-10T11:09:49.297 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.297 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:410/600: open fd = 3 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:411/600: open fd = 3 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:412/600: open fd = 3 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:413/600: open fd = 3 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:414/600: open fd = 3 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:415/600: open fd = 3 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:416/600: open fd = 3 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.299 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:417/600: open fd = 3 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:418/600: open fd = 3 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:419/600: open fd = 3 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.300 INFO:tasks.workunit.client.0.smithi059.stdout:420/600: open fd = 3 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:421/600: open fd = 3 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:422/600: open fd = 3 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:423/600: open fd = 3 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.301 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:424/600: open fd = 3 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:425/600: open fd = 3 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:426/600: open fd = 3 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:427/600: open fd = 3 2024-09-10T11:09:49.302 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:428/600: open fd = 3 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:429/600: open fd = 3 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:430/600: open fd = 3 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.303 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.304 INFO:tasks.workunit.client.0.smithi059.stdout:431/600: open fd = 3 2024-09-10T11:09:49.304 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.304 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.304 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.304 INFO:tasks.workunit.client.0.smithi059.stdout:432/600: open fd = 3 2024-09-10T11:09:49.304 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.304 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.304 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:433/600: open fd = 3 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:434/600: open fd = 3 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:435/600: open fd = 3 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:49.305 INFO:tasks.workunit.client.0.smithi059.stdout:436/600: open fd = 3 2024-09-10T11:09:49.306 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.306 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:09:49.306 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:09:50.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:49 smithi059 ceph-mon[30978]: pgmap v261: 97 pgs: 97 active+clean; 3.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:09:50.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:49 smithi181 ceph-mon[35409]: pgmap v261: 97 pgs: 97 active+clean; 3.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:09:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:49 smithi115 ceph-mon[34719]: pgmap v261: 97 pgs: 97 active+clean; 3.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:09:52.010 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:51 smithi115 ceph-mon[34719]: pgmap v262: 97 pgs: 97 active+clean; 3.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:52.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:51 smithi059 ceph-mon[30978]: pgmap v262: 97 pgs: 97 active+clean; 3.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:52.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:51 smithi181 ceph-mon[35409]: pgmap v262: 97 pgs: 97 active+clean; 3.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:54.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:53 smithi059 ceph-mon[30978]: pgmap v263: 97 pgs: 97 active+clean; 3.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:54.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:53 smithi181 ceph-mon[35409]: pgmap v263: 97 pgs: 97 active+clean; 3.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:54.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:53 smithi115 ceph-mon[34719]: pgmap v263: 97 pgs: 97 active+clean; 3.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:09:56.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:55 smithi059 ceph-mon[30978]: pgmap v264: 97 pgs: 97 active+clean; 3.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 16 op/s 2024-09-10T11:09:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:55 smithi181 ceph-mon[35409]: pgmap v264: 97 pgs: 97 active+clean; 3.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 16 op/s 2024-09-10T11:09:56.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:55 smithi115 ceph-mon[34719]: pgmap v264: 97 pgs: 97 active+clean; 3.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 16 op/s 2024-09-10T11:09:58.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:57 smithi059 ceph-mon[30978]: pgmap v265: 97 pgs: 97 active+clean; 3.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-09-10T11:09:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:57 smithi181 ceph-mon[35409]: pgmap v265: 97 pgs: 97 active+clean; 3.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-09-10T11:09:58.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:57 smithi115 ceph-mon[34719]: pgmap v265: 97 pgs: 97 active+clean; 3.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-09-10T11:09:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.672+0000 7f57e872c640 1 -- 172.21.15.59:0/1275987891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e01009f0 msgr2=0x7f57e0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.672+0000 7f57e872c640 1 --2- 172.21.15.59:0/1275987891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e01009f0 0x7f57e0100e50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009930 tx=0x7f57d002a420 comp rx=0 tx=0).stop 2024-09-10T11:09:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.672+0000 7f57e872c640 1 -- 172.21.15.59:0/1275987891 shutdown_connections 2024-09-10T11:09:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.672+0000 7f57e872c640 1 --2- 172.21.15.59:0/1275987891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57e0101390 0x7f57e010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.672+0000 7f57e872c640 1 --2- 172.21.15.59:0/1275987891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e01009f0 0x7f57e0100e50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.672+0000 7f57e872c640 1 --2- 172.21.15.59:0/1275987891 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57e0106a00 0x7f57e0106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.672+0000 7f57e872c640 1 -- 172.21.15.59:0/1275987891 >> 172.21.15.59:0/1275987891 conn(0x7f57e00fc6b0 msgr2=0x7f57e00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.672+0000 7f57e872c640 1 -- 172.21.15.59:0/1275987891 shutdown_connections 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.672+0000 7f57e872c640 1 -- 172.21.15.59:0/1275987891 wait complete. 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e872c640 1 Processor -- start 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e872c640 1 -- start start 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e872c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57e01009f0 0x7f57e01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e872c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e0101390 0x7f57e0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e872c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57e0106a00 0x7f57e019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e872c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f57e0110e40 con 0x7f57e0101390 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e872c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f57e0110cc0 con 0x7f57e01009f0 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e872c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f57e0110fc0 con 0x7f57e0106a00 2024-09-10T11:09:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e5cc7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e0101390 0x7f57e0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e5cc7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e0101390 0x7f57e0198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43912/0 (socket says 172.21.15.59:43912) 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e5cc7640 1 -- 172.21.15.59:0/4214187563 learned_addr learned my addr 172.21.15.59:0/4214187563 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.673+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57e0106a00 0x7f57e019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e64c8640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57e01009f0 0x7f57e01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e5cc7640 1 -- 172.21.15.59:0/4214187563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57e0106a00 msgr2=0x7f57e019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57e0106a00 0x7f57e019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e5cc7640 1 -- 172.21.15.59:0/4214187563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57e01009f0 msgr2=0x7f57e01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57e01009f0 0x7f57e01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e5cc7640 1 -- 172.21.15.59:0/4214187563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e019d3c0 con 0x7f57e0101390 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e64c8640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57e01009f0 0x7f57e01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e0101390 0x7f57e0198910 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009230 tx=0x7f57d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57d77fe640 1 -- 172.21.15.59:0/4214187563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d003f030 con 0x7f57e0101390 2024-09-10T11:09:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57d77fe640 1 -- 172.21.15.59:0/4214187563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d0003ad0 con 0x7f57e0101390 2024-09-10T11:09:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e872c640 1 -- 172.21.15.59:0/4214187563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e019d650 con 0x7f57e0101390 2024-09-10T11:09:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57d77fe640 1 -- 172.21.15.59:0/4214187563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0035070 con 0x7f57e0101390 2024-09-10T11:09:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.674+0000 7f57e872c640 1 -- 172.21.15.59:0/4214187563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e01a4f40 con 0x7f57e0101390 2024-09-10T11:09:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57d77fe640 1 -- 172.21.15.59:0/4214187563 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f57d0042030 con 0x7f57e0101390 2024-09-10T11:09:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57eb4c1740 1 Processor -- start 2024-09-10T11:09:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57eb4c1740 1 -- start start 2024-09-10T11:09:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 0x56407f9bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56407f9132f0 con 0x56407f9ae9f0 2024-09-10T11:09:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56407f8bb270 con 0x56407f9be0c0 2024-09-10T11:09:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56407f90f2b0 con 0x56407f9af310 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.677+0000 7f57e6cc9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43924/0 (socket says 172.21.15.59:43924) 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 -- 172.21.15.59:0/2747537201 learned_addr learned my addr 172.21.15.59:0/2747537201 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57d77fe640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f57cc0a2da0 0x7f57cc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e64c8640 1 --2- 172.21.15.59:0/2747537201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 0x56407f9bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/2747537201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f57cc0a2da0 0x7f57cc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 -- 172.21.15.59:0/2747537201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 msgr2=0x56407f9bdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/2747537201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 0x56407f9bdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57d77fe640 1 -- 172.21.15.59:0/4214187563 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f57d00ef970 con 0x7f57e0101390 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 -- 172.21.15.59:0/2747537201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 msgr2=0x56407f9c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/2747537201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 -- 172.21.15.59:0/2747537201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56407f8ba340 con 0x56407f9ae9f0 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/2747537201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9aedd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f57d8004140 tx=0x7f57d8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1809d7f47c5ae47c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57d4ff9640 1 -- 172.21.15.59:0/2747537201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8012e60 con 0x56407f9ae9f0 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57d4ff9640 1 -- 172.21.15.59:0/2747537201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d8023070 con 0x56407f9ae9f0 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57d4ff9640 1 -- 172.21.15.59:0/2747537201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8003ad0 con 0x56407f9ae9f0 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.678+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f57cc0a2da0 0x7f57cc0a5260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57d8022000 tx=0x7f57d8020000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.679+0000 7f57eb4c1740 1 -- 172.21.15.59:0/2747537201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 msgr2=0x56407f9aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.679+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/2747537201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9aedd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f57d8004140 tx=0x7f57d8003f90 comp rx=0 tx=0).stop 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.679+0000 7f57eb4c1740 1 -- 172.21.15.59:0/2747537201 shutdown_connections 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.679+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/2747537201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.679+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/2747537201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 0x56407f9bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.679+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/2747537201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9aedd0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.679+0000 7f57eb4c1740 1 -- 172.21.15.59:0/2747537201 >> 172.21.15.59:0/2747537201 conn(0x56407f9ab060 msgr2=0x56407f9ab440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.679+0000 7f57eb4c1740 1 -- 172.21.15.59:0/2747537201 shutdown_connections 2024-09-10T11:09:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.679+0000 7f57eb4c1740 1 -- 172.21.15.59:0/2747537201 wait complete. 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57eb4c1740 1 -- start start 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57eb4c1740 1 Processor -- start 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9ae9f0 0x56407f9bb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9bb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56407f9c0d20 con 0x56407f9af310 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56407f89c290 con 0x56407f9be0c0 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56407f9c0ea0 con 0x56407f9ae9f0 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57eb4c1740 10 client.0 _ll_register_callbacks cb 0x56407f8cd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57e5cc7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57e5cc7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9bb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43932/0 (socket says 172.21.15.59:43932) 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57e5cc7640 1 -- 172.21.15.59:0/426059530 learned_addr learned my addr 172.21.15.59:0/426059530 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57e64c8640 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9ae9f0 0x56407f9bb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.680+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57e5cc7640 1 -- 172.21.15.59:0/426059530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9ae9f0 msgr2=0x56407f9bb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9ae9f0 0x56407f9bb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57e5cc7640 1 -- 172.21.15.59:0/426059530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 msgr2=0x56407f9bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9bba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57e5cc7640 1 -- 172.21.15.59:0/426059530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56407f626210 con 0x56407f9af310 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9bb540 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009900 tx=0x7f57d002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603ec176ef253ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57c9ffb640 1 -- 172.21.15.59:0/426059530 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d00be030 con 0x56407f9af310 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57c9ffb640 1 -- 172.21.15.59:0/426059530 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f57d0003c80 con 0x56407f9af310 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57eb4c1740 1 -- 172.21.15.59:0/426059530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57d8023070 con 0x56407f9af310 2024-09-10T11:09:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57c9ffb640 1 -- 172.21.15.59:0/426059530 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57d0049040 con 0x56407f9af310 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57eb4c1740 10 client.15945 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57eb4c1740 1 -- 172.21.15.59:0/426059530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56407f6f2620 con 0x56407f9af310 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.681+0000 7f57c9ffb640 1 -- 172.21.15.59:0/426059530 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d8023070 con 0x56407f9af310 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57c9ffb640 1 -- 172.21.15.59:0/426059530 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57d00bc0a0 con 0x56407f9af310 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57eb4c1740 10 client.15945 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57eb4c1740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57eb4c1740 20 client.15945 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56407f9ce0d0 0x56407f9d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57eb4c1740 4 client.15945 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57eb4c1740 1 -- 172.21.15.59:0/426059530 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56407f920a20 con 0x56407f9ce0d0 2024-09-10T11:09:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57e64c8640 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56407f9ce0d0 0x56407f9d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57c9ffb640 10 client.15945 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.682+0000 7f57e64c8640 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56407f9ce0d0 0x56407f9d04e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76195be21d5af6b6 server_cookie=cf2bcd4e4cbbe930 in_seq=0 out_seq=0 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57c9ffb640 1 -- 172.21.15.59:0/426059530 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56407f920a20 con 0x56407f9ce0d0 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57c9ffb640 10 client.15945 handle_command_reply: tid=0 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57eb4c1740 1 client.15945 shutdown 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57eb4c1740 1 -- 172.21.15.59:0/426059530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 msgr2=0x56407f9bb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9bb540 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009900 tx=0x7f57d002a420 comp rx=0 tx=0).stop 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57eb4c1740 1 -- 172.21.15.59:0/426059530 shutdown_connections 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56407f9ce0d0 0x56407f9d04e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9bb540 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57c9ffb640 0 client.15945 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.683+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/426059530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9ae9f0 0x56407f9bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.684+0000 7f57eb4c1740 1 -- 172.21.15.59:0/426059530 >> 172.21.15.59:0/426059530 conn(0x56407f9ab060 msgr2=0x56407f9b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.684+0000 7f57eb4c1740 1 -- 172.21.15.59:0/426059530 shutdown_connections 2024-09-10T11:09:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.684+0000 7f57eb4c1740 1 -- 172.21.15.59:0/426059530 wait complete. 2024-09-10T11:09:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.684+0000 7f57eb4c1740 20 client.15945 trim_cache size 0 max 16384 2024-09-10T11:09:58.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.698+0000 7f57eb4c1740 1 Processor -- start 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.698+0000 7f57eb4c1740 1 -- start start 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.698+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9d5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.698+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 0x56407f9d6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.698+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9b8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.698+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f57e01ae000 con 0x56407f9ae9f0 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.698+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f57e01ab8d0 con 0x56407f9be0c0 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.698+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f57e01a9740 con 0x56407f9af310 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e64c8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e64c8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9d5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43946/0 (socket says 172.21.15.59:43946) 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e64c8640 1 -- 172.21.15.59:0/1469542615 learned_addr learned my addr 172.21.15.59:0/1469542615 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/1469542615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 0x56407f9d6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/1469542615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e64c8640 1 -- 172.21.15.59:0/1469542615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 msgr2=0x56407f9d6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e64c8640 1 --2- 172.21.15.59:0/1469542615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 0x56407f9d6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e64c8640 1 -- 172.21.15.59:0/1469542615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 msgr2=0x56407f9b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e64c8640 1 --2- 172.21.15.59:0/1469542615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e64c8640 1 -- 172.21.15.59:0/1469542615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56407f9d0b30 con 0x56407f9ae9f0 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57e64c8640 1 --2- 172.21.15.59:0/1469542615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9d5dc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x56407f9d0d30 tx=0x7f57dc013bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b473ea557a93729 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57cbfff640 1 -- 172.21.15.59:0/1469542615 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0130d0 con 0x56407f9ae9f0 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57cbfff640 1 -- 172.21.15.59:0/1469542615 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57dc013270 con 0x56407f9ae9f0 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.699+0000 7f57cbfff640 1 -- 172.21.15.59:0/1469542615 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0047a0 con 0x56407f9ae9f0 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1469542615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 msgr2=0x56407f9d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1469542615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9d5dc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x56407f9d0d30 tx=0x7f57dc013bc0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1469542615 shutdown_connections 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1469542615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9be0c0 0x56407f9b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1469542615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9af310 0x56407f9d6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1469542615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9ae9f0 0x56407f9d5dc0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1469542615 >> 172.21.15.59:0/1469542615 conn(0x56407f9ab060 msgr2=0x56407f9bd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1469542615 shutdown_connections 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1469542615 wait complete. 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 -- start start 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.700+0000 7f57eb4c1740 1 Processor -- start 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9ae9f0 0x56407f9c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9c6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57eb4c1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9be0c0 0x56407f9c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f57e01a9d90 con 0x56407f9af310 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f57e01ab200 con 0x56407f9ae9f0 2024-09-10T11:09:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57eb4c1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f57e01aa460 con 0x56407f9be0c0 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57eb4c1740 10 client.0 _ll_register_callbacks cb 0x7f57d00095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e5cc7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e5cc7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43962/0 (socket says 172.21.15.59:43962) 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e5cc7640 1 -- 172.21.15.59:0/1711908294 learned_addr learned my addr 172.21.15.59:0/1711908294 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9be0c0 0x56407f9c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e64c8640 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9ae9f0 0x56407f9c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e5cc7640 1 -- 172.21.15.59:0/1711908294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9be0c0 msgr2=0x56407f9c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9be0c0 0x56407f9c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e5cc7640 1 -- 172.21.15.59:0/1711908294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9ae9f0 msgr2=0x56407f9c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9ae9f0 0x56407f9c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e5cc7640 1 -- 172.21.15.59:0/1711908294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56407f9c3640 con 0x56407f9af310 2024-09-10T11:09:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e6cc9640 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9be0c0 0x56407f9c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57e5cc7640 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9c6670 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f57d00bbdd0 tx=0x7f57d0005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb112475d8cace2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57c9ffb640 1 -- 172.21.15.59:0/1711908294 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d00be030 con 0x56407f9af310 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57c9ffb640 1 -- 172.21.15.59:0/1711908294 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f57d00ed2f0 con 0x56407f9af310 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.701+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1711908294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57dc013270 con 0x56407f9af310 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57c9ffb640 1 -- 172.21.15.59:0/1711908294 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57d00bb980 con 0x56407f9af310 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57eb4c1740 10 client.15951 fetch_fsmap learned FSMap version 26 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1711908294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56407f9c3640 con 0x56407f9af310 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57c9ffb640 1 -- 172.21.15.59:0/1711908294 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57dc013270 con 0x56407f9af310 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57c9ffb640 1 -- 172.21.15.59:0/1711908294 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57d0031bd0 con 0x56407f9af310 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57eb4c1740 10 client.15951 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57eb4c1740 10 client.15951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:09:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57eb4c1740 20 client.15951 populate_metadata read hostname 'smithi059' 2024-09-10T11:09:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56407fa39850 0x56407fa3bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:09:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57eb4c1740 4 client.15951 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:09:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1711908294 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56407f91ad70 con 0x56407fa39850 2024-09-10T11:09:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.702+0000 7f57e64c8640 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56407fa39850 0x56407fa3bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:09:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.703+0000 7f57c9ffb640 10 client.15951 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.703+0000 7f57e64c8640 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56407fa39850 0x56407fa3bc70 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5da0e9c868269418 server_cookie=fd4fc8210c7cd428 in_seq=0 out_seq=0 2024-09-10T11:09:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57c9ffb640 1 -- 172.21.15.59:0/1711908294 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56407f91ad70 con 0x56407fa39850 2024-09-10T11:09:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57c9ffb640 10 client.15951 handle_command_reply: tid=0 2024-09-10T11:09:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 client.15951 shutdown 2024-09-10T11:09:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1711908294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 msgr2=0x56407f9c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9c6670 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f57d00bbdd0 tx=0x7f57d0005e50 comp rx=0 tx=0).stop 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1711908294 shutdown_connections 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x56407fa39850 0x56407fa3bc70 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56407f9be0c0 0x56407f9c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56407f9af310 0x56407f9c6670 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 --2- 172.21.15.59:0/1711908294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56407f9ae9f0 0x56407f9c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57c9ffb640 0 client.15951 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1711908294 >> 172.21.15.59:0/1711908294 conn(0x56407f9ab060 msgr2=0x56407f9b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1711908294 shutdown_connections 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.717+0000 7f57eb4c1740 1 -- 172.21.15.59:0/1711908294 wait complete. 2024-09-10T11:09:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57eb4c1740 20 client.15951 trim_cache size 0 max 16384 2024-09-10T11:09:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:09:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:09:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:09:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 -- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f57cc0a2da0 msgr2=0x7f57cc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f57cc0a2da0 0x7f57cc0a5260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57d8022000 tx=0x7f57d8020000 comp rx=0 tx=0).stop 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 -- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e0101390 msgr2=0x7f57e0198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e0101390 0x7f57e0198910 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009230 tx=0x7f57d0004270 comp rx=0 tx=0).stop 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 -- 172.21.15.59:0/4214187563 shutdown_connections 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f57cc0a2da0 0x7f57cc0a5260 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57e0106a00 0x7f57e019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57e0101390 0x7f57e0198910 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 --2- 172.21.15.59:0/4214187563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57e01009f0 0x7f57e01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 -- 172.21.15.59:0/4214187563 >> 172.21.15.59:0/4214187563 conn(0x7f57e00fc6b0 msgr2=0x7f57e006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:09:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 -- 172.21.15.59:0/4214187563 shutdown_connections 2024-09-10T11:09:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:09:58.718+0000 7f57e872c640 1 -- 172.21.15.59:0/4214187563 wait complete. 2024-09-10T11:10:00.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:09:59 smithi059 ceph-mon[30978]: pgmap v266: 97 pgs: 97 active+clean; 3.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-09-10T11:10:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:09:59 smithi181 ceph-mon[35409]: pgmap v266: 97 pgs: 97 active+clean; 3.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-09-10T11:10:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:09:59 smithi115 ceph-mon[34719]: pgmap v266: 97 pgs: 97 active+clean; 3.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-09-10T11:10:01.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:00 smithi059 ceph-mon[30978]: overall HEALTH_OK 2024-09-10T11:10:01.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:00 smithi181 ceph-mon[35409]: overall HEALTH_OK 2024-09-10T11:10:01.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:00 smithi115 ceph-mon[34719]: overall HEALTH_OK 2024-09-10T11:10:02.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:01 smithi059 ceph-mon[30978]: pgmap v267: 97 pgs: 97 active+clean; 3.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 8 op/s 2024-09-10T11:10:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:01 smithi181 ceph-mon[35409]: pgmap v267: 97 pgs: 97 active+clean; 3.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 8 op/s 2024-09-10T11:10:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:01 smithi115 ceph-mon[34719]: pgmap v267: 97 pgs: 97 active+clean; 3.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 8 op/s 2024-09-10T11:10:04.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:03 smithi059 ceph-mon[30978]: pgmap v268: 97 pgs: 97 active+clean; 3.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 8 op/s 2024-09-10T11:10:04.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:03 smithi181 ceph-mon[35409]: pgmap v268: 97 pgs: 97 active+clean; 3.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 8 op/s 2024-09-10T11:10:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:03 smithi115 ceph-mon[34719]: pgmap v268: 97 pgs: 97 active+clean; 3.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 8 op/s 2024-09-10T11:10:06.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:05 smithi059 ceph-mon[30978]: pgmap v269: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-09-10T11:10:06.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:05 smithi181 ceph-mon[35409]: pgmap v269: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-09-10T11:10:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:05 smithi115 ceph-mon[34719]: pgmap v269: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-09-10T11:10:08.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:07 smithi059 ceph-mon[30978]: pgmap v270: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 87 KiB/s wr, 29 op/s 2024-09-10T11:10:08.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:07 smithi059 ceph-mon[30978]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T11:10:08.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:07 smithi181 ceph-mon[35409]: pgmap v270: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 87 KiB/s wr, 29 op/s 2024-09-10T11:10:08.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:07 smithi181 ceph-mon[35409]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T11:10:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:07 smithi115 ceph-mon[34719]: pgmap v270: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 87 KiB/s wr, 29 op/s 2024-09-10T11:10:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:07 smithi115 ceph-mon[34719]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T11:10:10.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:09 smithi059 ceph-mon[30978]: pgmap v272: 97 pgs: 97 active+clean; 4.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-09-10T11:10:10.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:09 smithi181 ceph-mon[35409]: pgmap v272: 97 pgs: 97 active+clean; 4.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-09-10T11:10:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:09 smithi115 ceph-mon[34719]: pgmap v272: 97 pgs: 97 active+clean; 4.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-09-10T11:10:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.818+0000 7f0d69d86640 1 -- 172.21.15.59:0/2074601971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d64102cc0 msgr2=0x7f0d641030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.818+0000 7f0d69d86640 1 --2- 172.21.15.59:0/2074601971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d64102cc0 0x7f0d641030a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009900 tx=0x7f0d5402a480 comp rx=0 tx=0).stop 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.819+0000 7f0d69d86640 1 -- 172.21.15.59:0/2074601971 shutdown_connections 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.819+0000 7f0d69d86640 1 --2- 172.21.15.59:0/2074601971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6410c110 0x7f0d6410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.819+0000 7f0d69d86640 1 --2- 172.21.15.59:0/2074601971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d641035e0 0x7f0d6410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.819+0000 7f0d69d86640 1 --2- 172.21.15.59:0/2074601971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d64102cc0 0x7f0d641030a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.819+0000 7f0d69d86640 1 -- 172.21.15.59:0/2074601971 >> 172.21.15.59:0/2074601971 conn(0x7f0d640fc6b0 msgr2=0x7f0d640fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.819+0000 7f0d69d86640 1 -- 172.21.15.59:0/2074601971 shutdown_connections 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.819+0000 7f0d69d86640 1 -- 172.21.15.59:0/2074601971 wait complete. 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.819+0000 7f0d69d86640 1 Processor -- start 2024-09-10T11:10:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d69d86640 1 -- start start 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d69d86640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d64102cc0 0x7f0d64100910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d69d86640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d641035e0 0x7f0d64100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d69d86640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6410c110 0x7f0d64101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d69d86640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64111ef0 con 0x7f0d641035e0 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d69d86640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64111d70 con 0x7f0d64102cc0 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d69d86640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64112070 con 0x7f0d6410c110 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d62ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d641035e0 0x7f0d64100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d62ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d641035e0 0x7f0d64100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32786/0 (socket says 172.21.15.59:32786) 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d62ffd640 1 -- 172.21.15.59:0/981593330 learned_addr learned my addr 172.21.15.59:0/981593330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d637fe640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d64102cc0 0x7f0d64100910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d63fff640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6410c110 0x7f0d64101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d62ffd640 1 -- 172.21.15.59:0/981593330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6410c110 msgr2=0x7f0d64101390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6410c110 0x7f0d64101390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d62ffd640 1 -- 172.21.15.59:0/981593330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d64102cc0 msgr2=0x7f0d64100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d64102cc0 0x7f0d64100910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d62ffd640 1 -- 172.21.15.59:0/981593330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d641a6860 con 0x7f0d641035e0 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.820+0000 7f0d637fe640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d64102cc0 0x7f0d64100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.821+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d641035e0 0x7f0d64100e50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800d740 tx=0x7f0d5800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.821+0000 7f0d60ff9640 1 -- 172.21.15.59:0/981593330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58017070 con 0x7f0d641035e0 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.821+0000 7f0d60ff9640 1 -- 172.21.15.59:0/981593330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d5800de50 con 0x7f0d641035e0 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.821+0000 7f0d69d86640 1 -- 172.21.15.59:0/981593330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d641a6b50 con 0x7f0d641035e0 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.821+0000 7f0d60ff9640 1 -- 172.21.15.59:0/981593330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800f620 con 0x7f0d641035e0 2024-09-10T11:10:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.821+0000 7f0d69d86640 1 -- 172.21.15.59:0/981593330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d641a70a0 con 0x7f0d641035e0 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.823+0000 7f0d60ff9640 1 -- 172.21.15.59:0/981593330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0d58009c30 con 0x7f0d641035e0 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.823+0000 7f0d6cbfd740 1 Processor -- start 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d6cbfd740 1 -- start start 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 0x561b05743ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 0x561b0574e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b057510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561b056a82f0 con 0x561b0574ecb0 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561b05650270 con 0x561b05744410 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b056a42b0 con 0x561b05743af0 2024-09-10T11:10:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d60ff9640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0d4c0a2da0 0x7f0d4c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d62ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b057510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d62ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b057510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32800/0 (socket says 172.21.15.59:32800) 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d62ffd640 1 -- 172.21.15.59:0/22455324 learned_addr learned my addr 172.21.15.59:0/22455324 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d63fff640 1 --2- 172.21.15.59:0/22455324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 0x561b05743ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d63fff640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0d4c0a2da0 0x7f0d4c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d637fe640 1 --2- 172.21.15.59:0/22455324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 0x561b0574e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d60ff9640 1 -- 172.21.15.59:0/981593330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8644+0+0 (secure 0 0 0) 0x7f0d580cefe0 con 0x7f0d641035e0 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d62ffd640 1 -- 172.21.15.59:0/22455324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 msgr2=0x561b05743ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/22455324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 0x561b05743ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d62ffd640 1 -- 172.21.15.59:0/22455324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 msgr2=0x561b0574e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/22455324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 0x561b0574e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.824+0000 7f0d62ffd640 1 -- 172.21.15.59:0/22455324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b0564f340 con 0x561b0574ecb0 2024-09-10T11:10:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.825+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/22455324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b057510a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0d58005fd0 tx=0x7f0d58000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52dc814f49ea6b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.825+0000 7f0d63fff640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0d4c0a2da0 0x7f0d4c0a5260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009fd0 tx=0x7f0d5c009600 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.825+0000 7f0d49ffb640 1 -- 172.21.15.59:0/22455324 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58020070 con 0x561b0574ecb0 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.825+0000 7f0d49ffb640 1 -- 172.21.15.59:0/22455324 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d5809b530 con 0x561b0574ecb0 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.825+0000 7f0d49ffb640 1 -- 172.21.15.59:0/22455324 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d580d10d0 con 0x561b0574ecb0 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/22455324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 msgr2=0x561b057510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/22455324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b057510a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0d58005fd0 tx=0x7f0d58000bc0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/22455324 shutdown_connections 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/22455324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b057510a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/22455324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 0x561b0574e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/22455324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 0x561b05743ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/22455324 >> 172.21.15.59:0/22455324 conn(0x561b05740060 msgr2=0x561b05740440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/22455324 shutdown_connections 2024-09-10T11:10:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/22455324 wait complete. 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 -- start start 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.826+0000 7f0d6cbfd740 1 Processor -- start 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b0574bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 0x561b0574c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 0x561b0574c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561b05751880 con 0x561b05743af0 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561b05631290 con 0x561b0574ecb0 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561b05751a00 con 0x561b05744410 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d637fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b0574bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d6cbfd740 10 client.0 _ll_register_callbacks cb 0x561b05662140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d637fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b0574bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32808/0 (socket says 172.21.15.59:32808) 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d637fe640 1 -- 172.21.15.59:0/2443342572 learned_addr learned my addr 172.21.15.59:0/2443342572 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 0x561b0574c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d63fff640 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 0x561b0574c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d637fe640 1 -- 172.21.15.59:0/2443342572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 msgr2=0x561b0574c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d637fe640 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 0x561b0574c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d637fe640 1 -- 172.21.15.59:0/2443342572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 msgr2=0x561b0574c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d637fe640 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 0x561b0574c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d637fe640 1 -- 172.21.15.59:0/2443342572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b053bb210 con 0x561b05743af0 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 0x561b0574c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d63fff640 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 0x561b0574c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d637fe640 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b0574bc30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009900 tx=0x7f0d54031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ce25d612f4200a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.827+0000 7f0d42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:10:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2443342572 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54035040 con 0x561b05743af0 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2443342572 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8644+0+0 (secure 0 0 0) 0x7f0d54004450 con 0x561b05743af0 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2443342572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d5809b530 con 0x561b05743af0 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2443342572 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0d54005020 con 0x561b05743af0 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d6cbfd740 10 client.15963 fetch_fsmap learned FSMap version 26 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2443342572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b05487620 con 0x561b05743af0 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2443342572 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d5809b530 con 0x561b05743af0 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2443342572 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0d5404d070 con 0x561b05743af0 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d6cbfd740 10 client.15963 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d6cbfd740 10 client.15963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d6cbfd740 20 client.15963 populate_metadata read hostname 'smithi059' 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561b0575ece0 0x561b057610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d6cbfd740 4 client.15963 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:10:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.828+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2443342572 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b056b5a20 con 0x561b0575ece0 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.829+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561b0575ece0 0x561b057610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.829+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561b0575ece0 0x561b057610d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d45c0e847e12ccc server_cookie=c66331481ae772cc in_seq=0 out_seq=0 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.829+0000 7f0d42ffd640 10 client.15963 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2443342572 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b056b5a20 con 0x561b0575ece0 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d42ffd640 10 client.15963 handle_command_reply: tid=0 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 client.15963 shutdown 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2443342572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 msgr2=0x561b0574bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b0574bc30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009900 tx=0x7f0d54031920 comp rx=0 tx=0).stop 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2443342572 shutdown_connections 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561b0575ece0 0x561b057610d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 0x561b0574c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 0x561b0574c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d42ffd640 0 client.15963 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2443342572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b0574bc30 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2443342572 >> 172.21.15.59:0/2443342572 conn(0x561b05740060 msgr2=0x561b05745d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2443342572 shutdown_connections 2024-09-10T11:10:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2443342572 wait complete. 2024-09-10T11:10:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.830+0000 7f0d6cbfd740 20 client.15963 trim_cache size 0 max 16384 2024-09-10T11:10:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d6cbfd740 1 Processor -- start 2024-09-10T11:10:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d6cbfd740 1 -- start start 2024-09-10T11:10:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b05746560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 0x561b0574c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 0x561b057669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641b2410 con 0x561b05743af0 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641afce0 con 0x561b0574ecb0 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641adb50 con 0x561b05744410 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d637fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b05746560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d637fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b05746560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32818/0 (socket says 172.21.15.59:32818) 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d637fe640 1 -- 172.21.15.59:0/128127296 learned_addr learned my addr 172.21.15.59:0/128127296 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/128127296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 0x561b0574c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d63fff640 1 --2- 172.21.15.59:0/128127296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 0x561b057669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d637fe640 1 -- 172.21.15.59:0/128127296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 msgr2=0x561b0574c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d637fe640 1 --2- 172.21.15.59:0/128127296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 0x561b0574c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d637fe640 1 -- 172.21.15.59:0/128127296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 msgr2=0x561b057669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d637fe640 1 --2- 172.21.15.59:0/128127296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 0x561b057669a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.845+0000 7f0d637fe640 1 -- 172.21.15.59:0/128127296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b05743920 con 0x561b05743af0 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d637fe640 1 --2- 172.21.15.59:0/128127296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b05746560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0d54000c00 tx=0x7f0d5402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2577fb5c3a4f6653 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d497fa640 1 -- 172.21.15.59:0/128127296 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54035030 con 0x561b05743af0 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d497fa640 1 -- 172.21.15.59:0/128127296 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d54003e80 con 0x561b05743af0 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d497fa640 1 -- 172.21.15.59:0/128127296 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54053070 con 0x561b05743af0 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/128127296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 msgr2=0x561b05746560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/128127296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b05746560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0d54000c00 tx=0x7f0d5402a480 comp rx=0 tx=0).stop 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/128127296 shutdown_connections 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/128127296 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b0574ecb0 0x561b057669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/128127296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05744410 0x561b0574c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/128127296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b05743af0 0x561b05746560 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/128127296 >> 172.21.15.59:0/128127296 conn(0x561b05740060 msgr2=0x561b0574dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.846+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/128127296 shutdown_connections 2024-09-10T11:10:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/128127296 wait complete. 2024-09-10T11:10:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 1 -- start start 2024-09-10T11:10:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 1 Processor -- start 2024-09-10T11:10:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 0x561b057572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 0x561b057488a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b05748de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641ae1a0 con 0x561b0574ecb0 2024-09-10T11:10:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641af610 con 0x561b05744410 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641ae870 con 0x561b05743af0 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d6cbfd740 10 client.0 _ll_register_callbacks cb 0x7f0d54009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.847+0000 7f0d63fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b05748de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d63fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b05748de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32832/0 (socket says 172.21.15.59:32832) 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d63fff640 1 -- 172.21.15.59:0/2046958229 learned_addr learned my addr 172.21.15.59:0/2046958229 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d637fe640 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 0x561b057572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d62ffd640 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 0x561b057488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d63fff640 1 -- 172.21.15.59:0/2046958229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 msgr2=0x561b057572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d63fff640 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 0x561b057572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d63fff640 1 -- 172.21.15.59:0/2046958229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 msgr2=0x561b057488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d63fff640 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 0x561b057488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d63fff640 1 -- 172.21.15.59:0/2046958229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b05749520 con 0x561b0574ecb0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d63fff640 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b05748de0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00ab70 tx=0x7f0d5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403bba6ba1aa2e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2046958229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c02d070 con 0x561b0574ecb0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2046958229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8644+0+0 (secure 0 0 0) 0x7f0d5c01ebc0 con 0x561b0574ecb0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2046958229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b056afd70 con 0x561b0574ecb0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2046958229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0d5c036050 con 0x561b0574ecb0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d6cbfd740 10 client.15969 fetch_fsmap learned FSMap version 26 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.848+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2046958229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b057c9930 con 0x561b0574ecb0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2046958229 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561b056afd70 con 0x561b0574ecb0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2046958229 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0d5c030020 con 0x561b0574ecb0 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d6cbfd740 10 client.15969 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:10:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d6cbfd740 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:10:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d6cbfd740 20 client.15969 populate_metadata read hostname 'smithi059' 2024-09-10T11:10:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561b057ca130 0x561b057cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d6cbfd740 4 client.15969 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:10:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2046958229 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b0562c900 con 0x561b057ca130 2024-09-10T11:10:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d637fe640 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561b057ca130 0x561b057cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d42ffd640 10 client.15969 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.849+0000 7f0d637fe640 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561b057ca130 0x561b057cc550 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca2bd3485dcc8c53 server_cookie=832698f1a96e1c61 in_seq=0 out_seq=0 2024-09-10T11:10:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.863+0000 7f0d42ffd640 1 -- 172.21.15.59:0/2046958229 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b0562c900 con 0x561b057ca130 2024-09-10T11:10:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.863+0000 7f0d42ffd640 10 client.15969 handle_command_reply: tid=0 2024-09-10T11:10:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.863+0000 7f0d6cbfd740 1 client.15969 shutdown 2024-09-10T11:10:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2046958229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 msgr2=0x561b05748de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b05748de0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00ab70 tx=0x7f0d5c004a40 comp rx=0 tx=0).stop 2024-09-10T11:10:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2046958229 shutdown_connections 2024-09-10T11:10:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x561b057ca130 0x561b057cc550 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b0574ecb0 0x561b05748de0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b05744410 0x561b057488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d42ffd640 0 client.15969 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 --2- 172.21.15.59:0/2046958229 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561b05743af0 0x561b057572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2046958229 >> 172.21.15.59:0/2046958229 conn(0x561b05740060 msgr2=0x561b0573e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2046958229 shutdown_connections 2024-09-10T11:10:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 1 -- 172.21.15.59:0/2046958229 wait complete. 2024-09-10T11:10:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.864+0000 7f0d6cbfd740 20 client.15969 trim_cache size 0 max 16384 2024-09-10T11:10:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:10:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:10:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:10:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:10:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 -- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0d4c0a2da0 msgr2=0x7f0d4c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0d4c0a2da0 0x7f0d4c0a5260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009fd0 tx=0x7f0d5c009600 comp rx=0 tx=0).stop 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 -- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d641035e0 msgr2=0x7f0d64100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d641035e0 0x7f0d64100e50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800d740 tx=0x7f0d5800dc00 comp rx=0 tx=0).stop 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 -- 172.21.15.59:0/981593330 shutdown_connections 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0d4c0a2da0 0x7f0d4c0a5260 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d6410c110 0x7f0d64101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d641035e0 0x7f0d64100e50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 --2- 172.21.15.59:0/981593330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d64102cc0 0x7f0d64100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 -- 172.21.15.59:0/981593330 >> 172.21.15.59:0/981593330 conn(0x7f0d640fc6b0 msgr2=0x7f0d640fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 -- 172.21.15.59:0/981593330 shutdown_connections 2024-09-10T11:10:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:11.865+0000 7f0d69d86640 1 -- 172.21.15.59:0/981593330 wait complete. 2024-09-10T11:10:12.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:11 smithi059 ceph-mon[30978]: pgmap v273: 97 pgs: 97 active+clean; 4.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-09-10T11:10:12.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:11 smithi181 ceph-mon[35409]: pgmap v273: 97 pgs: 97 active+clean; 4.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-09-10T11:10:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:11 smithi115 ceph-mon[34719]: pgmap v273: 97 pgs: 97 active+clean; 4.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-09-10T11:10:14.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:13 smithi059 ceph-mon[30978]: pgmap v274: 97 pgs: 97 active+clean; 4.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-09-10T11:10:14.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:13 smithi059 ceph-mon[30978]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T11:10:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:13 smithi181 ceph-mon[35409]: pgmap v274: 97 pgs: 97 active+clean; 4.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-09-10T11:10:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:13 smithi181 ceph-mon[35409]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T11:10:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:13 smithi115 ceph-mon[34719]: pgmap v274: 97 pgs: 97 active+clean; 4.4 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 108 KiB/s wr, 35 op/s 2024-09-10T11:10:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:13 smithi115 ceph-mon[34719]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T11:10:16.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:15 smithi059 ceph-mon[30978]: pgmap v276: 97 pgs: 97 active+clean; 4.6 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-09-10T11:10:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:15 smithi181 ceph-mon[35409]: pgmap v276: 97 pgs: 97 active+clean; 4.6 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-09-10T11:10:16.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:15 smithi115 ceph-mon[34719]: pgmap v276: 97 pgs: 97 active+clean; 4.6 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 KiB/s wr, 18 op/s 2024-09-10T11:10:18.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:17 smithi059 ceph-mon[30978]: pgmap v277: 97 pgs: 97 active+clean; 4.6 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 56 KiB/s wr, 15 op/s 2024-09-10T11:10:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:17 smithi181 ceph-mon[35409]: pgmap v277: 97 pgs: 97 active+clean; 4.6 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 56 KiB/s wr, 15 op/s 2024-09-10T11:10:18.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:17 smithi115 ceph-mon[34719]: pgmap v277: 97 pgs: 97 active+clean; 4.6 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 56 KiB/s wr, 15 op/s 2024-09-10T11:10:20.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:19 smithi059 ceph-mon[30978]: pgmap v278: 97 pgs: 97 active+clean; 4.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:10:20.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:19 smithi181 ceph-mon[35409]: pgmap v278: 97 pgs: 97 active+clean; 4.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:10:20.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:19 smithi115 ceph-mon[34719]: pgmap v278: 97 pgs: 97 active+clean; 4.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:10:22.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:21 smithi059 ceph-mon[30978]: pgmap v279: 97 pgs: 97 active+clean; 4.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:10:22.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:21 smithi181 ceph-mon[35409]: pgmap v279: 97 pgs: 97 active+clean; 4.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:10:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:21 smithi115 ceph-mon[34719]: pgmap v279: 97 pgs: 97 active+clean; 4.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:10:24.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:23 smithi059 ceph-mon[30978]: pgmap v280: 97 pgs: 97 active+clean; 4.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:10:24.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:23 smithi181 ceph-mon[35409]: pgmap v280: 97 pgs: 97 active+clean; 4.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:10:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:23 smithi115 ceph-mon[34719]: pgmap v280: 97 pgs: 97 active+clean; 4.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:10:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 -- 172.21.15.59:0/3106419933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 msgr2=0x7f3b7c1030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 --2- 172.21.15.59:0/3106419933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 0x7f3b7c1030a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009900 tx=0x7f3b6c02a480 comp rx=0 tx=0).stop 2024-09-10T11:10:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 -- 172.21.15.59:0/3106419933 shutdown_connections 2024-09-10T11:10:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 --2- 172.21.15.59:0/3106419933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c10c110 0x7f3b7c10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 --2- 172.21.15.59:0/3106419933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b7c1035e0 0x7f3b7c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 --2- 172.21.15.59:0/3106419933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 0x7f3b7c1030a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 -- 172.21.15.59:0/3106419933 >> 172.21.15.59:0/3106419933 conn(0x7f3b7c0fc6b0 msgr2=0x7f3b7c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 -- 172.21.15.59:0/3106419933 shutdown_connections 2024-09-10T11:10:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 -- 172.21.15.59:0/3106419933 wait complete. 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 Processor -- start 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.966+0000 7f3b81986640 1 -- start start 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b81986640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 0x7f3b7c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b81986640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c1035e0 0x7f3b7c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b81986640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b7c10c110 0x7f3b7c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b81986640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c111ef0 con 0x7f3b7c102cc0 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b81986640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c111d70 con 0x7f3b7c1035e0 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b81986640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c112070 con 0x7f3b7c10c110 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 0x7f3b7c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 0x7f3b7c198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35230/0 (socket says 172.21.15.59:35230) 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7affd640 1 -- 172.21.15.59:0/1610403106 learned_addr learned my addr 172.21.15.59:0/1610403106 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b7c10c110 0x7f3b7c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b73fff640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c1035e0 0x7f3b7c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7affd640 1 -- 172.21.15.59:0/1610403106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b7c10c110 msgr2=0x7f3b7c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7affd640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b7c10c110 0x7f3b7c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7affd640 1 -- 172.21.15.59:0/1610403106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c1035e0 msgr2=0x7f3b7c1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7affd640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c1035e0 0x7f3b7c1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7affd640 1 -- 172.21.15.59:0/1610403106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c19d360 con 0x7f3b7c102cc0 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b73fff640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c1035e0 0x7f3b7c1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b7c10c110 0x7f3b7c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.967+0000 7f3b7affd640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 0x7f3b7c198370 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c006010 tx=0x7f3b6c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.968+0000 7f3b80984640 1 -- 172.21.15.59:0/1610403106 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c03f030 con 0x7f3b7c102cc0 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.968+0000 7f3b80984640 1 -- 172.21.15.59:0/1610403106 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b6c004440 con 0x7f3b7c102cc0 2024-09-10T11:10:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.968+0000 7f3b81986640 1 -- 172.21.15.59:0/1610403106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c19d5f0 con 0x7f3b7c102cc0 2024-09-10T11:10:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.968+0000 7f3b80984640 1 -- 172.21.15.59:0/1610403106 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c035070 con 0x7f3b7c102cc0 2024-09-10T11:10:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.968+0000 7f3b81986640 1 -- 172.21.15.59:0/1610403106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c1a4ee0 con 0x7f3b7c102cc0 2024-09-10T11:10:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b80984640 1 -- 172.21.15.59:0/1610403106 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3b6c042030 con 0x7f3b7c102cc0 2024-09-10T11:10:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b847fb740 1 Processor -- start 2024-09-10T11:10:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b847fb740 1 -- start start 2024-09-10T11:10:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e029d0 0x55c747e02db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 0x55c747e11b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 0x55c747e144b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b847fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c747d672f0 con 0x55c747e029d0 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b847fb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c747d0f270 con 0x55c747e032f0 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b847fb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c747d632b0 con 0x55c747e120c0 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b7b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e029d0 0x55c747e02db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b7b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e029d0 0x55c747e02db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35242/0 (socket says 172.21.15.59:35242) 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b7b7fe640 1 -- 172.21.15.59:0/2681475375 learned_addr learned my addr 172.21.15.59:0/2681475375 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.971+0000 7f3b73fff640 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 0x55c747e144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b7affd640 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 0x55c747e11b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b7b7fe640 1 -- 172.21.15.59:0/2681475375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 msgr2=0x55c747e144b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 0x55c747e144b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b7b7fe640 1 -- 172.21.15.59:0/2681475375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 msgr2=0x55c747e11b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 0x55c747e11b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b7b7fe640 1 -- 172.21.15.59:0/2681475375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c747d0e340 con 0x55c747e029d0 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b73fff640 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 0x55c747e144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e029d0 0x55c747e02db0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3b740117c0 tx=0x7f3b74011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a55c6724158b3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b80984640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f3b680a2da0 0x7f3b680a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b7affd640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f3b680a2da0 0x7f3b680a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b71ffb640 1 -- 172.21.15.59:0/2681475375 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74003c30 con 0x55c747e029d0 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b71ffb640 1 -- 172.21.15.59:0/2681475375 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b7400fe80 con 0x55c747e029d0 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b71ffb640 1 -- 172.21.15.59:0/2681475375 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b740193e0 con 0x55c747e029d0 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.972+0000 7f3b80984640 1 -- 172.21.15.59:0/1610403106 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7f3b6c0ef7e0 con 0x7f3b7c102cc0 2024-09-10T11:10:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 -- 172.21.15.59:0/2681475375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e029d0 msgr2=0x55c747e02db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b7affd640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f3b680a2da0 0x7f3b680a5260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0ecf90 tx=0x7f3b6c02a480 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e029d0 0x55c747e02db0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3b740117c0 tx=0x7f3b74011c80 comp rx=0 tx=0).stop 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 -- 172.21.15.59:0/2681475375 shutdown_connections 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 0x55c747e144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 0x55c747e11b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 --2- 172.21.15.59:0/2681475375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e029d0 0x55c747e02db0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 -- 172.21.15.59:0/2681475375 >> 172.21.15.59:0/2681475375 conn(0x55c747dff060 msgr2=0x55c747dff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 -- 172.21.15.59:0/2681475375 shutdown_connections 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 -- 172.21.15.59:0/2681475375 wait complete. 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.973+0000 7f3b847fb740 1 -- start start 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b847fb740 1 Processor -- start 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e0f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e0f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e120c0 0x55c747e0fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b847fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c747e14cf0 con 0x55c747e032f0 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b847fb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c747cf0290 con 0x55c747e120c0 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b847fb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c747e14e70 con 0x55c747e029d0 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b847fb740 10 client.0 _ll_register_callbacks cb 0x55c747d21140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b73fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e0f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b7b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e0f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b7b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e0f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.59:45668/0 (socket says 172.21.15.59:45668) 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b7b7fe640 1 -- 172.21.15.59:0/897877049 learned_addr learned my addr 172.21.15.59:0/897877049 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e120c0 0x55c747e0fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b73fff640 1 -- 172.21.15.59:0/897877049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 msgr2=0x55c747e0f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b73fff640 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e0f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b73fff640 1 -- 172.21.15.59:0/897877049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e120c0 msgr2=0x55c747e0fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b73fff640 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e120c0 0x55c747e0fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b73fff640 1 -- 172.21.15.59:0/897877049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c747a7a210 con 0x55c747e032f0 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.974+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e120c0 0x55c747e0fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b73fff640 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e0f580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c10d530 tx=0x7f3b6400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b213e4ea27e6ad7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b5affd640 1 -- 172.21.15.59:0/897877049 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b640120d0 con 0x55c747e032f0 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b5affd640 1 -- 172.21.15.59:0/897877049 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7f3b64010430 con 0x55c747e032f0 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b847fb740 1 -- 172.21.15.59:0/897877049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c747d74a20 con 0x55c747e032f0 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b5affd640 1 -- 172.21.15.59:0/897877049 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3b64012270 con 0x55c747e032f0 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b847fb740 10 client.15981 fetch_fsmap learned FSMap version 26 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b847fb740 1 -- 172.21.15.59:0/897877049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c747b46620 con 0x55c747e032f0 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b5affd640 1 -- 172.21.15.59:0/897877049 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c747d74a20 con 0x55c747e032f0 2024-09-10T11:10:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b5affd640 1 -- 172.21.15.59:0/897877049 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3b6401c720 con 0x55c747e032f0 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b847fb740 10 client.15981 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b847fb740 10 client.15981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b847fb740 20 client.15981 populate_metadata read hostname 'smithi059' 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b847fb740 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c747e22220 0x55c747e24610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b847fb740 4 client.15981 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.975+0000 7f3b847fb740 1 -- 172.21.15.59:0/897877049 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c747d6ed70 con 0x55c747e22220 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.976+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c747e22220 0x55c747e24610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.976+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c747e22220 0x55c747e24610 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f00796cb4484f26 server_cookie=525d75bf2246214b in_seq=0 out_seq=0 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.976+0000 7f3b5affd640 10 client.15981 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b5affd640 1 -- 172.21.15.59:0/897877049 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c747d6ed70 con 0x55c747e22220 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b5affd640 10 client.15981 handle_command_reply: tid=0 2024-09-10T11:10:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 client.15981 shutdown 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 -- 172.21.15.59:0/897877049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 msgr2=0x55c747e0f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e0f580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c10d530 tx=0x7f3b6400f790 comp rx=0 tx=0).stop 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 -- 172.21.15.59:0/897877049 shutdown_connections 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c747e22220 0x55c747e24610 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e120c0 0x55c747e0fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e0f580 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b5affd640 0 client.15981 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 --2- 172.21.15.59:0/897877049 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e0f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 -- 172.21.15.59:0/897877049 >> 172.21.15.59:0/897877049 conn(0x55c747dff060 msgr2=0x55c747e04dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 -- 172.21.15.59:0/897877049 shutdown_connections 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.977+0000 7f3b847fb740 1 -- 172.21.15.59:0/897877049 wait complete. 2024-09-10T11:10:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.978+0000 7f3b847fb740 20 client.15981 trim_cache size 0 max 16384 2024-09-10T11:10:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b847fb740 1 Processor -- start 2024-09-10T11:10:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b847fb740 1 -- start start 2024-09-10T11:10:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e029d0 0x55c747e0f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e29e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 0x55c747e2a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b847fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1ae080 con 0x55c747e032f0 2024-09-10T11:10:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b847fb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1ab950 con 0x55c747e029d0 2024-09-10T11:10:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b847fb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1a97c0 con 0x55c747e120c0 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b73fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e29e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b73fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e29e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35258/0 (socket says 172.21.15.59:35258) 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.992+0000 7f3b73fff640 1 -- 172.21.15.59:0/3461600591 learned_addr learned my addr 172.21.15.59:0/3461600591 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/3461600591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 0x55c747e2a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/3461600591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e029d0 0x55c747e0f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b73fff640 1 -- 172.21.15.59:0/3461600591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 msgr2=0x55c747e2a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b73fff640 1 --2- 172.21.15.59:0/3461600591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 0x55c747e2a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b73fff640 1 -- 172.21.15.59:0/3461600591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e029d0 msgr2=0x55c747e0f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b73fff640 1 --2- 172.21.15.59:0/3461600591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e029d0 0x55c747e0f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b73fff640 1 -- 172.21.15.59:0/3461600591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c747e24980 con 0x55c747e032f0 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b73fff640 1 --2- 172.21.15.59:0/3461600591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e29e70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3b6401cd30 tx=0x7f3b6401b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2609e4458eac36e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b717fa640 1 -- 172.21.15.59:0/3461600591 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6401c420 con 0x55c747e032f0 2024-09-10T11:10:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b717fa640 1 -- 172.21.15.59:0/3461600591 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b640050d0 con 0x55c747e032f0 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.993+0000 7f3b717fa640 1 -- 172.21.15.59:0/3461600591 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64003b20 con 0x55c747e032f0 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 -- 172.21.15.59:0/3461600591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 msgr2=0x55c747e29e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 --2- 172.21.15.59:0/3461600591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e29e70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3b6401cd30 tx=0x7f3b6401b400 comp rx=0 tx=0).stop 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 -- 172.21.15.59:0/3461600591 shutdown_connections 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 --2- 172.21.15.59:0/3461600591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e120c0 0x55c747e2a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 --2- 172.21.15.59:0/3461600591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e032f0 0x55c747e29e70 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 --2- 172.21.15.59:0/3461600591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e029d0 0x55c747e0f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 -- 172.21.15.59:0/3461600591 >> 172.21.15.59:0/3461600591 conn(0x55c747dff060 msgr2=0x55c747e110c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 -- 172.21.15.59:0/3461600591 shutdown_connections 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 -- 172.21.15.59:0/3461600591 wait complete. 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 -- start start 2024-09-10T11:10:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.994+0000 7f3b847fb740 1 Processor -- start 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e1a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 0x55c747e15aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b847fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e120c0 0x55c747e15fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b847fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1a9e10 con 0x55c747e120c0 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b847fb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1ab280 con 0x55c747e032f0 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b847fb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1aa4e0 con 0x55c747e029d0 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b847fb740 10 client.0 _ll_register_callbacks cb 0x7f3b64009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e1a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e1a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.59:45674/0 (socket says 172.21.15.59:45674) 2024-09-10T11:10:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 -- 172.21.15.59:0/1157477812 learned_addr learned my addr 172.21.15.59:0/1157477812 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e120c0 0x55c747e15fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b73fff640 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 0x55c747e15aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 -- 172.21.15.59:0/1157477812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 msgr2=0x55c747e15aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 0x55c747e15aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 -- 172.21.15.59:0/1157477812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e120c0 msgr2=0x55c747e15fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e120c0 0x55c747e15fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 -- 172.21.15.59:0/1157477812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c747e167f0 con 0x55c747e029d0 2024-09-10T11:10:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b7b7fe640 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e1a780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3b74004770 tx=0x7f3b7402a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8db3425c30c89f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.995+0000 7f3b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-10T11:10:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b5affd640 1 -- 172.21.15.59:0/1157477812 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74004320 con 0x55c747e029d0 2024-09-10T11:10:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b847fb740 1 -- 172.21.15.59:0/1157477812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b640050d0 con 0x55c747e029d0 2024-09-10T11:10:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b5affd640 1 -- 172.21.15.59:0/1157477812 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7f3b74011020 con 0x55c747e029d0 2024-09-10T11:10:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b5affd640 1 -- 172.21.15.59:0/1157477812 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3b74011220 con 0x55c747e029d0 2024-09-10T11:10:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b847fb740 10 client.25561 fetch_fsmap learned FSMap version 26 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b847fb740 1 -- 172.21.15.59:0/1157477812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c747e8ce20 con 0x55c747e029d0 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b5affd640 1 -- 172.21.15.59:0/1157477812 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b640050d0 con 0x55c747e029d0 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b5affd640 1 -- 172.21.15.59:0/1157477812 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3b7402f030 con 0x55c747e029d0 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b847fb740 10 client.25561 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b847fb740 10 client.25561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b847fb740 20 client.25561 populate_metadata read hostname 'smithi059' 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b847fb740 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c747e8d310 0x55c747e8f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b847fb740 4 client.25561 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b847fb740 1 -- 172.21.15.59:0/1157477812 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c747ceb900 con 0x55c747e8d310 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.996+0000 7f3b73fff640 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c747e8d310 0x55c747e8f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.997+0000 7f3b73fff640 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c747e8d310 0x55c747e8f700 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc199378f5de5a1c server_cookie=2789c5c06e055700 in_seq=0 out_seq=0 2024-09-10T11:10:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:24.997+0000 7f3b5affd640 10 client.25561 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b5affd640 1 -- 172.21.15.59:0/1157477812 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c747ceb900 con 0x55c747e8d310 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b5affd640 10 client.25561 handle_command_reply: tid=0 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 client.25561 shutdown 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 -- 172.21.15.59:0/1157477812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 msgr2=0x55c747e1a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e1a780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3b74004770 tx=0x7f3b7402a040 comp rx=0 tx=0).stop 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 -- 172.21.15.59:0/1157477812 shutdown_connections 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55c747e8d310 0x55c747e8f700 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c747e120c0 0x55c747e15fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b5affd640 0 client.25561 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c747e032f0 0x55c747e15aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 --2- 172.21.15.59:0/1157477812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c747e029d0 0x55c747e1a780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 -- 172.21.15.59:0/1157477812 >> 172.21.15.59:0/1157477812 conn(0x55c747dff060 msgr2=0x55c747dfd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 -- 172.21.15.59:0/1157477812 shutdown_connections 2024-09-10T11:10:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 1 -- 172.21.15.59:0/1157477812 wait complete. 2024-09-10T11:10:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.012+0000 7f3b847fb740 20 client.25561 trim_cache size 0 max 16384 2024-09-10T11:10:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:10:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:10:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:10:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:10:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 -- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f3b680a2da0 msgr2=0x7f3b680a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f3b680a2da0 0x7f3b680a5260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0ecf90 tx=0x7f3b6c02a480 comp rx=0 tx=0).stop 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 -- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 msgr2=0x7f3b7c198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 0x7f3b7c198370 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c006010 tx=0x7f3b6c004040 comp rx=0 tx=0).stop 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 -- 172.21.15.59:0/1610403106 shutdown_connections 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f3b680a2da0 0x7f3b680a5260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b7c10c110 0x7f3b7c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c1035e0 0x7f3b7c1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 --2- 172.21.15.59:0/1610403106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b7c102cc0 0x7f3b7c198370 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 -- 172.21.15.59:0/1610403106 >> 172.21.15.59:0/1610403106 conn(0x7f3b7c0fc6b0 msgr2=0x7f3b7c0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 -- 172.21.15.59:0/1610403106 shutdown_connections 2024-09-10T11:10:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:25.013+0000 7f3b81986640 1 -- 172.21.15.59:0/1610403106 wait complete. 2024-09-10T11:10:26.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:25 smithi059 ceph-mon[30978]: pgmap v281: 97 pgs: 97 active+clean; 5.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-09-10T11:10:26.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:25 smithi181 ceph-mon[35409]: pgmap v281: 97 pgs: 97 active+clean; 5.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-09-10T11:10:26.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:25 smithi115 ceph-mon[34719]: pgmap v281: 97 pgs: 97 active+clean; 5.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-09-10T11:10:28.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:27 smithi059 ceph-mon[30978]: pgmap v282: 97 pgs: 97 active+clean; 5.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:10:28.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:27 smithi181 ceph-mon[35409]: pgmap v282: 97 pgs: 97 active+clean; 5.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:10:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:27 smithi115 ceph-mon[34719]: pgmap v282: 97 pgs: 97 active+clean; 5.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:10:30.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:29 smithi059 ceph-mon[30978]: pgmap v283: 97 pgs: 97 active+clean; 5.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:10:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:29 smithi181 ceph-mon[35409]: pgmap v283: 97 pgs: 97 active+clean; 5.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:10:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:29 smithi115 ceph-mon[34719]: pgmap v283: 97 pgs: 97 active+clean; 5.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:10:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:31 smithi059 ceph-mon[30978]: pgmap v284: 97 pgs: 97 active+clean; 5.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:10:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:10:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:10:32.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:10:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:31 smithi181 ceph-mon[35409]: pgmap v284: 97 pgs: 97 active+clean; 5.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:10:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:10:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:10:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:10:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:31 smithi115 ceph-mon[34719]: pgmap v284: 97 pgs: 97 active+clean; 5.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:10:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:10:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:10:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:10:34.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:33 smithi059 ceph-mon[30978]: pgmap v285: 97 pgs: 97 active+clean; 5.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:34.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:33 smithi181 ceph-mon[35409]: pgmap v285: 97 pgs: 97 active+clean; 5.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:33 smithi115 ceph-mon[34719]: pgmap v285: 97 pgs: 97 active+clean; 5.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:36.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:35 smithi059 ceph-mon[30978]: pgmap v286: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-09-10T11:10:36.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:35 smithi181 ceph-mon[35409]: pgmap v286: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-09-10T11:10:36.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:35 smithi115 ceph-mon[34719]: pgmap v286: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-09-10T11:10:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.114+0000 7fda25a8b640 1 -- 172.21.15.59:0/3285193855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda2010c0d0 msgr2=0x7fda2010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.114+0000 7fda25a8b640 1 --2- 172.21.15.59:0/3285193855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda2010c0d0 0x7fda2010e550 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fda18009ca0 tx=0x7fda1802a950 comp rx=0 tx=0).stop 2024-09-10T11:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.114+0000 7fda25a8b640 1 -- 172.21.15.59:0/3285193855 shutdown_connections 2024-09-10T11:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.114+0000 7fda25a8b640 1 --2- 172.21.15.59:0/3285193855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda2010c0d0 0x7fda2010e550 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.114+0000 7fda25a8b640 1 --2- 172.21.15.59:0/3285193855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda201035a0 0x7fda2010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.114+0000 7fda25a8b640 1 --2- 172.21.15.59:0/3285193855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda20102c80 0x7fda20103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.114+0000 7fda25a8b640 1 -- 172.21.15.59:0/3285193855 >> 172.21.15.59:0/3285193855 conn(0x7fda20077990 msgr2=0x7fda200fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.114+0000 7fda25a8b640 1 -- 172.21.15.59:0/3285193855 shutdown_connections 2024-09-10T11:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.114+0000 7fda25a8b640 1 -- 172.21.15.59:0/3285193855 wait complete. 2024-09-10T11:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda25a8b640 1 Processor -- start 2024-09-10T11:10:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda25a8b640 1 -- start start 2024-09-10T11:10:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda25a8b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda20102c80 0x7fda201982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda25a8b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda201035a0 0x7fda20198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda25a8b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda2010c0d0 0x7fda2019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda25a8b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda20111e70 con 0x7fda20102c80 2024-09-10T11:10:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda25a8b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fda20111cf0 con 0x7fda201035a0 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda25a8b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fda20111ff0 con 0x7fda2010c0d0 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda1f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda20102c80 0x7fda201982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda1f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda20102c80 0x7fda201982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35352/0 (socket says 172.21.15.59:35352) 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.115+0000 7fda1f7fe640 1 -- 172.21.15.59:0/4179729980 learned_addr learned my addr 172.21.15.59:0/4179729980 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1ffff640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda2010c0d0 0x7fda2019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1effd640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda201035a0 0x7fda20198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1f7fe640 1 -- 172.21.15.59:0/4179729980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda2010c0d0 msgr2=0x7fda2019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda2010c0d0 0x7fda2019cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1f7fe640 1 -- 172.21.15.59:0/4179729980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda201035a0 msgr2=0x7fda20198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda201035a0 0x7fda20198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1f7fe640 1 -- 172.21.15.59:0/4179729980 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2019d2b0 con 0x7fda20102c80 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda20102c80 0x7fda201982c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fda1000d950 tx=0x7fda1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1cff9640 1 -- 172.21.15.59:0/4179729980 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10017070 con 0x7fda20102c80 2024-09-10T11:10:38.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1cff9640 1 -- 172.21.15.59:0/4179729980 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda10009c30 con 0x7fda20102c80 2024-09-10T11:10:38.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda25a8b640 1 -- 172.21.15.59:0/4179729980 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2019d5a0 con 0x7fda20102c80 2024-09-10T11:10:38.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda1cff9640 1 -- 172.21.15.59:0/4179729980 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1000f6b0 con 0x7fda20102c80 2024-09-10T11:10:38.120 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.116+0000 7fda25a8b640 1 -- 172.21.15.59:0/4179729980 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda201a4e30 con 0x7fda20102c80 2024-09-10T11:10:38.126 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.119+0000 7fda1cff9640 1 -- 172.21.15.59:0/4179729980 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fda100109d0 con 0x7fda20102c80 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.119+0000 7fda28824740 1 Processor -- start 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.119+0000 7fda28824740 1 -- start start 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.119+0000 7fda28824740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce999ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.119+0000 7fda28824740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce99a410 0x55b3ce9a4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.119+0000 7fda28824740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.119+0000 7fda28824740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b3ce8fe2f0 con 0x55b3ce999af0 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.119+0000 7fda28824740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b3ce8a6270 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.119+0000 7fda28824740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b3ce8fa2b0 con 0x55b3ce99a410 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce999ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce999ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35362/0 (socket says 172.21.15.59:35362) 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce99a410 0x55b3ce9a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1ffff640 1 -- 172.21.15.59:0/1750499708 learned_addr learned my addr 172.21.15.59:0/1750499708 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1effd640 1 --2- 172.21.15.59:0/1750499708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1cff9640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fda080a2da0 0x7fda080a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1f7fe640 1 -- 172.21.15.59:0/1750499708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce9a4cb0 msgr2=0x55b3ce9a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/1750499708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1f7fe640 1 -- 172.21.15.59:0/1750499708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 msgr2=0x55b3ce999ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/1750499708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce999ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1f7fe640 1 -- 172.21.15.59:0/1750499708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3ce8a5340 con 0x55b3ce99a410 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1ffff640 1 --2- 172.21.15.59:0/1750499708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce999ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1ffff640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fda080a2da0 0x7fda080a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1cff9640 1 -- 172.21.15.59:0/4179729980 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7fda100cf040 con 0x7fda20102c80 2024-09-10T11:10:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.120+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/1750499708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce99a410 0x55b3ce9a4770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda100cc740 tx=0x7fda100661f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cb6b04a290628ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda1ffff640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fda080a2da0 0x7fda080a5260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda18030040 tx=0x7fda1803c040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda05ffb640 1 -- 172.21.15.59:0/1750499708 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1009b100 con 0x55b3ce99a410 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda05ffb640 1 -- 172.21.15.59:0/1750499708 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda10009de0 con 0x55b3ce99a410 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda05ffb640 1 -- 172.21.15.59:0/1750499708 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1006e490 con 0x55b3ce99a410 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda28824740 1 -- 172.21.15.59:0/1750499708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce99a410 msgr2=0x55b3ce9a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda28824740 1 --2- 172.21.15.59:0/1750499708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce99a410 0x55b3ce9a4770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda100cc740 tx=0x7fda100661f0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda28824740 1 -- 172.21.15.59:0/1750499708 shutdown_connections 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda28824740 1 --2- 172.21.15.59:0/1750499708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda28824740 1 --2- 172.21.15.59:0/1750499708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce99a410 0x55b3ce9a4770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda28824740 1 --2- 172.21.15.59:0/1750499708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce999ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.121+0000 7fda28824740 1 -- 172.21.15.59:0/1750499708 >> 172.21.15.59:0/1750499708 conn(0x55b3ce996060 msgr2=0x55b3ce996440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.122+0000 7fda28824740 1 -- 172.21.15.59:0/1750499708 shutdown_connections 2024-09-10T11:10:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.122+0000 7fda28824740 1 -- 172.21.15.59:0/1750499708 wait complete. 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.122+0000 7fda28824740 1 -- start start 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.122+0000 7fda28824740 1 Processor -- start 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.122+0000 7fda28824740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce9a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda28824740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 0x55b3ce9a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda28824740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda28824740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b3ce9a7880 con 0x55b3ce999af0 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda28824740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b3ce887290 con 0x55b3ce99a410 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda28824740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55b3ce9a7a00 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce9a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda28824740 10 client.0 _ll_register_callbacks cb 0x55b3ce8b8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce9a1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35378/0 (socket says 172.21.15.59:35378) 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1f7fe640 1 -- 172.21.15.59:0/3337174649 learned_addr learned my addr 172.21.15.59:0/3337174649 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1effd640 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 0x55b3ce9a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1ffff640 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1f7fe640 1 -- 172.21.15.59:0/3337174649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 msgr2=0x55b3ce9a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1f7fe640 1 -- 172.21.15.59:0/3337174649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 msgr2=0x55b3ce9a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 0x55b3ce9a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1f7fe640 1 -- 172.21.15.59:0/3337174649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3ce611210 con 0x55b3ce999af0 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1effd640 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 0x55b3ce9a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce9a1b50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fda10010fd0 tx=0x7fda10010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836e859b8c5383cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fd9feffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fd9feffd640 1 -- 172.21.15.59:0/3337174649 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10020040 con 0x55b3ce999af0 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fd9feffd640 1 -- 172.21.15.59:0/3337174649 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7fda100998c0 con 0x55b3ce999af0 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.123+0000 7fda28824740 1 -- 172.21.15.59:0/3337174649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda10009de0 con 0x55b3ce999af0 2024-09-10T11:10:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fd9feffd640 1 -- 172.21.15.59:0/3337174649 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda100647b0 con 0x55b3ce999af0 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fda28824740 10 client.15999 fetch_fsmap learned FSMap version 26 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fda28824740 1 -- 172.21.15.59:0/3337174649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b3ce6dd620 con 0x55b3ce999af0 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fd9feffd640 1 -- 172.21.15.59:0/3337174649 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda10009de0 con 0x55b3ce999af0 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fd9feffd640 1 -- 172.21.15.59:0/3337174649 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fda100cc9c0 con 0x55b3ce999af0 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fda28824740 10 client.15999 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fda28824740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fda28824740 20 client.15999 populate_metadata read hostname 'smithi059' 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fda28824740 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55b3ce9b4a50 0x55b3ce9b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fda28824740 4 client.15999 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fda28824740 1 -- 172.21.15.59:0/3337174649 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3ce90ba20 con 0x55b3ce9b4a50 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.124+0000 7fda1effd640 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55b3ce9b4a50 0x55b3ce9b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.125+0000 7fda1effd640 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55b3ce9b4a50 0x55b3ce9b6e40 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1f9504566273647 server_cookie=9fd933aeda3ded18 in_seq=0 out_seq=0 2024-09-10T11:10:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.125+0000 7fd9feffd640 10 client.15999 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.125+0000 7fd9feffd640 1 -- 172.21.15.59:0/3337174649 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3ce90ba20 con 0x55b3ce9b4a50 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.125+0000 7fd9feffd640 10 client.15999 handle_command_reply: tid=0 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.125+0000 7fda28824740 1 client.15999 shutdown 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 -- 172.21.15.59:0/3337174649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 msgr2=0x55b3ce9a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce9a1b50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fda10010fd0 tx=0x7fda10010d70 comp rx=0 tx=0).stop 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 -- 172.21.15.59:0/3337174649 shutdown_connections 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55b3ce9b4a50 0x55b3ce9b6e40 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 0x55b3ce9a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 --2- 172.21.15.59:0/3337174649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce999af0 0x55b3ce9a1b50 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fd9feffd640 0 client.15999 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 -- 172.21.15.59:0/3337174649 >> 172.21.15.59:0/3337174649 conn(0x55b3ce996060 msgr2=0x55b3ce99bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:38.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 -- 172.21.15.59:0/3337174649 shutdown_connections 2024-09-10T11:10:38.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 1 -- 172.21.15.59:0/3337174649 wait complete. 2024-09-10T11:10:38.134 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.126+0000 7fda28824740 20 client.15999 trim_cache size 0 max 16384 2024-09-10T11:10:38.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:37 smithi059 ceph-mon[30978]: pgmap v287: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda28824740 1 Processor -- start 2024-09-10T11:10:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda28824740 1 -- start start 2024-09-10T11:10:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda28824740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce999af0 0x55b3ce9a2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda28824740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce99a410 0x55b3ce9bc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda28824740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9bc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda28824740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda201b0270 con 0x55b3ce99a410 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda28824740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fda201adb40 con 0x55b3ce999af0 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda28824740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fda201ab9b0 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce99a410 0x55b3ce9bc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce99a410 0x55b3ce9bc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35392/0 (socket says 172.21.15.59:35392) 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1effd640 1 -- 172.21.15.59:0/390805768 learned_addr learned my addr 172.21.15.59:0/390805768 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce999af0 0x55b3ce9a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1ffff640 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9bc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1effd640 1 -- 172.21.15.59:0/390805768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 msgr2=0x55b3ce9bc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1effd640 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9bc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1effd640 1 -- 172.21.15.59:0/390805768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce999af0 msgr2=0x55b3ce9a2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1effd640 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce999af0 0x55b3ce9a2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1effd640 1 -- 172.21.15.59:0/390805768 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3ce99a240 con 0x55b3ce99a410 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1ffff640 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9bc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.141+0000 7fda1effd640 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce99a410 0x55b3ce9bc410 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x55b3ce99c690 tx=0x7fda140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e72900cacd50e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda057fa640 1 -- 172.21.15.59:0/390805768 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14003e20 con 0x55b3ce99a410 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda057fa640 1 -- 172.21.15.59:0/390805768 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda14010910 con 0x55b3ce99a410 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda057fa640 1 -- 172.21.15.59:0/390805768 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1401ea50 con 0x55b3ce99a410 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda28824740 1 -- 172.21.15.59:0/390805768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce99a410 msgr2=0x55b3ce9bc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda28824740 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce99a410 0x55b3ce9bc410 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x55b3ce99c690 tx=0x7fda140046c0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda28824740 1 -- 172.21.15.59:0/390805768 shutdown_connections 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda28824740 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce9bc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda28824740 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce99a410 0x55b3ce9bc410 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda28824740 1 --2- 172.21.15.59:0/390805768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce999af0 0x55b3ce9a2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda28824740 1 -- 172.21.15.59:0/390805768 >> 172.21.15.59:0/390805768 conn(0x55b3ce996060 msgr2=0x55b3ce9a3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda28824740 1 -- 172.21.15.59:0/390805768 shutdown_connections 2024-09-10T11:10:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.142+0000 7fda28824740 1 -- 172.21.15.59:0/390805768 wait complete. 2024-09-10T11:10:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda28824740 1 -- start start 2024-09-10T11:10:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda28824740 1 Processor -- start 2024-09-10T11:10:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda28824740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce999af0 0x55b3ce99eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda28824740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 0x55b3ce99f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda28824740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce99f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda28824740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda201ac000 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda28824740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fda201ad470 con 0x55b3ce99a410 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda28824740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fda201ac6d0 con 0x55b3ce999af0 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda28824740 10 client.0 _ll_register_callbacks cb 0x7fda18009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.143+0000 7fda1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce99f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce99f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35400/0 (socket says 172.21.15.59:35400) 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1ffff640 1 -- 172.21.15.59:0/955349996 learned_addr learned my addr 172.21.15.59:0/955349996 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce999af0 0x55b3ce99eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1effd640 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 0x55b3ce99f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1ffff640 1 -- 172.21.15.59:0/955349996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce999af0 msgr2=0x55b3ce99eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1ffff640 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce999af0 0x55b3ce99eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1ffff640 1 -- 172.21.15.59:0/955349996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 msgr2=0x55b3ce99f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1ffff640 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 0x55b3ce99f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1ffff640 1 -- 172.21.15.59:0/955349996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3cea1e3e0 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda1ffff640 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce99f5a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fda18005e30 tx=0x7fda18005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232c5302d94aed99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fd9feffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fd9feffd640 1 -- 172.21.15.59:0/955349996 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18056060 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fd9feffd640 1 -- 172.21.15.59:0/955349996 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7fda18004030 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda28824740 1 -- 172.21.15.59:0/955349996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda14010910 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fd9feffd640 1 -- 172.21.15.59:0/955349996 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda18034040 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda28824740 10 client.16005 fetch_fsmap learned FSMap version 26 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.144+0000 7fda28824740 1 -- 172.21.15.59:0/955349996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b3cea1f600 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fd9feffd640 1 -- 172.21.15.59:0/955349996 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda14010910 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fd9feffd640 1 -- 172.21.15.59:0/955349996 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fda18030a80 con 0x55b3ce9a4cb0 2024-09-10T11:10:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fda28824740 10 client.16005 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:10:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fda28824740 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:10:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fda28824740 20 client.16005 populate_metadata read hostname 'smithi059' 2024-09-10T11:10:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fda28824740 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55b3cea1fe80 0x55b3cea222a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fda28824740 4 client.16005 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:10:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fda28824740 1 -- 172.21.15.59:0/955349996 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3ce905d70 con 0x55b3cea1fe80 2024-09-10T11:10:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55b3cea1fe80 0x55b3cea222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fd9feffd640 10 client.16005 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.145+0000 7fda1f7fe640 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55b3cea1fe80 0x55b3cea222a0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d7130be7262f server_cookie=8b3a8773b23d9c3e in_seq=0 out_seq=0 2024-09-10T11:10:38.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fd9feffd640 1 -- 172.21.15.59:0/955349996 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3ce905d70 con 0x55b3cea1fe80 2024-09-10T11:10:38.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fd9feffd640 10 client.16005 handle_command_reply: tid=0 2024-09-10T11:10:38.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 client.16005 shutdown 2024-09-10T11:10:38.160 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 -- 172.21.15.59:0/955349996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce9a4cb0 msgr2=0x55b3ce99f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce99f5a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fda18005e30 tx=0x7fda18005c50 comp rx=0 tx=0).stop 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 -- 172.21.15.59:0/955349996 shutdown_connections 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55b3cea1fe80 0x55b3cea222a0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3ce9a4cb0 0x55b3ce99f5a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b3ce99a410 0x55b3ce99f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fd9feffd640 0 client.16005 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 --2- 172.21.15.59:0/955349996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b3ce999af0 0x55b3ce99eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 -- 172.21.15.59:0/955349996 >> 172.21.15.59:0/955349996 conn(0x55b3ce996060 msgr2=0x55b3ce9a3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 -- 172.21.15.59:0/955349996 shutdown_connections 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 1 -- 172.21.15.59:0/955349996 wait complete. 2024-09-10T11:10:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.159+0000 7fda28824740 20 client.16005 trim_cache size 0 max 16384 2024-09-10T11:10:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:10:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:10:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:10:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 -- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fda080a2da0 msgr2=0x7fda080a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fda080a2da0 0x7fda080a5260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda18030040 tx=0x7fda1803c040 comp rx=0 tx=0).stop 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 -- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda20102c80 msgr2=0x7fda201982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda20102c80 0x7fda201982c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fda1000d950 tx=0x7fda1000de10 comp rx=0 tx=0).stop 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 -- 172.21.15.59:0/4179729980 shutdown_connections 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fda080a2da0 0x7fda080a5260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda2010c0d0 0x7fda2019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda201035a0 0x7fda20198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 --2- 172.21.15.59:0/4179729980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda20102c80 0x7fda201982c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 -- 172.21.15.59:0/4179729980 >> 172.21.15.59:0/4179729980 conn(0x7fda20077990 msgr2=0x7fda200fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 -- 172.21.15.59:0/4179729980 shutdown_connections 2024-09-10T11:10:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:38.160+0000 7fda25a8b640 1 -- 172.21.15.59:0/4179729980 wait complete. 2024-09-10T11:10:38.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:37 smithi181 ceph-mon[35409]: pgmap v287: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:38.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:37 smithi115 ceph-mon[34719]: pgmap v287: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:40.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:39 smithi059 ceph-mon[30978]: pgmap v288: 97 pgs: 97 active+clean; 1.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-09-10T11:10:40.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:39 smithi181 ceph-mon[35409]: pgmap v288: 97 pgs: 97 active+clean; 1.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-09-10T11:10:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:39 smithi115 ceph-mon[34719]: pgmap v288: 97 pgs: 97 active+clean; 1.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-09-10T11:10:42.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:41 smithi059 ceph-mon[30978]: pgmap v289: 97 pgs: 97 active+clean; 1.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-09-10T11:10:42.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:41 smithi181 ceph-mon[35409]: pgmap v289: 97 pgs: 97 active+clean; 1.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-09-10T11:10:42.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:41 smithi115 ceph-mon[34719]: pgmap v289: 97 pgs: 97 active+clean; 1.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-09-10T11:10:44.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:43 smithi059 ceph-mon[30978]: pgmap v290: 97 pgs: 97 active+clean; 1.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-09-10T11:10:44.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:43 smithi181 ceph-mon[35409]: pgmap v290: 97 pgs: 97 active+clean; 1.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-09-10T11:10:44.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:43 smithi115 ceph-mon[34719]: pgmap v290: 97 pgs: 97 active+clean; 1.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-09-10T11:10:46.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:45 smithi059 ceph-mon[30978]: pgmap v291: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-09-10T11:10:46.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:45 smithi181 ceph-mon[35409]: pgmap v291: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-09-10T11:10:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:45 smithi115 ceph-mon[34719]: pgmap v291: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-09-10T11:10:48.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:47 smithi059 ceph-mon[30978]: pgmap v292: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:10:48.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:47 smithi181 ceph-mon[35409]: pgmap v292: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:10:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:47 smithi115 ceph-mon[34719]: pgmap v292: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:10:50.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:49 smithi059 ceph-mon[30978]: pgmap v293: 97 pgs: 97 active+clean; 2.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:10:50.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:49 smithi181 ceph-mon[35409]: pgmap v293: 97 pgs: 97 active+clean; 2.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:10:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:49 smithi115 ceph-mon[34719]: pgmap v293: 97 pgs: 97 active+clean; 2.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-09-10T11:10:51.263 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.259+0000 7f87bb274640 1 -- 172.21.15.59:0/520449068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41009b0 msgr2=0x7f87b4100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.259+0000 7f87bb274640 1 --2- 172.21.15.59:0/520449068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41009b0 0x7f87b4100e10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009930 tx=0x7f87a402a420 comp rx=0 tx=0).stop 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.259+0000 7f87bb274640 1 -- 172.21.15.59:0/520449068 shutdown_connections 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.259+0000 7f87bb274640 1 --2- 172.21.15.59:0/520449068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87b4101350 0x7f87b410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.259+0000 7f87bb274640 1 --2- 172.21.15.59:0/520449068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41009b0 0x7f87b4100e10 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.259+0000 7f87bb274640 1 --2- 172.21.15.59:0/520449068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87b41069c0 0x7f87b4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.259+0000 7f87bb274640 1 -- 172.21.15.59:0/520449068 >> 172.21.15.59:0/520449068 conn(0x7f87b4077990 msgr2=0x7f87b40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.259+0000 7f87bb274640 1 -- 172.21.15.59:0/520449068 shutdown_connections 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.259+0000 7f87bb274640 1 -- 172.21.15.59:0/520449068 wait complete. 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87bb274640 1 Processor -- start 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87bb274640 1 -- start start 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87bb274640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87b41009b0 0x7f87b41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87bb274640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87b4101350 0x7f87b41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87bb274640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41069c0 0x7f87b419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87bb274640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f87b4110e00 con 0x7f87b41069c0 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87bb274640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f87b4110c80 con 0x7f87b41009b0 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87bb274640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87b4110f80 con 0x7f87b4101350 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87b9811640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41069c0 0x7f87b419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87b9811640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41069c0 0x7f87b419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55422/0 (socket says 172.21.15.59:55422) 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.260+0000 7f87b9811640 1 -- 172.21.15.59:0/812103000 learned_addr learned my addr 172.21.15.59:0/812103000 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b9010640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87b41009b0 0x7f87b41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b880f640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87b4101350 0x7f87b41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b9811640 1 -- 172.21.15.59:0/812103000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87b4101350 msgr2=0x7f87b41989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b9811640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87b4101350 0x7f87b41989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b9811640 1 -- 172.21.15.59:0/812103000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87b41009b0 msgr2=0x7f87b41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b9811640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87b41009b0 0x7f87b41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b9811640 1 -- 172.21.15.59:0/812103000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b419d3f0 con 0x7f87b41069c0 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b9010640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87b41009b0 0x7f87b41984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b880f640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87b4101350 0x7f87b41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87b9811640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41069c0 0x7f87b419ccc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009fd0 tx=0x7f87ac00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87aa7fc640 1 -- 172.21.15.59:0/812103000 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac017070 con 0x7f87b41069c0 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87aa7fc640 1 -- 172.21.15.59:0/812103000 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87ac003e50 con 0x7f87b41069c0 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87bb274640 1 -- 172.21.15.59:0/812103000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b419d6e0 con 0x7f87b41069c0 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87aa7fc640 1 -- 172.21.15.59:0/812103000 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0106c0 con 0x7f87b41069c0 2024-09-10T11:10:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.261+0000 7f87bb274640 1 -- 172.21.15.59:0/812103000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b41a4f70 con 0x7f87b41069c0 2024-09-10T11:10:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.264+0000 7f87aa7fc640 1 -- 172.21.15.59:0/812103000 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f87ac003970 con 0x7f87b41069c0 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.264+0000 7f87be016740 1 Processor -- start 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.264+0000 7f87be016740 1 -- start start 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87be016740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dcf9d0 0x5615a7dcfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87be016740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dd02f0 0x5615a7ddeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87be016740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 0x5615a7de14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87be016740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5615a7d342f0 con 0x5615a7dd02f0 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87be016740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5615a7cdc270 con 0x5615a7dcf9d0 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87be016740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5615a7d302b0 con 0x5615a7ddf0c0 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9010640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dd02f0 0x5615a7ddeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87aa7fc640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f87a00a2da0 0x7f87a00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9010640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dd02f0 0x5615a7ddeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55426/0 (socket says 172.21.15.59:55426) 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9010640 1 -- 172.21.15.59:0/144014272 learned_addr learned my addr 172.21.15.59:0/144014272 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b880f640 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 0x5615a7de14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9811640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f87a00a2da0 0x7f87a00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b880f640 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dcf9d0 0x5615a7dcfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9010640 1 -- 172.21.15.59:0/144014272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 msgr2=0x5615a7de14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9010640 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 0x5615a7de14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87aa7fc640 1 -- 172.21.15.59:0/812103000 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7f87ac0cf350 con 0x7f87b41069c0 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9010640 1 -- 172.21.15.59:0/144014272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dcf9d0 msgr2=0x5615a7dcfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9010640 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dcf9d0 0x5615a7dcfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9010640 1 -- 172.21.15.59:0/144014272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a7cdb340 con 0x5615a7dd02f0 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b880f640 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 0x5615a7de14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9010640 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dd02f0 0x5615a7ddeb80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009c00 tx=0x7f87b000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f114619f1ddc5e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.265+0000 7f87b9811640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f87a00a2da0 0x7f87a00a5260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87ac09b750 tx=0x7f87ac086040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f879f7fe640 1 -- 172.21.15.59:0/144014272 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0016070 con 0x5615a7dd02f0 2024-09-10T11:10:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f879f7fe640 1 -- 172.21.15.59:0/144014272 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87b0005500 con 0x5615a7dd02f0 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f879f7fe640 1 -- 172.21.15.59:0/144014272 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b00116d0 con 0x5615a7dd02f0 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f87be016740 1 -- 172.21.15.59:0/144014272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dd02f0 msgr2=0x5615a7ddeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f87be016740 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dd02f0 0x5615a7ddeb80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009c00 tx=0x7f87b000e6c0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f87be016740 1 -- 172.21.15.59:0/144014272 shutdown_connections 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f87be016740 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 0x5615a7de14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f87be016740 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dd02f0 0x5615a7ddeb80 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f87be016740 1 --2- 172.21.15.59:0/144014272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dcf9d0 0x5615a7dcfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f87be016740 1 -- 172.21.15.59:0/144014272 >> 172.21.15.59:0/144014272 conn(0x5615a7dcc060 msgr2=0x5615a7dcc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f87be016740 1 -- 172.21.15.59:0/144014272 shutdown_connections 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.266+0000 7f87be016740 1 -- 172.21.15.59:0/144014272 wait complete. 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.267+0000 7f87be016740 1 -- start start 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.267+0000 7f87be016740 1 Processor -- start 2024-09-10T11:10:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.267+0000 7f87be016740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 0x5615a7ddbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.267+0000 7f87be016740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7ddc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.267+0000 7f87be016740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7ddca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.267+0000 7f87be016740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5615a7de1cf0 con 0x5615a7ddf0c0 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.267+0000 7f87be016740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5615a7cbd290 con 0x5615a7dd02f0 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.267+0000 7f87be016740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5615a7de1e70 con 0x5615a7dcf9d0 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.267+0000 7f87be016740 10 client.0 _ll_register_callbacks cb 0x5615a7cee140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7ddca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7ddca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55440/0 (socket says 172.21.15.59:55440) 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 -- 172.21.15.59:0/4045929008 learned_addr learned my addr 172.21.15.59:0/4045929008 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b9010640 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7ddc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 0x5615a7ddbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 -- 172.21.15.59:0/4045929008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 msgr2=0x5615a7ddbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 0x5615a7ddbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 -- 172.21.15.59:0/4045929008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 msgr2=0x5615a7ddc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7ddc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 -- 172.21.15.59:0/4045929008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a7a47210 con 0x5615a7ddf0c0 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87b880f640 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7ddca40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f87a40057c0 tx=0x7f87a402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b1bb36704e9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f879cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f879cff9640 1 -- 172.21.15.59:0/4045929008 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4044030 con 0x5615a7ddf0c0 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f879cff9640 1 -- 172.21.15.59:0/4045929008 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7f87a403ea00 con 0x5615a7ddf0c0 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87be016740 1 -- 172.21.15.59:0/4045929008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87b0005500 con 0x5615a7ddf0c0 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f879cff9640 1 -- 172.21.15.59:0/4045929008 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f87a4050050 con 0x5615a7ddf0c0 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.268+0000 7f87be016740 10 client.16017 fetch_fsmap learned FSMap version 26 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f87be016740 1 -- 172.21.15.59:0/4045929008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5615a7b13620 con 0x5615a7ddf0c0 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f879cff9640 1 -- 172.21.15.59:0/4045929008 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87b0005500 con 0x5615a7ddf0c0 2024-09-10T11:10:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f879cff9640 1 -- 172.21.15.59:0/4045929008 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f87a403a040 con 0x5615a7ddf0c0 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f87be016740 10 client.16017 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f87be016740 10 client.16017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f87be016740 20 client.16017 populate_metadata read hostname 'smithi059' 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f87be016740 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5615a7deefe0 0x5615a7df13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f87be016740 4 client.16017 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f87be016740 1 -- 172.21.15.59:0/4045929008 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615a7d41a20 con 0x5615a7deefe0 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.269+0000 7f87b9010640 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5615a7deefe0 0x5615a7df13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.270+0000 7f87b9010640 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5615a7deefe0 0x5615a7df13d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afb6bbdeccf82ce4 server_cookie=76e57725ca4ea530 in_seq=0 out_seq=0 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.270+0000 7f879cff9640 10 client.16017 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.270+0000 7f879cff9640 1 -- 172.21.15.59:0/4045929008 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615a7d41a20 con 0x5615a7deefe0 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.270+0000 7f879cff9640 10 client.16017 handle_command_reply: tid=0 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.270+0000 7f87be016740 1 client.16017 shutdown 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.270+0000 7f87be016740 1 -- 172.21.15.59:0/4045929008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 msgr2=0x5615a7ddca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.270+0000 7f87be016740 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7ddca40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f87a40057c0 tx=0x7f87a402a420 comp rx=0 tx=0).stop 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f87be016740 1 -- 172.21.15.59:0/4045929008 shutdown_connections 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f87be016740 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5615a7deefe0 0x5615a7df13d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f87be016740 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7ddca40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f87be016740 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7ddc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f879cff9640 0 client.16017 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f87be016740 1 --2- 172.21.15.59:0/4045929008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 0x5615a7ddbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f87be016740 1 -- 172.21.15.59:0/4045929008 >> 172.21.15.59:0/4045929008 conn(0x5615a7dcc060 msgr2=0x5615a7dd1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f87be016740 1 -- 172.21.15.59:0/4045929008 shutdown_connections 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f87be016740 1 -- 172.21.15.59:0/4045929008 wait complete. 2024-09-10T11:10:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.271+0000 7f87be016740 20 client.16017 trim_cache size 0 max 16384 2024-09-10T11:10:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.285+0000 7f87be016740 1 Processor -- start 2024-09-10T11:10:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.285+0000 7f87be016740 1 -- start start 2024-09-10T11:10:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87be016740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dcf9d0 0x5615a7dddf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87be016740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7df6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87be016740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 0x5615a7df71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87be016740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f87b41ae130 con 0x5615a7dcf9d0 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87be016740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f87b41aba00 con 0x5615a7dd02f0 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87be016740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87b41a9870 con 0x5615a7ddf0c0 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87b880f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dcf9d0 0x5615a7dddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87b880f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dcf9d0 0x5615a7dddf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55452/0 (socket says 172.21.15.59:55452) 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87b880f640 1 -- 172.21.15.59:0/3497279436 learned_addr learned my addr 172.21.15.59:0/3497279436 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87b880f640 1 -- 172.21.15.59:0/3497279436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 msgr2=0x5615a7df71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87b880f640 1 --2- 172.21.15.59:0/3497279436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 0x5615a7df71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87b880f640 1 -- 172.21.15.59:0/3497279436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 msgr2=0x5615a7df6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87b880f640 1 --2- 172.21.15.59:0/3497279436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7df6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87b880f640 1 -- 172.21.15.59:0/3497279436 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a7dd0120 con 0x5615a7dcf9d0 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f87b880f640 1 --2- 172.21.15.59:0/3497279436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dcf9d0 0x5615a7dddf30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f87a4031b90 tx=0x7f87a403e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6f4a80894f01f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f879effd640 1 -- 172.21.15.59:0/3497279436 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4058070 con 0x5615a7dcf9d0 2024-09-10T11:10:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f879effd640 1 -- 172.21.15.59:0/3497279436 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87a40037f0 con 0x5615a7dcf9d0 2024-09-10T11:10:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.286+0000 7f879effd640 1 -- 172.21.15.59:0/3497279436 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4044040 con 0x5615a7dcf9d0 2024-09-10T11:10:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 -- 172.21.15.59:0/3497279436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dcf9d0 msgr2=0x5615a7dddf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 --2- 172.21.15.59:0/3497279436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dcf9d0 0x5615a7dddf30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f87a4031b90 tx=0x7f87a403e750 comp rx=0 tx=0).stop 2024-09-10T11:10:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 -- 172.21.15.59:0/3497279436 shutdown_connections 2024-09-10T11:10:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 --2- 172.21.15.59:0/3497279436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7ddf0c0 0x5615a7df71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 --2- 172.21.15.59:0/3497279436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7df6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 --2- 172.21.15.59:0/3497279436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7dcf9d0 0x5615a7dddf30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 -- 172.21.15.59:0/3497279436 >> 172.21.15.59:0/3497279436 conn(0x5615a7dcc060 msgr2=0x5615a7ddd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 -- 172.21.15.59:0/3497279436 shutdown_connections 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 -- 172.21.15.59:0/3497279436 wait complete. 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.287+0000 7f87be016740 1 -- start start 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87be016740 1 Processor -- start 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87be016740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 0x5615a7de79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87be016740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7dd8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87be016740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7dd95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87be016740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f87b41a9ec0 con 0x5615a7ddf0c0 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87be016740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f87b41ab330 con 0x5615a7dd02f0 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87be016740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87b41aa590 con 0x5615a7dcf9d0 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87be016740 10 client.0 _ll_register_callbacks cb 0x7f87a4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87b880f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7dd95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87b880f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7dd95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55466/0 (socket says 172.21.15.59:55466) 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87b880f640 1 -- 172.21.15.59:0/3721987613 learned_addr learned my addr 172.21.15.59:0/3721987613 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87b9010640 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7dd8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87b880f640 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 0x5615a7de79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87b880f640 1 -- 172.21.15.59:0/3721987613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 msgr2=0x5615a7de79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87b880f640 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 0x5615a7de79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.288+0000 7f87b880f640 1 -- 172.21.15.59:0/3721987613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 msgr2=0x5615a7dd8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87b880f640 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7dd8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87b880f640 1 -- 172.21.15.59:0/3721987613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a7e58c60 con 0x5615a7ddf0c0 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87b9010640 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7dd8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87b880f640 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7dd95b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f87a4003a80 tx=0x7f87a402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c860e80d850bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f879cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f879cff9640 1 -- 172.21.15.59:0/3721987613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4044070 con 0x5615a7ddf0c0 2024-09-10T11:10:51.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87be016740 1 -- 172.21.15.59:0/3721987613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87a40037f0 con 0x5615a7ddf0c0 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f879cff9640 1 -- 172.21.15.59:0/3721987613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7f87a403ea00 con 0x5615a7ddf0c0 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f879cff9640 1 -- 172.21.15.59:0/3721987613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f87a4058040 con 0x5615a7ddf0c0 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87be016740 10 client.16023 fetch_fsmap learned FSMap version 26 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87be016740 1 -- 172.21.15.59:0/3721987613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5615a7e59dc0 con 0x5615a7ddf0c0 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f879cff9640 1 -- 172.21.15.59:0/3721987613 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87a40037f0 con 0x5615a7ddf0c0 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f879cff9640 1 -- 172.21.15.59:0/3721987613 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f87a405e030 con 0x5615a7ddf0c0 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87be016740 10 client.16023 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87be016740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.289+0000 7f87be016740 20 client.16023 populate_metadata read hostname 'smithi059' 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.290+0000 7f87be016740 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5615a7e5a420 0x5615a7e5c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.290+0000 7f87be016740 4 client.16023 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.290+0000 7f87be016740 1 -- 172.21.15.59:0/3721987613 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5615a7d3bd70 con 0x5615a7e5a420 2024-09-10T11:10:51.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.290+0000 7f87b9010640 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5615a7e5a420 0x5615a7e5c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:10:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.290+0000 7f879cff9640 10 client.16023 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:51.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.290+0000 7f87b9010640 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5615a7e5a420 0x5615a7e5c840 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f41971679488e7e server_cookie=ac5b6d4c9b5e7b99 in_seq=0 out_seq=0 2024-09-10T11:10:51.306 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f879cff9640 1 -- 172.21.15.59:0/3721987613 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5615a7d3bd70 con 0x5615a7e5a420 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f879cff9640 10 client.16023 handle_command_reply: tid=0 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f87be016740 1 client.16023 shutdown 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f87be016740 1 -- 172.21.15.59:0/3721987613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 msgr2=0x5615a7dd95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f87be016740 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7dd95b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f87a4003a80 tx=0x7f87a402a420 comp rx=0 tx=0).stop 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f87be016740 1 -- 172.21.15.59:0/3721987613 shutdown_connections 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f87be016740 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5615a7e5a420 0x5615a7e5c840 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f87be016740 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615a7ddf0c0 0x5615a7dd95b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f87be016740 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5615a7dd02f0 0x5615a7dd8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f87be016740 1 --2- 172.21.15.59:0/3721987613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5615a7dcf9d0 0x5615a7de79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f879cff9640 0 client.16023 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:10:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.304+0000 7f87be016740 1 -- 172.21.15.59:0/3721987613 >> 172.21.15.59:0/3721987613 conn(0x5615a7dcc060 msgr2=0x5615a7dd1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87be016740 1 -- 172.21.15.59:0/3721987613 shutdown_connections 2024-09-10T11:10:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87be016740 1 -- 172.21.15.59:0/3721987613 wait complete. 2024-09-10T11:10:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87be016740 20 client.16023 trim_cache size 0 max 16384 2024-09-10T11:10:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:10:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:10:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:10:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:10:51.309 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 -- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f87a00a2da0 msgr2=0x7f87a00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:51.309 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f87a00a2da0 0x7f87a00a5260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87ac09b750 tx=0x7f87ac086040 comp rx=0 tx=0).stop 2024-09-10T11:10:51.309 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 -- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41069c0 msgr2=0x7f87b419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:10:51.309 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41069c0 0x7f87b419ccc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009fd0 tx=0x7f87ac00b260 comp rx=0 tx=0).stop 2024-09-10T11:10:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 -- 172.21.15.59:0/812103000 shutdown_connections 2024-09-10T11:10:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b41069c0 0x7f87b419ccc0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f87a00a2da0 0x7f87a00a5260 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87b4101350 0x7f87b41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 --2- 172.21.15.59:0/812103000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87b41009b0 0x7f87b41984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:10:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.305+0000 7f87bb274640 1 -- 172.21.15.59:0/812103000 >> 172.21.15.59:0/812103000 conn(0x7f87b4077990 msgr2=0x7f87b4069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:10:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.306+0000 7f87bb274640 1 -- 172.21.15.59:0/812103000 shutdown_connections 2024-09-10T11:10:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:10:51.306+0000 7f87bb274640 1 -- 172.21.15.59:0/812103000 wait complete. 2024-09-10T11:10:51.790 INFO:tasks.workunit.client.0.smithi059.stdout:437/600: open fd = 3 2024-09-10T11:10:51.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.790 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.790 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:438/600: open fd = 3 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:439/600: open fd = 3 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:440/600: open fd = 3 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.791 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:441/600: open fd = 3 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:442/600: open fd = 3 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:443/600: open fd = 3 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.792 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:444/600: open fd = 3 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:445/600: open fd = 3 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:446/600: open fd = 3 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.793 INFO:tasks.workunit.client.0.smithi059.stdout:447/600: open fd = 3 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:448/600: open fd = 3 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:449/600: open fd = 3 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.794 INFO:tasks.workunit.client.0.smithi059.stdout:450/600: open fd = 3 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:451/600: open fd = 3 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:452/600: open fd = 3 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.795 INFO:tasks.workunit.client.0.smithi059.stdout:453/600: open fd = 3 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:454/600: open fd = 3 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:455/600: open fd = 3 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:456/600: open fd = 3 2024-09-10T11:10:51.796 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:457/600: open fd = 3 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:458/600: open fd = 3 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:459/600: open fd = 3 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.797 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:460/600: open fd = 3 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:461/600: open fd = 3 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:462/600: open fd = 3 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.798 INFO:tasks.workunit.client.0.smithi059.stdout:463/600: open fd = 3 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:464/600: open fd = 3 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:465/600: open fd = 3 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:466/600: open fd = 3 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.799 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:467/600: open fd = 3 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:468/600: open fd = 3 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:469/600: open fd = 3 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.800 INFO:tasks.workunit.client.0.smithi059.stdout:470/600: open fd = 3 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:471/600: open fd = 3 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:472/600: open fd = 3 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:473/600: open fd = 3 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.801 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:474/600: open fd = 3 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:475/600: open fd = 3 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:476/600: open fd = 3 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.802 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:477/600: open fd = 3 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:478/600: open fd = 3 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:479/600: open fd = 3 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:480/600: open fd = 3 2024-09-10T11:10:51.803 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:481/600: open fd = 3 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:482/600: open fd = 3 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:483/600: open fd = 3 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.804 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:484/600: open fd = 3 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:485/600: open fd = 3 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:486/600: open fd = 3 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.805 INFO:tasks.workunit.client.0.smithi059.stdout:487/600: open fd = 3 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:488/600: open fd = 3 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:489/600: open fd = 3 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:490/600: open fd = 3 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.806 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:491/600: open fd = 3 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:492/600: open fd = 3 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:493/600: open fd = 3 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.807 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.808 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.808 INFO:tasks.workunit.client.0.smithi059.stdout:494/600: open fd = 3 2024-09-10T11:10:51.808 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.808 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.808 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.808 INFO:tasks.workunit.client.0.smithi059.stdout:495/600: open fd = 3 2024-09-10T11:10:51.808 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.808 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.808 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:496/600: open fd = 3 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:497/600: open fd = 3 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:498/600: open fd = 3 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:10:51.809 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:10:52.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:51 smithi059 ceph-mon[30978]: pgmap v294: 97 pgs: 97 active+clean; 2.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:10:52.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:51 smithi181 ceph-mon[35409]: pgmap v294: 97 pgs: 97 active+clean; 2.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:10:52.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:51 smithi115 ceph-mon[34719]: pgmap v294: 97 pgs: 97 active+clean; 2.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:10:54.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:53 smithi059 ceph-mon[30978]: pgmap v295: 97 pgs: 97 active+clean; 2.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:10:54.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:53 smithi181 ceph-mon[35409]: pgmap v295: 97 pgs: 97 active+clean; 2.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:10:54.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:53 smithi115 ceph-mon[34719]: pgmap v295: 97 pgs: 97 active+clean; 2.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:10:56.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:55 smithi059 ceph-mon[30978]: pgmap v296: 97 pgs: 97 active+clean; 2.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:10:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:55 smithi181 ceph-mon[35409]: pgmap v296: 97 pgs: 97 active+clean; 2.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:10:56.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:55 smithi115 ceph-mon[34719]: pgmap v296: 97 pgs: 97 active+clean; 2.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:10:58.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:57 smithi059 ceph-mon[30978]: pgmap v297: 97 pgs: 97 active+clean; 2.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:58.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:57 smithi181 ceph-mon[35409]: pgmap v297: 97 pgs: 97 active+clean; 2.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:10:58.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:57 smithi115 ceph-mon[34719]: pgmap v297: 97 pgs: 97 active+clean; 2.3 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:00.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:10:59 smithi059 ceph-mon[30978]: pgmap v298: 97 pgs: 97 active+clean; 2.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:11:00.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:10:59 smithi181 ceph-mon[35409]: pgmap v298: 97 pgs: 97 active+clean; 2.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:11:00.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:10:59 smithi115 ceph-mon[34719]: pgmap v298: 97 pgs: 97 active+clean; 2.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:11:02.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:01 smithi059 ceph-mon[30978]: pgmap v299: 97 pgs: 97 active+clean; 2.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:11:02.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:01 smithi181 ceph-mon[35409]: pgmap v299: 97 pgs: 97 active+clean; 2.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:11:02.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:01 smithi115 ceph-mon[34719]: pgmap v299: 97 pgs: 97 active+clean; 2.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:11:04.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:03 smithi059 ceph-mon[30978]: pgmap v300: 97 pgs: 97 active+clean; 2.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:11:04.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:03 smithi181 ceph-mon[35409]: pgmap v300: 97 pgs: 97 active+clean; 2.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:11:04.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:03 smithi115 ceph-mon[34719]: pgmap v300: 97 pgs: 97 active+clean; 2.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:11:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.405+0000 7fa4643f6640 1 -- 172.21.15.59:0/1511513327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c102cc0 msgr2=0x7fa45c1030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.405+0000 7fa4643f6640 1 --2- 172.21.15.59:0/1511513327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c102cc0 0x7fa45c1030a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa458009900 tx=0x7fa45802a480 comp rx=0 tx=0).stop 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.405+0000 7fa4643f6640 1 -- 172.21.15.59:0/1511513327 shutdown_connections 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.405+0000 7fa4643f6640 1 --2- 172.21.15.59:0/1511513327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa45c10c110 0x7fa45c10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.405+0000 7fa4643f6640 1 --2- 172.21.15.59:0/1511513327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45c1035e0 0x7fa45c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.405+0000 7fa4643f6640 1 --2- 172.21.15.59:0/1511513327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c102cc0 0x7fa45c1030a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.405+0000 7fa4643f6640 1 -- 172.21.15.59:0/1511513327 >> 172.21.15.59:0/1511513327 conn(0x7fa45c0fc6b0 msgr2=0x7fa45c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 -- 172.21.15.59:0/1511513327 shutdown_connections 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 -- 172.21.15.59:0/1511513327 wait complete. 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 Processor -- start 2024-09-10T11:11:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 -- start start 2024-09-10T11:11:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa45c102cc0 0x7fa45c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45c1035e0 0x7fa45c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c10c110 0x7fa45c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c111ef0 con 0x7fa45c10c110 2024-09-10T11:11:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c111d70 con 0x7fa45c102cc0 2024-09-10T11:11:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.406+0000 7fa4643f6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c112070 con 0x7fa45c1035e0 2024-09-10T11:11:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462993640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c10c110 0x7fa45c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462993640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c10c110 0x7fa45c19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45232/0 (socket says 172.21.15.59:45232) 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462993640 1 -- 172.21.15.59:0/248768338 learned_addr learned my addr 172.21.15.59:0/248768338 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa461991640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45c1035e0 0x7fa45c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462192640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa45c102cc0 0x7fa45c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462993640 1 -- 172.21.15.59:0/248768338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45c1035e0 msgr2=0x7fa45c1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462993640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45c1035e0 0x7fa45c1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462993640 1 -- 172.21.15.59:0/248768338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa45c102cc0 msgr2=0x7fa45c198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462993640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa45c102cc0 0x7fa45c198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462993640 1 -- 172.21.15.59:0/248768338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c19d360 con 0x7fa45c10c110 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462192640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa45c102cc0 0x7fa45c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa462993640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c10c110 0x7fa45c19cc30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa45400eaa0 tx=0x7fa45400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa4537fe640 1 -- 172.21.15.59:0/248768338 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45400cdb0 con 0x7fa45c10c110 2024-09-10T11:11:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa4537fe640 1 -- 172.21.15.59:0/248768338 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa454005020 con 0x7fa45c10c110 2024-09-10T11:11:04.414 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa4643f6640 1 -- 172.21.15.59:0/248768338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45c19d650 con 0x7fa45c10c110 2024-09-10T11:11:04.414 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa4537fe640 1 -- 172.21.15.59:0/248768338 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4540116b0 con 0x7fa45c10c110 2024-09-10T11:11:04.414 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.407+0000 7fa4643f6640 1 -- 172.21.15.59:0/248768338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa45c1a4ee0 con 0x7fa45c10c110 2024-09-10T11:11:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.410+0000 7fa4537fe640 1 -- 172.21.15.59:0/248768338 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa454005560 con 0x7fa45c10c110 2024-09-10T11:11:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.410+0000 7fa46726c740 1 Processor -- start 2024-09-10T11:11:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa46726c740 1 -- start start 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa46726c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c729d0 0x55ae45c72db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa46726c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 0x55ae45c81b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa46726c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c820c0 0x55ae45c844b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa46726c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ae45bd72f0 con 0x55ae45c820c0 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa46726c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ae45b7f270 con 0x55ae45c729d0 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa46726c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ae45bd32b0 con 0x55ae45c732f0 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa461991640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c820c0 0x55ae45c844b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa461991640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c820c0 0x55ae45c844b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45240/0 (socket says 172.21.15.59:45240) 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa461991640 1 -- 172.21.15.59:0/2687212090 learned_addr learned my addr 172.21.15.59:0/2687212090 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa4537fe640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa4480a2e20 0x7fa4480a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa462192640 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 0x55ae45c81b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa461991640 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c729d0 0x55ae45c72db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.411+0000 7fa462993640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa4480a2e20 0x7fa4480a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa462192640 1 -- 172.21.15.59:0/2687212090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c729d0 msgr2=0x55ae45c72db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa4537fe640 1 -- 172.21.15.59:0/248768338 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7fa4540cf690 con 0x7fa45c10c110 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa462192640 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c729d0 0x55ae45c72db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa462192640 1 -- 172.21.15.59:0/2687212090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c820c0 msgr2=0x55ae45c844b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa462192640 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c820c0 0x55ae45c844b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa462192640 1 -- 172.21.15.59:0/2687212090 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae45b7e340 con 0x55ae45c732f0 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa461991640 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c820c0 0x55ae45c844b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa462192640 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 0x55ae45c81b80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa458009230 tx=0x7fa458032cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3899486d4c5fb582 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa462993640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa4480a2e20 0x7fa4480a52e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4540054f0 tx=0x7fa454086040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa450bfe640 1 -- 172.21.15.59:0/2687212090 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458035030 con 0x55ae45c732f0 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa450bfe640 1 -- 172.21.15.59:0/2687212090 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4580317b0 con 0x55ae45c732f0 2024-09-10T11:11:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.412+0000 7fa450bfe640 1 -- 172.21.15.59:0/2687212090 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458005600 con 0x55ae45c732f0 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 -- 172.21.15.59:0/2687212090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 msgr2=0x55ae45c81b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 0x55ae45c81b80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa458009230 tx=0x7fa458032cb0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 -- 172.21.15.59:0/2687212090 shutdown_connections 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c820c0 0x55ae45c844b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 0x55ae45c81b80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 --2- 172.21.15.59:0/2687212090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c729d0 0x55ae45c72db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 -- 172.21.15.59:0/2687212090 >> 172.21.15.59:0/2687212090 conn(0x55ae45c6f060 msgr2=0x55ae45c6f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 -- 172.21.15.59:0/2687212090 shutdown_connections 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 -- 172.21.15.59:0/2687212090 wait complete. 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 -- start start 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.413+0000 7fa46726c740 1 Processor -- start 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa46726c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c7eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa46726c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 0x55ae45c7f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa46726c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 0x55ae45c7fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa46726c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ae45c84c90 con 0x55ae45c729d0 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa46726c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ae45b60290 con 0x55ae45c820c0 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa46726c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ae45c84e10 con 0x55ae45c732f0 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa46726c740 10 client.0 _ll_register_callbacks cb 0x55ae45b91140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c7eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c7eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45242/0 (socket says 172.21.15.59:45242) 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 -- 172.21.15.59:0/3777810469 learned_addr learned my addr 172.21.15.59:0/3777810469 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa462192640 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 0x55ae45c7f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 0x55ae45c7fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 -- 172.21.15.59:0/3777810469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 msgr2=0x55ae45c7f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 0x55ae45c7f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 -- 172.21.15.59:0/3777810469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 msgr2=0x55ae45c7fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 0x55ae45c7fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 -- 172.21.15.59:0/3777810469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae458ea210 con 0x55ae45c729d0 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.414+0000 7fa461991640 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c7eff0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0044e0 tx=0x7fa44c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496b81e53c8d0d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa445ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa445ffb640 1 -- 172.21.15.59:0/3777810469 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c012b10 con 0x55ae45c729d0 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa46726c740 1 -- 172.21.15.59:0/3777810469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4580317b0 con 0x55ae45c729d0 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa445ffb640 1 -- 172.21.15.59:0/3777810469 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7fa44c012cb0 con 0x55ae45c729d0 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa445ffb640 1 -- 172.21.15.59:0/3777810469 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa44c028050 con 0x55ae45c729d0 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa46726c740 10 client.16035 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa46726c740 1 -- 172.21.15.59:0/3777810469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ae459b6620 con 0x55ae45c729d0 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa445ffb640 1 -- 172.21.15.59:0/3777810469 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4580317b0 con 0x55ae45c729d0 2024-09-10T11:11:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa445ffb640 1 -- 172.21.15.59:0/3777810469 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa44c020020 con 0x55ae45c729d0 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa46726c740 10 client.16035 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa46726c740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa46726c740 20 client.16035 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa46726c740 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ae45c92090 0x55ae45c94480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa46726c740 4 client.16035 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.415+0000 7fa46726c740 1 -- 172.21.15.59:0/3777810469 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae45be4a20 con 0x55ae45c92090 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.416+0000 7fa462192640 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ae45c92090 0x55ae45c94480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.416+0000 7fa445ffb640 10 client.16035 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.416+0000 7fa462192640 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ae45c92090 0x55ae45c94480 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1be6837385e67828 server_cookie=8bce12895d101332 in_seq=0 out_seq=0 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa445ffb640 1 -- 172.21.15.59:0/3777810469 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae45be4a20 con 0x55ae45c92090 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa445ffb640 10 client.16035 handle_command_reply: tid=0 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa46726c740 1 client.16035 shutdown 2024-09-10T11:11:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa46726c740 1 -- 172.21.15.59:0/3777810469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 msgr2=0x55ae45c7eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa46726c740 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c7eff0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0044e0 tx=0x7fa44c014040 comp rx=0 tx=0).stop 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa46726c740 1 -- 172.21.15.59:0/3777810469 shutdown_connections 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa46726c740 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ae45c92090 0x55ae45c94480 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa46726c740 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 0x55ae45c7fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa445ffb640 0 client.16035 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa46726c740 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c732f0 0x55ae45c7f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa46726c740 1 --2- 172.21.15.59:0/3777810469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c7eff0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.417+0000 7fa46726c740 1 -- 172.21.15.59:0/3777810469 >> 172.21.15.59:0/3777810469 conn(0x55ae45c6f060 msgr2=0x55ae45c74dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.418+0000 7fa46726c740 1 -- 172.21.15.59:0/3777810469 shutdown_connections 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.418+0000 7fa46726c740 1 -- 172.21.15.59:0/3777810469 wait complete. 2024-09-10T11:11:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.418+0000 7fa46726c740 20 client.16035 trim_cache size 0 max 16384 2024-09-10T11:11:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.432+0000 7fa46726c740 1 Processor -- start 2024-09-10T11:11:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.432+0000 7fa46726c740 1 -- start start 2024-09-10T11:11:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.432+0000 7fa46726c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c99d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.432+0000 7fa46726c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c732f0 0x55ae45c9a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.432+0000 7fa46726c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c820c0 0x55ae45c7c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.432+0000 7fa46726c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c1ae000 con 0x55ae45c729d0 2024-09-10T11:11:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.432+0000 7fa46726c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c1ab8d0 con 0x55ae45c732f0 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.432+0000 7fa46726c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c1a9740 con 0x55ae45c820c0 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c99d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c99d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45250/0 (socket says 172.21.15.59:45250) 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 -- 172.21.15.59:0/663263301 learned_addr learned my addr 172.21.15.59:0/663263301 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c820c0 0x55ae45c7c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa462192640 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c732f0 0x55ae45c9a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 -- 172.21.15.59:0/663263301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c820c0 msgr2=0x55ae45c7c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c820c0 0x55ae45c7c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 -- 172.21.15.59:0/663263301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c732f0 msgr2=0x55ae45c9a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c732f0 0x55ae45c9a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 -- 172.21.15.59:0/663263301 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae45c73120 con 0x55ae45c729d0 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa462192640 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c732f0 0x55ae45c9a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:11:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa461991640 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c99d70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa44c021640 tx=0x7fa44c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819a569f70f589a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa447fff640 1 -- 172.21.15.59:0/663263301 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00b2e0 con 0x55ae45c729d0 2024-09-10T11:11:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa447fff640 1 -- 172.21.15.59:0/663263301 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa44c012130 con 0x55ae45c729d0 2024-09-10T11:11:04.437 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.433+0000 7fa447fff640 1 -- 172.21.15.59:0/663263301 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00f3f0 con 0x55ae45c729d0 2024-09-10T11:11:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 -- 172.21.15.59:0/663263301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 msgr2=0x55ae45c99d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c99d70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa44c021640 tx=0x7fa44c00bf30 comp rx=0 tx=0).stop 2024-09-10T11:11:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 -- 172.21.15.59:0/663263301 shutdown_connections 2024-09-10T11:11:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c820c0 0x55ae45c7c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c732f0 0x55ae45c9a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 --2- 172.21.15.59:0/663263301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c729d0 0x55ae45c99d70 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 -- 172.21.15.59:0/663263301 >> 172.21.15.59:0/663263301 conn(0x55ae45c6f060 msgr2=0x55ae45c6e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 -- 172.21.15.59:0/663263301 shutdown_connections 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 -- 172.21.15.59:0/663263301 wait complete. 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 -- start start 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.434+0000 7fa46726c740 1 Processor -- start 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa46726c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c729d0 0x55ae45c8a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa46726c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c732f0 0x55ae45c85ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa46726c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 0x55ae45c86470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa46726c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c1a9d90 con 0x55ae45c732f0 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa46726c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c1ab200 con 0x55ae45c820c0 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa46726c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c1aa460 con 0x55ae45c729d0 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa46726c740 10 client.0 _ll_register_callbacks cb 0x7fa44c00bd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa462192640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c732f0 0x55ae45c85ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa462192640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c732f0 0x55ae45c85ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45258/0 (socket says 172.21.15.59:45258) 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa462192640 1 -- 172.21.15.59:0/2116195542 learned_addr learned my addr 172.21.15.59:0/2116195542 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa461991640 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c729d0 0x55ae45c8a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa461991640 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 0x55ae45c86470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa462192640 1 -- 172.21.15.59:0/2116195542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c729d0 msgr2=0x55ae45c8a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa462192640 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c729d0 0x55ae45c8a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa462192640 1 -- 172.21.15.59:0/2116195542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 msgr2=0x55ae45c86470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa462192640 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 0x55ae45c86470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa462192640 1 -- 172.21.15.59:0/2116195542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae45cfbd40 con 0x55ae45c732f0 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa461991640 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 0x55ae45c86470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa462192640 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c732f0 0x55ae45c85ce0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa458033000 tx=0x7fa458005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0a4df7b6e3f345 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa445ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.435+0000 7fa445ffb640 1 -- 172.21.15.59:0/2116195542 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458035040 con 0x55ae45c732f0 2024-09-10T11:11:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa445ffb640 1 -- 172.21.15.59:0/2116195542 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7fa458031730 con 0x55ae45c732f0 2024-09-10T11:11:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa46726c740 1 -- 172.21.15.59:0/2116195542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa44c012130 con 0x55ae45c732f0 2024-09-10T11:11:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa445ffb640 1 -- 172.21.15.59:0/2116195542 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa458031930 con 0x55ae45c732f0 2024-09-10T11:11:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa46726c740 10 client.16041 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa46726c740 1 -- 172.21.15.59:0/2116195542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ae45cfcea0 con 0x55ae45c732f0 2024-09-10T11:11:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa445ffb640 1 -- 172.21.15.59:0/2116195542 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa44c012130 con 0x55ae45c732f0 2024-09-10T11:11:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa445ffb640 1 -- 172.21.15.59:0/2116195542 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa458003ae0 con 0x55ae45c732f0 2024-09-10T11:11:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa46726c740 10 client.16041 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa46726c740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa46726c740 20 client.16041 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa46726c740 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ae45cfd1e0 0x55ae45cff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa46726c740 4 client.16041 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:11:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa46726c740 1 -- 172.21.15.59:0/2116195542 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae45bded70 con 0x55ae45cfd1e0 2024-09-10T11:11:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.436+0000 7fa461991640 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ae45cfd1e0 0x55ae45cff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.437+0000 7fa445ffb640 10 client.16041 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.437+0000 7fa461991640 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ae45cfd1e0 0x55ae45cff5d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f32af767c70987a1 server_cookie=c292a0d1c6b10921 in_seq=0 out_seq=0 2024-09-10T11:11:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa445ffb640 1 -- 172.21.15.59:0/2116195542 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae45bded70 con 0x55ae45cfd1e0 2024-09-10T11:11:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa445ffb640 10 client.16041 handle_command_reply: tid=0 2024-09-10T11:11:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 client.16041 shutdown 2024-09-10T11:11:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 -- 172.21.15.59:0/2116195542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c732f0 msgr2=0x55ae45c85ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c732f0 0x55ae45c85ce0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa458033000 tx=0x7fa458005300 comp rx=0 tx=0).stop 2024-09-10T11:11:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 -- 172.21.15.59:0/2116195542 shutdown_connections 2024-09-10T11:11:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55ae45cfd1e0 0x55ae45cff5d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae45c820c0 0x55ae45c86470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae45c732f0 0x55ae45c85ce0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa445ffb640 0 client.16041 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 --2- 172.21.15.59:0/2116195542 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae45c729d0 0x55ae45c8a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 -- 172.21.15.59:0/2116195542 >> 172.21.15.59:0/2116195542 conn(0x55ae45c6f060 msgr2=0x55ae45c744f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 -- 172.21.15.59:0/2116195542 shutdown_connections 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 1 -- 172.21.15.59:0/2116195542 wait complete. 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.451+0000 7fa46726c740 20 client.16041 trim_cache size 0 max 16384 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:11:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:11:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 -- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa4480a2e20 msgr2=0x7fa4480a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa4480a2e20 0x7fa4480a52e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4540054f0 tx=0x7fa454086040 comp rx=0 tx=0).stop 2024-09-10T11:11:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 -- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c10c110 msgr2=0x7fa45c19cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c10c110 0x7fa45c19cc30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa45400eaa0 tx=0x7fa45400ef60 comp rx=0 tx=0).stop 2024-09-10T11:11:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 -- 172.21.15.59:0/248768338 shutdown_connections 2024-09-10T11:11:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c10c110 0x7fa45c19cc30 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fa4480a2e20 0x7fa4480a52e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa45c1035e0 0x7fa45c1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 --2- 172.21.15.59:0/248768338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa45c102cc0 0x7fa45c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 -- 172.21.15.59:0/248768338 >> 172.21.15.59:0/248768338 conn(0x7fa45c0fc6b0 msgr2=0x7fa45c0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 -- 172.21.15.59:0/248768338 shutdown_connections 2024-09-10T11:11:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:04.452+0000 7fa4643f6640 1 -- 172.21.15.59:0/248768338 wait complete. 2024-09-10T11:11:06.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:05 smithi059 ceph-mon[30978]: pgmap v301: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 106 KiB/s wr, 34 op/s 2024-09-10T11:11:06.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:05 smithi181 ceph-mon[35409]: pgmap v301: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 106 KiB/s wr, 34 op/s 2024-09-10T11:11:06.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:05 smithi115 ceph-mon[34719]: pgmap v301: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 106 KiB/s wr, 34 op/s 2024-09-10T11:11:08.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:07 smithi059 ceph-mon[30978]: pgmap v302: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 82 KiB/s wr, 26 op/s 2024-09-10T11:11:08.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:07 smithi059 ceph-mon[30978]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T11:11:08.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:07 smithi181 ceph-mon[35409]: pgmap v302: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 82 KiB/s wr, 26 op/s 2024-09-10T11:11:08.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:07 smithi181 ceph-mon[35409]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T11:11:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:07 smithi115 ceph-mon[34719]: pgmap v302: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 82 KiB/s wr, 26 op/s 2024-09-10T11:11:08.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:07 smithi115 ceph-mon[34719]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T11:11:10.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:09 smithi059 ceph-mon[30978]: pgmap v304: 97 pgs: 97 active+clean; 3.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-10T11:11:10.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:09 smithi181 ceph-mon[35409]: pgmap v304: 97 pgs: 97 active+clean; 3.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-10T11:11:10.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:09 smithi115 ceph-mon[34719]: pgmap v304: 97 pgs: 97 active+clean; 3.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-10T11:11:12.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:11 smithi059 ceph-mon[30978]: pgmap v305: 97 pgs: 97 active+clean; 3.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-10T11:11:12.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:11 smithi181 ceph-mon[35409]: pgmap v305: 97 pgs: 97 active+clean; 3.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-10T11:11:12.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:11 smithi115 ceph-mon[34719]: pgmap v305: 97 pgs: 97 active+clean; 3.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-10T11:11:14.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:13 smithi059 ceph-mon[30978]: pgmap v306: 97 pgs: 97 active+clean; 3.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-10T11:11:14.141 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:13 smithi059 ceph-mon[30978]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T11:11:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:13 smithi181 ceph-mon[35409]: pgmap v306: 97 pgs: 97 active+clean; 3.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-10T11:11:14.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:13 smithi181 ceph-mon[35409]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T11:11:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:13 smithi115 ceph-mon[34719]: pgmap v306: 97 pgs: 97 active+clean; 3.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-10T11:11:14.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:13 smithi115 ceph-mon[34719]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T11:11:16.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:15 smithi059 ceph-mon[30978]: pgmap v308: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 65 KiB/s wr, 18 op/s 2024-09-10T11:11:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:15 smithi181 ceph-mon[35409]: pgmap v308: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 65 KiB/s wr, 18 op/s 2024-09-10T11:11:16.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:15 smithi115 ceph-mon[34719]: pgmap v308: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 65 KiB/s wr, 18 op/s 2024-09-10T11:11:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 -- 172.21.15.59:0/732248898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 msgr2=0x7fc9c0106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 --2- 172.21.15.59:0/732248898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 0x7fc9c0106600 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009930 tx=0x7fc9b002a420 comp rx=0 tx=0).stop 2024-09-10T11:11:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 -- 172.21.15.59:0/732248898 shutdown_connections 2024-09-10T11:11:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 --2- 172.21.15.59:0/732248898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0100fd0 0x7fc9c010d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 --2- 172.21.15.59:0/732248898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c0100630 0x7fc9c0100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 --2- 172.21.15.59:0/732248898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 0x7fc9c0106600 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 -- 172.21.15.59:0/732248898 >> 172.21.15.59:0/732248898 conn(0x7fc9c0075ef0 msgr2=0x7fc9c0076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 -- 172.21.15.59:0/732248898 shutdown_connections 2024-09-10T11:11:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 -- 172.21.15.59:0/732248898 wait complete. 2024-09-10T11:11:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 Processor -- start 2024-09-10T11:11:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.552+0000 7fc9c681e640 1 -- start start 2024-09-10T11:11:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c681e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c0100630 0x7fc9c0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c681e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0100fd0 0x7fc9c01988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c681e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 0x7fc9c019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c681e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c010fd30 con 0x7fc9c0106220 2024-09-10T11:11:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c681e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c010fbb0 con 0x7fc9c0100fd0 2024-09-10T11:11:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c681e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c010feb0 con 0x7fc9c0100630 2024-09-10T11:11:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c4dbb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 0x7fc9c019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c4dbb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 0x7fc9c019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38698/0 (socket says 172.21.15.59:38698) 2024-09-10T11:11:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c4dbb640 1 -- 172.21.15.59:0/3698442320 learned_addr learned my addr 172.21.15.59:0/3698442320 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9bffff640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c0100630 0x7fc9c0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0100fd0 0x7fc9c01988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c4dbb640 1 -- 172.21.15.59:0/3698442320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c0100630 msgr2=0x7fc9c0198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c4dbb640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c0100630 0x7fc9c0198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c4dbb640 1 -- 172.21.15.59:0/3698442320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0100fd0 msgr2=0x7fc9c01988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c4dbb640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0100fd0 0x7fc9c01988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.553+0000 7fc9c4dbb640 1 -- 172.21.15.59:0/3698442320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c019d370 con 0x7fc9c0106220 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.554+0000 7fc9c4dbb640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 0x7fc9c019cc40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800dd70 tx=0x7fc9b800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.554+0000 7fc9bd7fa640 1 -- 172.21.15.59:0/3698442320 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8004d20 con 0x7fc9c0106220 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.554+0000 7fc9bd7fa640 1 -- 172.21.15.59:0/3698442320 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b800be40 con 0x7fc9c0106220 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.554+0000 7fc9c681e640 1 -- 172.21.15.59:0/3698442320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c019d660 con 0x7fc9c0106220 2024-09-10T11:11:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.554+0000 7fc9bd7fa640 1 -- 172.21.15.59:0/3698442320 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8005720 con 0x7fc9c0106220 2024-09-10T11:11:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.554+0000 7fc9c681e640 1 -- 172.21.15.59:0/3698442320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c01a4ef0 con 0x7fc9c0106220 2024-09-10T11:11:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.557+0000 7fc9bd7fa640 1 -- 172.21.15.59:0/3698442320 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc9b80058c0 con 0x7fc9c0106220 2024-09-10T11:11:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.557+0000 7fc9c968f740 1 Processor -- start 2024-09-10T11:11:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.557+0000 7fc9c968f740 1 -- start start 2024-09-10T11:11:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.557+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a86ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.557+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 0x5654a4a91770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9c968f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5654a49eb2f0 con 0x5654a4a91cb0 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9c968f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5654a4993270 con 0x5654a4a86af0 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9c968f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5654a49e72b0 con 0x5654a4a87410 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a940a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38700/0 (socket says 172.21.15.59:38700) 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/116147610 learned_addr learned my addr 172.21.15.59:0/116147610 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/116147610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a86ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bffff640 1 --2- 172.21.15.59:0/116147610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 0x5654a4a91770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bd7fa640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc9a80a2e20 0x7fc9a80a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/116147610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 msgr2=0x5654a4a91770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/116147610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 0x5654a4a91770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/116147610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 msgr2=0x5654a4a86ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/116147610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a86ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/116147610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a4992340 con 0x5654a4a91cb0 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9c4dbb640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc9a80a2e20 0x7fc9a80a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bd7fa640 1 -- 172.21.15.59:0/3698442320 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7fc9b80cf850 con 0x7fc9c0106220 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.558+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/116147610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a940a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40127a0 tx=0x7fc9b400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec8fc071f12cd07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9a67fc640 1 -- 172.21.15.59:0/116147610 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4012c60 con 0x5654a4a91cb0 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9a67fc640 1 -- 172.21.15.59:0/116147610 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b4012e00 con 0x5654a4a91cb0 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9a67fc640 1 -- 172.21.15.59:0/116147610 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4004a30 con 0x5654a4a91cb0 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c968f740 1 -- 172.21.15.59:0/116147610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 msgr2=0x5654a4a940a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c968f740 1 --2- 172.21.15.59:0/116147610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a940a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40127a0 tx=0x7fc9b400b7c0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c4dbb640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc9a80a2e20 0x7fc9a80a52e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80cd110 tx=0x7fc9b806bc90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c968f740 1 -- 172.21.15.59:0/116147610 shutdown_connections 2024-09-10T11:11:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c968f740 1 --2- 172.21.15.59:0/116147610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a940a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c968f740 1 --2- 172.21.15.59:0/116147610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 0x5654a4a91770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c968f740 1 --2- 172.21.15.59:0/116147610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a86ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c968f740 1 -- 172.21.15.59:0/116147610 >> 172.21.15.59:0/116147610 conn(0x5654a4a83060 msgr2=0x5654a4a83440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c968f740 1 -- 172.21.15.59:0/116147610 shutdown_connections 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.559+0000 7fc9c968f740 1 -- 172.21.15.59:0/116147610 wait complete. 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9c968f740 1 -- start start 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9c968f740 1 Processor -- start 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a8eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a87410 0x5654a4a8f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 0x5654a4a8f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9c968f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5654a4a94880 con 0x5654a4a87410 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9c968f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5654a4974290 con 0x5654a4a86af0 2024-09-10T11:11:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9c968f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5654a4a94a00 con 0x5654a4a91cb0 2024-09-10T11:11:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9c968f740 10 client.0 _ll_register_callbacks cb 0x5654a49a5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9bffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a87410 0x5654a4a8f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.560+0000 7fc9bffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a87410 0x5654a4a8f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38706/0 (socket says 172.21.15.59:38706) 2024-09-10T11:11:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bffff640 1 -- 172.21.15.59:0/3790356797 learned_addr learned my addr 172.21.15.59:0/3790356797 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 0x5654a4a8f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a8eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bffff640 1 -- 172.21.15.59:0/3790356797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 msgr2=0x5654a4a8f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bffff640 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 0x5654a4a8f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bffff640 1 -- 172.21.15.59:0/3790356797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 msgr2=0x5654a4a8eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bffff640 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a8eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bffff640 1 -- 172.21.15.59:0/3790356797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654a46fe210 con 0x5654a4a87410 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 0x5654a4a8f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9bffff640 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a87410 0x5654a4a8f0d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc9b002a940 tx=0x7fc9b0031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3bd491911287d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc99f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc99f7fe640 1 -- 172.21.15.59:0/3790356797 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0035040 con 0x5654a4a87410 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc99f7fe640 1 -- 172.21.15.59:0/3790356797 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7fc9b0004460 con 0x5654a4a87410 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9c968f740 1 -- 172.21.15.59:0/3790356797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9b4012e00 con 0x5654a4a87410 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc99f7fe640 1 -- 172.21.15.59:0/3790356797 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9b0005020 con 0x5654a4a87410 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9c968f740 10 client.16053 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.561+0000 7fc9c968f740 1 -- 172.21.15.59:0/3790356797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5654a47ca620 con 0x5654a4a87410 2024-09-10T11:11:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.562+0000 7fc99f7fe640 1 -- 172.21.15.59:0/3790356797 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b4012e00 con 0x5654a4a87410 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.562+0000 7fc99f7fe640 1 -- 172.21.15.59:0/3790356797 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc9b00035f0 con 0x5654a4a87410 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.562+0000 7fc9c968f740 10 client.16053 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.562+0000 7fc9c968f740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.562+0000 7fc9c968f740 20 client.16053 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.562+0000 7fc9c968f740 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5654a4aa1c20 0x5654a4aa4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.562+0000 7fc9c968f740 4 client.16053 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.562+0000 7fc9c968f740 1 -- 172.21.15.59:0/3790356797 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654a49f8a20 con 0x5654a4aa1c20 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.562+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5654a4aa1c20 0x5654a4aa4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.563+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5654a4aa1c20 0x5654a4aa4010 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9919d412f8ff6f14 server_cookie=6eb520d23028ac81 in_seq=0 out_seq=0 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.563+0000 7fc99f7fe640 10 client.16053 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.563+0000 7fc99f7fe640 1 -- 172.21.15.59:0/3790356797 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654a49f8a20 con 0x5654a4aa1c20 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.563+0000 7fc99f7fe640 10 client.16053 handle_command_reply: tid=0 2024-09-10T11:11:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.563+0000 7fc9c968f740 1 client.16053 shutdown 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 -- 172.21.15.59:0/3790356797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a87410 msgr2=0x5654a4a8f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a87410 0x5654a4a8f0d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc9b002a940 tx=0x7fc9b0031920 comp rx=0 tx=0).stop 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 -- 172.21.15.59:0/3790356797 shutdown_connections 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5654a4aa1c20 0x5654a4aa4010 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 0x5654a4a8f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a87410 0x5654a4a8f0d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc99f7fe640 0 client.16053 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 --2- 172.21.15.59:0/3790356797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a8eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 -- 172.21.15.59:0/3790356797 >> 172.21.15.59:0/3790356797 conn(0x5654a4a83060 msgr2=0x5654a4a88d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 -- 172.21.15.59:0/3790356797 shutdown_connections 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 1 -- 172.21.15.59:0/3790356797 wait complete. 2024-09-10T11:11:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.564+0000 7fc9c968f740 20 client.16053 trim_cache size 0 max 16384 2024-09-10T11:11:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.578+0000 7fc9c968f740 1 Processor -- start 2024-09-10T11:11:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.578+0000 7fc9c968f740 1 -- start start 2024-09-10T11:11:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a86af0 0x5654a4a8f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a87410 0x5654a4aa9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 0x5654a4aa9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9c968f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01b0250 con 0x5654a4a86af0 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9c968f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01adb20 con 0x5654a4a87410 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9c968f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01ab990 con 0x5654a4a91cb0 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a86af0 0x5654a4a8f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a86af0 0x5654a4a8f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38722/0 (socket says 172.21.15.59:38722) 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/1592646890 learned_addr learned my addr 172.21.15.59:0/1592646890 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bffff640 1 --2- 172.21.15.59:0/1592646890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a87410 0x5654a4aa9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/1592646890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 msgr2=0x5654a4aa9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/1592646890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 0x5654a4aa9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/1592646890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a87410 msgr2=0x5654a4aa9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/1592646890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a87410 0x5654a4aa9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/1592646890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a4a82e90 con 0x5654a4a86af0 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bffff640 1 --2- 172.21.15.59:0/1592646890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a87410 0x5654a4aa9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/1592646890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a86af0 0x5654a4a8f440 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001eb0 tx=0x7fc9b400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad5b3db3cd0c422 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9a5ffb640 1 -- 172.21.15.59:0/1592646890 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4012df0 con 0x5654a4a86af0 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9a5ffb640 1 -- 172.21.15.59:0/1592646890 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b4005070 con 0x5654a4a86af0 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.579+0000 7fc9a5ffb640 1 -- 172.21.15.59:0/1592646890 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4003950 con 0x5654a4a86af0 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 -- 172.21.15.59:0/1592646890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a86af0 msgr2=0x5654a4a8f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1592646890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a86af0 0x5654a4a8f440 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001eb0 tx=0x7fc9b400b7c0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 -- 172.21.15.59:0/1592646890 shutdown_connections 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1592646890 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a91cb0 0x5654a4aa9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1592646890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a87410 0x5654a4aa9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1592646890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a86af0 0x5654a4a8f440 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 -- 172.21.15.59:0/1592646890 >> 172.21.15.59:0/1592646890 conn(0x5654a4a83060 msgr2=0x5654a4a90c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 -- 172.21.15.59:0/1592646890 shutdown_connections 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 -- 172.21.15.59:0/1592646890 wait complete. 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.580+0000 7fc9c968f740 1 -- start start 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9c968f740 1 Processor -- start 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a9a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 0x5654a4a958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9c968f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a96040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9c968f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01abfe0 con 0x5654a4a91cb0 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9c968f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01ad450 con 0x5654a4a86af0 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9c968f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01ac6b0 con 0x5654a4a87410 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9c968f740 10 client.0 _ll_register_callbacks cb 0x7fc9b0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a96040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a96040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38728/0 (socket says 172.21.15.59:38728) 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/1419314347 learned_addr learned my addr 172.21.15.59:0/1419314347 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a9a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bffff640 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 0x5654a4a958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/1419314347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 msgr2=0x5654a4a958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 0x5654a4a958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/1419314347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 msgr2=0x5654a4a9a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a9a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.581+0000 7fc9bf7fe640 1 -- 172.21.15.59:0/1419314347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654a4b0b8f0 con 0x5654a4a91cb0 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9bf7fe640 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a96040 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4005800 tx=0x7fc9b40035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552ffa73ad091f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc99f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc99f7fe640 1 -- 172.21.15.59:0/1419314347 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4010740 con 0x5654a4a91cb0 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc99f7fe640 1 -- 172.21.15.59:0/1419314347 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7fc9b40108e0 con 0x5654a4a91cb0 2024-09-10T11:11:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9c968f740 1 -- 172.21.15.59:0/1419314347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9b4005070 con 0x5654a4a91cb0 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc99f7fe640 1 -- 172.21.15.59:0/1419314347 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9b4010ae0 con 0x5654a4a91cb0 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9c968f740 10 client.16059 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9c968f740 1 -- 172.21.15.59:0/1419314347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5654a4b0ca00 con 0x5654a4a91cb0 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc99f7fe640 1 -- 172.21.15.59:0/1419314347 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b4005070 con 0x5654a4a91cb0 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc99f7fe640 1 -- 172.21.15.59:0/1419314347 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc9b402a630 con 0x5654a4a91cb0 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9c968f740 10 client.16059 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9c968f740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9c968f740 20 client.16059 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5654a4b0ce70 0x5654a4b0f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9c968f740 4 client.16059 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.582+0000 7fc9c968f740 1 -- 172.21.15.59:0/1419314347 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5654a49f2d70 con 0x5654a4b0ce70 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.583+0000 7fc9bffff640 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5654a4b0ce70 0x5654a4b0f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.583+0000 7fc9bffff640 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5654a4b0ce70 0x5654a4b0f260 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11987ab91ce0782d server_cookie=525cf3455f5c7f6 in_seq=0 out_seq=0 2024-09-10T11:11:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.583+0000 7fc99f7fe640 10 client.16059 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.597+0000 7fc99f7fe640 1 -- 172.21.15.59:0/1419314347 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5654a49f2d70 con 0x5654a4b0ce70 2024-09-10T11:11:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.597+0000 7fc99f7fe640 10 client.16059 handle_command_reply: tid=0 2024-09-10T11:11:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.597+0000 7fc9c968f740 1 client.16059 shutdown 2024-09-10T11:11:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 -- 172.21.15.59:0/1419314347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 msgr2=0x5654a4a96040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a96040 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4005800 tx=0x7fc9b40035f0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 -- 172.21.15.59:0/1419314347 shutdown_connections 2024-09-10T11:11:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5654a4b0ce70 0x5654a4b0f260 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654a4a91cb0 0x5654a4a96040 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654a4a87410 0x5654a4a958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc99f7fe640 0 client.16059 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 --2- 172.21.15.59:0/1419314347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5654a4a86af0 0x5654a4a9a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 -- 172.21.15.59:0/1419314347 >> 172.21.15.59:0/1419314347 conn(0x5654a4a83060 msgr2=0x5654a4a819a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 -- 172.21.15.59:0/1419314347 shutdown_connections 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 1 -- 172.21.15.59:0/1419314347 wait complete. 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c968f740 20 client.16059 trim_cache size 0 max 16384 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:11:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:11:17.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c681e640 1 -- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc9a80a2e20 msgr2=0x7fc9a80a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:17.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c681e640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc9a80a2e20 0x7fc9a80a52e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80cd110 tx=0x7fc9b806bc90 comp rx=0 tx=0).stop 2024-09-10T11:11:17.602 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c681e640 1 -- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 msgr2=0x7fc9c019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.598+0000 7fc9c681e640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 0x7fc9c019cc40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800dd70 tx=0x7fc9b800b730 comp rx=0 tx=0).stop 2024-09-10T11:11:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.599+0000 7fc9c681e640 1 -- 172.21.15.59:0/3698442320 shutdown_connections 2024-09-10T11:11:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.599+0000 7fc9c681e640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c0106220 0x7fc9c019cc40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.599+0000 7fc9c681e640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0100fd0 0x7fc9c01988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.599+0000 7fc9c681e640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fc9a80a2e20 0x7fc9a80a52e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.599+0000 7fc9c681e640 1 --2- 172.21.15.59:0/3698442320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc9c0100630 0x7fc9c0198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.599+0000 7fc9c681e640 1 -- 172.21.15.59:0/3698442320 >> 172.21.15.59:0/3698442320 conn(0x7fc9c0075ef0 msgr2=0x7fc9c01045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.599+0000 7fc9c681e640 1 -- 172.21.15.59:0/3698442320 shutdown_connections 2024-09-10T11:11:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:17.599+0000 7fc9c681e640 1 -- 172.21.15.59:0/3698442320 wait complete. 2024-09-10T11:11:18.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:17 smithi181 ceph-mon[35409]: pgmap v309: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 15 op/s 2024-09-10T11:11:18.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:17 smithi115 ceph-mon[34719]: pgmap v309: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 15 op/s 2024-09-10T11:11:18.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:17 smithi059 ceph-mon[30978]: pgmap v309: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 15 op/s 2024-09-10T11:11:20.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:19 smithi181 ceph-mon[35409]: pgmap v310: 97 pgs: 97 active+clean; 3.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:11:20.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:19 smithi115 ceph-mon[34719]: pgmap v310: 97 pgs: 97 active+clean; 3.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:11:20.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:19 smithi059 ceph-mon[30978]: pgmap v310: 97 pgs: 97 active+clean; 3.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:11:22.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:21 smithi181 ceph-mon[35409]: pgmap v311: 97 pgs: 97 active+clean; 3.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:11:22.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:21 smithi115 ceph-mon[34719]: pgmap v311: 97 pgs: 97 active+clean; 3.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:11:22.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:21 smithi059 ceph-mon[30978]: pgmap v311: 97 pgs: 97 active+clean; 3.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:11:24.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:23 smithi181 ceph-mon[35409]: pgmap v312: 97 pgs: 97 active+clean; 3.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:11:24.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:23 smithi115 ceph-mon[34719]: pgmap v312: 97 pgs: 97 active+clean; 3.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:11:24.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:23 smithi059 ceph-mon[30978]: pgmap v312: 97 pgs: 97 active+clean; 3.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-10T11:11:26.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:25 smithi181 ceph-mon[35409]: pgmap v313: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-10T11:11:26.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:25 smithi115 ceph-mon[34719]: pgmap v313: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-10T11:11:26.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:25 smithi059 ceph-mon[30978]: pgmap v313: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-10T11:11:28.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:27 smithi181 ceph-mon[35409]: pgmap v314: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:11:28.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:27 smithi115 ceph-mon[34719]: pgmap v314: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:11:28.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:27 smithi059 ceph-mon[30978]: pgmap v314: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-10T11:11:30.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:29 smithi181 ceph-mon[35409]: pgmap v315: 97 pgs: 97 active+clean; 3.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:11:30.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:29 smithi115 ceph-mon[34719]: pgmap v315: 97 pgs: 97 active+clean; 3.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:11:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:29 smithi059 ceph-mon[30978]: pgmap v315: 97 pgs: 97 active+clean; 3.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:11:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.699+0000 7f4cd063c640 1 -- 172.21.15.59:0/1636309200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81069c0 msgr2=0x7f4cc8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.699+0000 7f4cd063c640 1 --2- 172.21.15.59:0/1636309200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81069c0 0x7f4cc8106da0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009930 tx=0x7f4cc402a420 comp rx=0 tx=0).stop 2024-09-10T11:11:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.699+0000 7f4cd063c640 1 -- 172.21.15.59:0/1636309200 shutdown_connections 2024-09-10T11:11:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.699+0000 7f4cd063c640 1 --2- 172.21.15.59:0/1636309200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc8101350 0x7f4cc810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.699+0000 7f4cd063c640 1 --2- 172.21.15.59:0/1636309200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc81009b0 0x7f4cc8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.699+0000 7f4cd063c640 1 --2- 172.21.15.59:0/1636309200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81069c0 0x7f4cc8106da0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.699+0000 7f4cd063c640 1 -- 172.21.15.59:0/1636309200 >> 172.21.15.59:0/1636309200 conn(0x7f4cc8077990 msgr2=0x7f4cc80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.699+0000 7f4cd063c640 1 -- 172.21.15.59:0/1636309200 shutdown_connections 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.699+0000 7f4cd063c640 1 -- 172.21.15.59:0/1636309200 wait complete. 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cd063c640 1 Processor -- start 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cd063c640 1 -- start start 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cd063c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81009b0 0x7f4cc81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cd063c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc8101350 0x7f4cc81996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cd063c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc81069c0 0x7f4cc81a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cd063c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8110e00 con 0x7f4cc81009b0 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cd063c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8110c80 con 0x7f4cc8101350 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cd063c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8110f80 con 0x7f4cc81069c0 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cce3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81009b0 0x7f4cc81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cce3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81009b0 0x7f4cc81991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41566/0 (socket says 172.21.15.59:41566) 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cce3d8640 1 -- 172.21.15.59:0/2072404455 learned_addr learned my addr 172.21.15.59:0/2072404455 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc81069c0 0x7f4cc81a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc8101350 0x7f4cc81996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cce3d8640 1 -- 172.21.15.59:0/2072404455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc81069c0 msgr2=0x7f4cc81a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc81069c0 0x7f4cc81a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cce3d8640 1 -- 172.21.15.59:0/2072404455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc8101350 msgr2=0x7f4cc81996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc8101350 0x7f4cc81996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4cce3d8640 1 -- 172.21.15.59:0/2072404455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc81a4770 con 0x7f4cc81009b0 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.700+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc8101350 0x7f4cc81996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.701+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81009b0 0x7f4cc81991b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009a50 tx=0x7f4cc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.701+0000 7f4cbf7fe640 1 -- 172.21.15.59:0/2072404455 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc403f030 con 0x7f4cc81009b0 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.701+0000 7f4cbf7fe640 1 -- 172.21.15.59:0/2072404455 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cc4003ce0 con 0x7f4cc81009b0 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.701+0000 7f4cd063c640 1 -- 172.21.15.59:0/2072404455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc81a4940 con 0x7f4cc81009b0 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.701+0000 7f4cbf7fe640 1 -- 172.21.15.59:0/2072404455 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4035070 con 0x7f4cc81009b0 2024-09-10T11:11:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.701+0000 7f4cd063c640 1 -- 172.21.15.59:0/2072404455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc81a4e00 con 0x7f4cc81009b0 2024-09-10T11:11:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4cbf7fe640 1 -- 172.21.15.59:0/2072404455 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4cc4042030 con 0x7f4cc81009b0 2024-09-10T11:11:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4cd33d7740 1 Processor -- start 2024-09-10T11:11:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4cd33d7740 1 -- start start 2024-09-10T11:11:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 0x559e0d10fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d11eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d1214b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.711 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559e0d0742f0 con 0x559e0d11f0c0 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559e0d01c270 con 0x559e0d1102f0 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559e0d0702b0 con 0x559e0d10f9d0 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4ccdbd7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d1214b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4ccdbd7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d1214b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41576/0 (socket says 172.21.15.59:41576) 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4ccdbd7640 1 -- 172.21.15.59:0/1873947993 learned_addr learned my addr 172.21.15.59:0/1873947993 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.704+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 0x559e0d10fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d11eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4cbf7fe640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4cb40a2e20 0x7f4cb40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4ccdbd7640 1 -- 172.21.15.59:0/1873947993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 msgr2=0x559e0d10fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 0x559e0d10fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4ccdbd7640 1 -- 172.21.15.59:0/1873947993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 msgr2=0x559e0d11eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d11eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.712 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4ccdbd7640 1 -- 172.21.15.59:0/1873947993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0d01b340 con 0x559e0d11f0c0 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d11eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4cb40a2e20 0x7f4cb40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4cbf7fe640 1 -- 172.21.15.59:0/2072404455 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f4cc40ef9a0 con 0x7f4cc81009b0 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d1214b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8007830 tx=0x7f4cb8007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4c636942f57368 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4cbcbfe640 1 -- 172.21.15.59:0/1873947993 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800d950 con 0x559e0d11f0c0 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4cbcbfe640 1 -- 172.21.15.59:0/1873947993 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb8018070 con 0x559e0d11f0c0 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.705+0000 7f4cbcbfe640 1 -- 172.21.15.59:0/1873947993 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80123e0 con 0x559e0d11f0c0 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1873947993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 msgr2=0x559e0d1214b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4cb40a2e20 0x7f4cb40a52e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0003970 tx=0x7f4cc0004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d1214b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8007830 tx=0x7f4cb8007cf0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1873947993 shutdown_connections 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d1214b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d11eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.713 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1873947993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 0x559e0d10fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1873947993 >> 172.21.15.59:0/1873947993 conn(0x559e0d10c060 msgr2=0x559e0d10c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1873947993 shutdown_connections 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.706+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1873947993 wait complete. 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cd33d7740 1 -- start start 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cd33d7740 1 Processor -- start 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 0x559e0d11bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d11c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d11ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559e0d121cf0 con 0x559e0d11f0c0 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559e0cffd290 con 0x559e0d1102f0 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559e0d121e70 con 0x559e0d10f9d0 2024-09-10T11:11:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cd33d7740 10 client.0 _ll_register_callbacks cb 0x559e0d02e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4ccebd9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d11ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4cce3d8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 0x559e0d11bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4ccebd9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d11ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41582/0 (socket says 172.21.15.59:41582) 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4ccebd9640 1 -- 172.21.15.59:0/1060575472 learned_addr learned my addr 172.21.15.59:0/1060575472 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.707+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d11c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4ccebd9640 1 -- 172.21.15.59:0/1060575472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 msgr2=0x559e0d11bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 0x559e0d11bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4ccebd9640 1 -- 172.21.15.59:0/1060575472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 msgr2=0x559e0d11c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d11c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4ccebd9640 1 -- 172.21.15.59:0/1060575472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e0cd87210 con 0x559e0d11f0c0 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d11ca40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00077f0 tx=0x7f4cc0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca7fca5bed95fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:30.715 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4cb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/1060575472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0010b90 con 0x559e0d11f0c0 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1060575472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb8018070 con 0x559e0d11f0c0 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/1060575472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f4cc0010d30 con 0x559e0d11f0c0 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/1060575472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4cc001f400 con 0x559e0d11f0c0 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4cd33d7740 10 client.16071 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1060575472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559e0ce53620 con 0x559e0d11f0c0 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/1060575472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb8018070 con 0x559e0d11f0c0 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.708+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/1060575472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4cc001b830 con 0x559e0d11f0c0 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.709+0000 7f4cd33d7740 10 client.16071 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.709+0000 7f4cd33d7740 10 client.16071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.709+0000 7f4cd33d7740 20 client.16071 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.709+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x559e0d12f0e0 0x559e0d1314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.709+0000 7f4cd33d7740 4 client.16071 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:11:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.709+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1060575472 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e0d081a20 con 0x559e0d12f0e0 2024-09-10T11:11:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.709+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x559e0d12f0e0 0x559e0d1314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.709+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x559e0d12f0e0 0x559e0d1314f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ca91868505ee6c2 server_cookie=d6af27e2b00e1d52 in_seq=0 out_seq=0 2024-09-10T11:11:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.709+0000 7f4cb1ffb640 10 client.16071 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/1060575472 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e0d081a20 con 0x559e0d12f0e0 2024-09-10T11:11:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cb1ffb640 10 client.16071 handle_command_reply: tid=0 2024-09-10T11:11:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 client.16071 shutdown 2024-09-10T11:11:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1060575472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 msgr2=0x559e0d11ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d11ca40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00077f0 tx=0x7f4cc0004ab0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1060575472 shutdown_connections 2024-09-10T11:11:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x559e0d12f0e0 0x559e0d1314f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d11f0c0 0x559e0d11ca40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cb1ffb640 0 client.16071 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d11c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/1060575472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d10f9d0 0x559e0d11bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1060575472 >> 172.21.15.59:0/1060575472 conn(0x559e0d10c060 msgr2=0x559e0d111d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1060575472 shutdown_connections 2024-09-10T11:11:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.710+0000 7f4cd33d7740 1 -- 172.21.15.59:0/1060575472 wait complete. 2024-09-10T11:11:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.711+0000 7f4cd33d7740 20 client.16071 trim_cache size 0 max 16384 2024-09-10T11:11:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.725+0000 7f4cd33d7740 1 Processor -- start 2024-09-10T11:11:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.725+0000 7f4cd33d7740 1 -- start start 2024-09-10T11:11:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.725+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d11df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.725+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d136e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.725+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d11f0c0 0x559e0d137390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.725+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81adfe0 con 0x559e0d10f9d0 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81ab8b0 con 0x559e0d1102f0 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81a9720 con 0x559e0d11f0c0 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cce3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d11df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cce3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d11df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41592/0 (socket says 172.21.15.59:41592) 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cce3d8640 1 -- 172.21.15.59:0/976423951 learned_addr learned my addr 172.21.15.59:0/976423951 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d136e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d11f0c0 0x559e0d137390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cce3d8640 1 -- 172.21.15.59:0/976423951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d11f0c0 msgr2=0x559e0d137390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d11f0c0 0x559e0d137390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cce3d8640 1 -- 172.21.15.59:0/976423951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 msgr2=0x559e0d136e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d136e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cce3d8640 1 -- 172.21.15.59:0/976423951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0d10be90 con 0x559e0d10f9d0 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d136e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d11f0c0 0x559e0d137390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d11df30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40ed100 tx=0x7f4cc402f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a1024578b5fb8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cb3fff640 1 -- 172.21.15.59:0/976423951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4049040 con 0x559e0d10f9d0 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cb3fff640 1 -- 172.21.15.59:0/976423951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cc40efe50 con 0x559e0d10f9d0 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.726+0000 7f4cb3fff640 1 -- 172.21.15.59:0/976423951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40ed320 con 0x559e0d10f9d0 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 -- 172.21.15.59:0/976423951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 msgr2=0x559e0d11df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d11df30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40ed100 tx=0x7f4cc402f000 comp rx=0 tx=0).stop 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 -- 172.21.15.59:0/976423951 shutdown_connections 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d11f0c0 0x559e0d137390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.733 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d1102f0 0x559e0d136e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/976423951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d11df30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 -- 172.21.15.59:0/976423951 >> 172.21.15.59:0/976423951 conn(0x559e0d10c060 msgr2=0x559e0d11d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 -- 172.21.15.59:0/976423951 shutdown_connections 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 -- 172.21.15.59:0/976423951 wait complete. 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 -- start start 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.727+0000 7f4cd33d7740 1 Processor -- start 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d1231a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d1102f0 0x559e0d1236e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cd33d7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d11f0c0 0x559e0d123c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81a9d70 con 0x559e0d10f9d0 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81ab1e0 con 0x559e0d11f0c0 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cd33d7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81aa440 con 0x559e0d1102f0 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cd33d7740 10 client.0 _ll_register_callbacks cb 0x7f4cc0005bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:30.734 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cce3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d1231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cce3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d1231a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41608/0 (socket says 172.21.15.59:41608) 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cce3d8640 1 -- 172.21.15.59:0/2410421867 learned_addr learned my addr 172.21.15.59:0/2410421867 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d1102f0 0x559e0d1236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4ccebd9640 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d11f0c0 0x559e0d123c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cce3d8640 1 -- 172.21.15.59:0/2410421867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d1102f0 msgr2=0x559e0d1236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d1102f0 0x559e0d1236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cce3d8640 1 -- 172.21.15.59:0/2410421867 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d11f0c0 msgr2=0x559e0d123c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d11f0c0 0x559e0d123c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cce3d8640 1 -- 172.21.15.59:0/2410421867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e0d11bd90 con 0x559e0d10f9d0 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cce3d8640 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d1231a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4000c00 tx=0x7f4cc40ba340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99cb8be19da5246 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/2410421867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4049030 con 0x559e0d10f9d0 2024-09-10T11:11:30.735 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/2410421867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f4cc40b84e0 con 0x559e0d10f9d0 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.728+0000 7f4cd33d7740 1 -- 172.21.15.59:0/2410421867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cc40efe50 con 0x559e0d10f9d0 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/2410421867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4cc40bc570 con 0x559e0d10f9d0 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cd33d7740 10 client.16077 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cd33d7740 1 -- 172.21.15.59:0/2410421867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559e0d19a1c0 con 0x559e0d10f9d0 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/2410421867 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cc40efe50 con 0x559e0d10f9d0 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/2410421867 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4cc40c4650 con 0x559e0d10f9d0 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cd33d7740 10 client.16077 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cd33d7740 10 client.16077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cd33d7740 20 client.16077 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x559e0d19a6f0 0x559e0d19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cd33d7740 4 client.16077 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4cd33d7740 1 -- 172.21.15.59:0/2410421867 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559e0d07bd70 con 0x559e0d19a6f0 2024-09-10T11:11:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.729+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x559e0d19a6f0 0x559e0d19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:30.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.730+0000 7f4cb1ffb640 10 client.16077 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:30.737 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.730+0000 7f4ccdbd7640 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x559e0d19a6f0 0x559e0d19cae0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a5da0298807f261 server_cookie=125821e8e6d45cd2 in_seq=0 out_seq=0 2024-09-10T11:11:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cb1ffb640 1 -- 172.21.15.59:0/2410421867 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559e0d07bd70 con 0x559e0d19a6f0 2024-09-10T11:11:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cb1ffb640 10 client.16077 handle_command_reply: tid=0 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 client.16077 shutdown 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 -- 172.21.15.59:0/2410421867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 msgr2=0x559e0d1231a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d1231a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4000c00 tx=0x7f4cc40ba340 comp rx=0 tx=0).stop 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 -- 172.21.15.59:0/2410421867 shutdown_connections 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x559e0d19a6f0 0x559e0d19cae0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e0d11f0c0 0x559e0d123c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e0d1102f0 0x559e0d1236e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 --2- 172.21.15.59:0/2410421867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e0d10f9d0 0x559e0d1231a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cb1ffb640 0 client.16077 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 -- 172.21.15.59:0/2410421867 >> 172.21.15.59:0/2410421867 conn(0x559e0d10c060 msgr2=0x559e0d10b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 -- 172.21.15.59:0/2410421867 shutdown_connections 2024-09-10T11:11:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 1 -- 172.21.15.59:0/2410421867 wait complete. 2024-09-10T11:11:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd33d7740 20 client.16077 trim_cache size 0 max 16384 2024-09-10T11:11:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:11:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:11:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:11:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:11:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 -- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4cb40a2e20 msgr2=0x7f4cb40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4cb40a2e20 0x7f4cb40a52e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0003970 tx=0x7f4cc0004a40 comp rx=0 tx=0).stop 2024-09-10T11:11:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 -- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81009b0 msgr2=0x7f4cc81991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81009b0 0x7f4cc81991b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009a50 tx=0x7f4cc4004270 comp rx=0 tx=0).stop 2024-09-10T11:11:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 -- 172.21.15.59:0/2072404455 shutdown_connections 2024-09-10T11:11:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4cb40a2e20 0x7f4cb40a52e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc81069c0 0x7f4cc81a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc8101350 0x7f4cc81996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 --2- 172.21.15.59:0/2072404455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc81009b0 0x7f4cc81991b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 -- 172.21.15.59:0/2072404455 >> 172.21.15.59:0/2072404455 conn(0x7f4cc8077990 msgr2=0x7f4cc8103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.744+0000 7f4cd063c640 1 -- 172.21.15.59:0/2072404455 shutdown_connections 2024-09-10T11:11:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:30.745+0000 7f4cd063c640 1 -- 172.21.15.59:0/2072404455 wait complete. 2024-09-10T11:11:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:31 smithi181 ceph-mon[35409]: pgmap v316: 97 pgs: 97 active+clean; 3.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:11:32.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:31 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:11:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:31 smithi115 ceph-mon[34719]: pgmap v316: 97 pgs: 97 active+clean; 3.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:11:32.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:31 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:11:32.328 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:31 smithi059 ceph-mon[30978]: pgmap v316: 97 pgs: 97 active+clean; 3.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:11:32.328 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:31 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:11:34.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: pgmap v317: 97 pgs: 97 active+clean; 3.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:11:34.188 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:33 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: pgmap v317: 97 pgs: 97 active+clean; 3.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:11:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:11:34.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:11:34.210 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:33 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: pgmap v317: 97 pgs: 97 active+clean; 3.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:11:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:11:34.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:11:34.390 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:11:34.390 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:33 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:11:35.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:34 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi181 to 176.0M 2024-09-10T11:11:35.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:34 smithi181 ceph-mon[35409]: Unable to set osd_memory_target on smithi181 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-10T11:11:35.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:34 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-10T11:11:35.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:34 smithi181 ceph-mon[35409]: Unable to set osd_memory_target on smithi115 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-10T11:11:35.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:34 smithi181 ceph-mon[35409]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-10T11:11:35.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:34 smithi181 ceph-mon[35409]: Unable to set osd_memory_target on smithi059 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-10T11:11:35.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:34 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi181 to 176.0M 2024-09-10T11:11:35.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:34 smithi115 ceph-mon[34719]: Unable to set osd_memory_target on smithi181 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-10T11:11:35.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:34 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-10T11:11:35.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:34 smithi115 ceph-mon[34719]: Unable to set osd_memory_target on smithi115 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-10T11:11:35.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:34 smithi115 ceph-mon[34719]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-10T11:11:35.209 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:34 smithi115 ceph-mon[34719]: Unable to set osd_memory_target on smithi059 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-10T11:11:35.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:34 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi181 to 176.0M 2024-09-10T11:11:35.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:34 smithi059 ceph-mon[30978]: Unable to set osd_memory_target on smithi181 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-10T11:11:35.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:34 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-10T11:11:35.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:34 smithi059 ceph-mon[30978]: Unable to set osd_memory_target on smithi115 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-10T11:11:35.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:34 smithi059 ceph-mon[30978]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-10T11:11:35.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:34 smithi059 ceph-mon[30978]: Unable to set osd_memory_target on smithi059 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-10T11:11:36.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:35 smithi181 ceph-mon[35409]: pgmap v318: 97 pgs: 97 active+clean; 4.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:11:36.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:35 smithi115 ceph-mon[34719]: pgmap v318: 97 pgs: 97 active+clean; 4.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:11:36.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:35 smithi059 ceph-mon[30978]: pgmap v318: 97 pgs: 97 active+clean; 4.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:11:38.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:37 smithi181 ceph-mon[35409]: pgmap v319: 97 pgs: 97 active+clean; 4.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:38.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:37 smithi115 ceph-mon[34719]: pgmap v319: 97 pgs: 97 active+clean; 4.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:38.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:37 smithi059 ceph-mon[30978]: pgmap v319: 97 pgs: 97 active+clean; 4.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:40.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:39 smithi181 ceph-mon[35409]: pgmap v320: 97 pgs: 97 active+clean; 4.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-09-10T11:11:40.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:39 smithi115 ceph-mon[34719]: pgmap v320: 97 pgs: 97 active+clean; 4.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-09-10T11:11:40.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:39 smithi059 ceph-mon[30978]: pgmap v320: 97 pgs: 97 active+clean; 4.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-09-10T11:11:42.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:41 smithi115 ceph-mon[34719]: pgmap v321: 97 pgs: 97 active+clean; 4.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:42.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:41 smithi059 ceph-mon[30978]: pgmap v321: 97 pgs: 97 active+clean; 4.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:41 smithi181 ceph-mon[35409]: pgmap v321: 97 pgs: 97 active+clean; 4.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.845+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/1019906902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 msgr2=0x7f0ce410e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.845+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/1019906902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 0x7f0ce410e9b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009cd0 tx=0x7f0cdc02a8e0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.845+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/1019906902 shutdown_connections 2024-09-10T11:11:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.845+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/1019906902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 0x7f0ce410e9b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.845+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/1019906902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce4101ae0 0x7f0ce4101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.845+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/1019906902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ce4107b80 0x7f0ce4107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.845+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/1019906902 >> 172.21.15.59:0/1019906902 conn(0x7f0ce40fd7e0 msgr2=0x7f0ce40ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.845+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/1019906902 shutdown_connections 2024-09-10T11:11:43.847 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.846+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/1019906902 wait complete. 2024-09-10T11:11:43.848 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.846+0000 7f0ce8ed7640 1 Processor -- start 2024-09-10T11:11:43.848 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.846+0000 7f0ce8ed7640 1 -- start start 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce8ed7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce4101ae0 0x7f0ce4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce8ed7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 0x7f0ce4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce8ed7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ce4107b80 0x7f0ce419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce8ed7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce4111f30 con 0x7f0ce4102480 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce8ed7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce4111db0 con 0x7f0ce4101ae0 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce8ed7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce41120b0 con 0x7f0ce4107b80 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce1d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 0x7f0ce4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce1d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 0x7f0ce4198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43948/0 (socket says 172.21.15.59:43948) 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/3685454895 learned_addr learned my addr 172.21.15.59:0/3685454895 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:43.850 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce2d9d640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ce4107b80 0x7f0ce419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce259c640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce4101ae0 0x7f0ce4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/3685454895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ce4107b80 msgr2=0x7f0ce419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ce4107b80 0x7f0ce419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/3685454895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce4101ae0 msgr2=0x7f0ce4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce4101ae0 0x7f0ce4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/3685454895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce419d330 con 0x7f0ce4102480 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.847+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 0x7f0ce4198880 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00e9f0 tx=0x7f0ccc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.848+0000 7f0cdb7fe640 1 -- 172.21.15.59:0/3685454895 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00cd80 con 0x7f0ce4102480 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.848+0000 7f0cdb7fe640 1 -- 172.21.15.59:0/3685454895 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ccc010910 con 0x7f0ce4102480 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.848+0000 7f0cdb7fe640 1 -- 172.21.15.59:0/3685454895 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc018990 con 0x7f0ce4102480 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.848+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/3685454895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce419d620 con 0x7f0ce4102480 2024-09-10T11:11:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.848+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/3685454895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce41a4eb0 con 0x7f0ce4102480 2024-09-10T11:11:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.851+0000 7f0cdb7fe640 1 -- 172.21.15.59:0/3685454895 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0ccc010ac0 con 0x7f0ce4102480 2024-09-10T11:11:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.851+0000 7f0cebc72740 1 Processor -- start 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.851+0000 7f0cebc72740 1 -- start start 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.851+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 0x55e608aeced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.851+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aed410 0x55e608af7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.851+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608afa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0cebc72740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e608a512f0 con 0x55e608af7cb0 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0cebc72740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55e6089f9270 con 0x55e608aecaf0 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0cebc72740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e608a4d2b0 con 0x55e608aed410 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce1d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608afa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce1d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608afa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43964/0 (socket says 172.21.15.59:43964) 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/1134446690 learned_addr learned my addr 172.21.15.59:0/1134446690 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce2d9d640 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 0x55e608aeced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aed410 0x55e608af7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/1134446690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aed410 msgr2=0x55e608af7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aed410 0x55e608af7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/1134446690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 msgr2=0x55e608aeced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 0x55e608aeced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0cdb7fe640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cd00a2da0 0x7f0cd00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/1134446690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6089f8340 con 0x55e608af7cb0 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aed410 0x55e608af7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce259c640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cd00a2da0 0x7f0cd00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0cdb7fe640 1 -- 172.21.15.59:0/3685454895 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f0ccc0cf8f0 con 0x7f0ce4102480 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.852+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608afa0a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0ccf60 tx=0x7f0ccc0d5f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6ad52657f71e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.853+0000 7f0cd8ff9640 1 -- 172.21.15.59:0/1134446690 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc09bb90 con 0x55e608af7cb0 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.853+0000 7f0cd8ff9640 1 -- 172.21.15.59:0/1134446690 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ccc09c4c0 con 0x55e608af7cb0 2024-09-10T11:11:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.853+0000 7f0cd8ff9640 1 -- 172.21.15.59:0/1134446690 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc09b720 con 0x55e608af7cb0 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.853+0000 7f0cebc72740 1 -- 172.21.15.59:0/1134446690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 msgr2=0x55e608afa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.853+0000 7f0ce259c640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cd00a2da0 0x7f0cd00a5260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55e608ae9ec0 tx=0x7f0cd4005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.853+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608afa0a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0ccf60 tx=0x7f0ccc0d5f30 comp rx=0 tx=0).stop 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 -- 172.21.15.59:0/1134446690 shutdown_connections 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608afa0a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aed410 0x55e608af7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1134446690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 0x55e608aeced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 -- 172.21.15.59:0/1134446690 >> 172.21.15.59:0/1134446690 conn(0x55e608ae9060 msgr2=0x55e608ae9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 -- 172.21.15.59:0/1134446690 shutdown_connections 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 -- 172.21.15.59:0/1134446690 wait complete. 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 -- start start 2024-09-10T11:11:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 Processor -- start 2024-09-10T11:11:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aecaf0 0x55e608af4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 0x55e608af5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608af5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e608afa880 con 0x55e608af7cb0 2024-09-10T11:11:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55e6089da290 con 0x55e608aed410 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e608afaa00 con 0x55e608aecaf0 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.854+0000 7f0cebc72740 10 client.0 _ll_register_callbacks cb 0x55e608a0b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce2d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608af5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce2d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608af5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43972/0 (socket says 172.21.15.59:43972) 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce2d9d640 1 -- 172.21.15.59:0/1773984959 learned_addr learned my addr 172.21.15.59:0/1773984959 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 0x55e608af5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aecaf0 0x55e608af4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce2d9d640 1 -- 172.21.15.59:0/1773984959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aecaf0 msgr2=0x55e608af4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce2d9d640 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aecaf0 0x55e608af4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce2d9d640 1 -- 172.21.15.59:0/1773984959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 msgr2=0x55e608af5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce2d9d640 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 0x55e608af5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce2d9d640 1 -- 172.21.15.59:0/1773984959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e608764210 con 0x55e608af7cb0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aecaf0 0x55e608af4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0ce2d9d640 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608af5680 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc02ae00 tx=0x7f0cdc005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be649624820b75f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0cc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1773984959 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc048020 con 0x55e608af7cb0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1773984959 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f0cdc003970 con 0x55e608af7cb0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0cebc72740 1 -- 172.21.15.59:0/1773984959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ccc09c4c0 con 0x55e608af7cb0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.855+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1773984959 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0cdc050050 con 0x55e608af7cb0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cebc72740 10 client.16089 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cebc72740 1 -- 172.21.15.59:0/1773984959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e608830620 con 0x55e608af7cb0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1773984959 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ccc09c4c0 con 0x55e608af7cb0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1773984959 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0cdc043070 con 0x55e608af7cb0 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cebc72740 10 client.16089 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cebc72740 10 client.16089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cebc72740 20 client.16089 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55e608b07cd0 0x55e608b0a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cebc72740 4 client.16089 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0cebc72740 1 -- 172.21.15.59:0/1773984959 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e608a5ea20 con 0x55e608b07cd0 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.856+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55e608b07cd0 0x55e608b0a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.857+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55e608b07cd0 0x55e608b0a0e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931c569a0685814 server_cookie=df448d1b9e09939a in_seq=0 out_seq=0 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.857+0000 7f0cc9ffb640 10 client.16089 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.857+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1773984959 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e608a5ea20 con 0x55e608b07cd0 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.857+0000 7f0cc9ffb640 10 client.16089 handle_command_reply: tid=0 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.857+0000 7f0cebc72740 1 client.16089 shutdown 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.857+0000 7f0cebc72740 1 -- 172.21.15.59:0/1773984959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 msgr2=0x55e608af5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.857+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608af5680 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc02ae00 tx=0x7f0cdc005f60 comp rx=0 tx=0).stop 2024-09-10T11:11:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cebc72740 1 -- 172.21.15.59:0/1773984959 shutdown_connections 2024-09-10T11:11:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55e608b07cd0 0x55e608b0a0e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608af7cb0 0x55e608af5680 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cc9ffb640 0 client.16089 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 0x55e608af5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1773984959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608aecaf0 0x55e608af4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cebc72740 1 -- 172.21.15.59:0/1773984959 >> 172.21.15.59:0/1773984959 conn(0x55e608ae9060 msgr2=0x55e608aeed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cebc72740 1 -- 172.21.15.59:0/1773984959 shutdown_connections 2024-09-10T11:11:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cebc72740 1 -- 172.21.15.59:0/1773984959 wait complete. 2024-09-10T11:11:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.858+0000 7f0cebc72740 20 client.16089 trim_cache size 0 max 16384 2024-09-10T11:11:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.872+0000 7f0cebc72740 1 Processor -- start 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0cebc72740 1 -- start start 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 0x55e608ae89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aed410 0x55e608af54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 0x55e608b0fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0cebc72740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce41b0270 con 0x55e608aed410 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0cebc72740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce41adb40 con 0x55e608aecaf0 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0cebc72740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce41ab9b0 con 0x55e608af7cb0 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce1d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aed410 0x55e608af54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce1d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aed410 0x55e608af54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43986/0 (socket says 172.21.15.59:43986) 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/1949488402 learned_addr learned my addr 172.21.15.59:0/1949488402 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 0x55e608ae89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce2d9d640 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 0x55e608b0fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/1949488402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 msgr2=0x55e608b0fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 0x55e608b0fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/1949488402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 msgr2=0x55e608ae89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 0x55e608ae89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce1d9b640 1 -- 172.21.15.59:0/1949488402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e608b0a760 con 0x55e608aed410 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 0x55e608ae89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aed410 0x55e608af54b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00e9c0 tx=0x7f0ccc018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bff0d675bcbee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.873+0000 7f0ccbfff640 1 -- 172.21.15.59:0/1949488402 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc09b900 con 0x55e608aed410 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0ccbfff640 1 -- 172.21.15.59:0/1949488402 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ccc09c4c0 con 0x55e608aed410 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0ccbfff640 1 -- 172.21.15.59:0/1949488402 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc09bdc0 con 0x55e608aed410 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 -- 172.21.15.59:0/1949488402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aed410 msgr2=0x55e608af54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aed410 0x55e608af54b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00e9c0 tx=0x7f0ccc018420 comp rx=0 tx=0).stop 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 -- 172.21.15.59:0/1949488402 shutdown_connections 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 0x55e608b0fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aed410 0x55e608af54b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1949488402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aecaf0 0x55e608ae89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 -- 172.21.15.59:0/1949488402 >> 172.21.15.59:0/1949488402 conn(0x55e608ae9060 msgr2=0x55e608af6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 -- 172.21.15.59:0/1949488402 shutdown_connections 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 -- 172.21.15.59:0/1949488402 wait complete. 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 -- start start 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.874+0000 7f0cebc72740 1 Processor -- start 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aecaf0 0x55e608af1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 0x55e608af2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0cebc72740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 0x55e608af2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0cebc72740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce41ac000 con 0x55e608aecaf0 2024-09-10T11:11:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0cebc72740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce41ad470 con 0x55e608aed410 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0cebc72740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce41ac6d0 con 0x55e608af7cb0 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0cebc72740 10 client.0 _ll_register_callbacks cb 0x7f0cd4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aecaf0 0x55e608af1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aecaf0 0x55e608af1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43994/0 (socket says 172.21.15.59:43994) 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce259c640 1 -- 172.21.15.59:0/1283078136 learned_addr learned my addr 172.21.15.59:0/1283078136 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 0x55e608af2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce2d9d640 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 0x55e608af2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce259c640 1 -- 172.21.15.59:0/1283078136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 msgr2=0x55e608af2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 0x55e608af2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce259c640 1 -- 172.21.15.59:0/1283078136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 msgr2=0x55e608af2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 0x55e608af2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce259c640 1 -- 172.21.15.59:0/1283078136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e608ae42d0 con 0x55e608aecaf0 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce2d9d640 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 0x55e608af2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0ce259c640 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aecaf0 0x55e608af1cf0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55e608b0a930 tx=0x7f0cd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518e167bc8954e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.875+0000 7f0cc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1283078136 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40282f0 con 0x55e608aecaf0 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1283078136 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f0cd4028490 con 0x55e608aecaf0 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cebc72740 1 -- 172.21.15.59:0/1283078136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ccc09c4c0 con 0x55e608aecaf0 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1283078136 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0cd4028690 con 0x55e608aecaf0 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cebc72740 10 client.16095 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cebc72740 1 -- 172.21.15.59:0/1283078136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e608aec920 con 0x55e608aecaf0 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1283078136 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ccc09c4c0 con 0x55e608aecaf0 2024-09-10T11:11:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1283078136 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0cd4032bc0 con 0x55e608aecaf0 2024-09-10T11:11:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cebc72740 10 client.16095 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cebc72740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cebc72740 20 client.16095 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55e608b731d0 0x55e608b755f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cebc72740 4 client.16095 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:11:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.876+0000 7f0cebc72740 1 -- 172.21.15.59:0/1283078136 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e608a58d70 con 0x55e608b731d0 2024-09-10T11:11:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.877+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55e608b731d0 0x55e608b755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.877+0000 7f0cc9ffb640 10 client.16095 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.877+0000 7f0ce1d9b640 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55e608b731d0 0x55e608b755f0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db5dbad55fb6b3b8 server_cookie=bb38984d944ebdc8 in_seq=0 out_seq=0 2024-09-10T11:11:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cc9ffb640 1 -- 172.21.15.59:0/1283078136 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e608a58d70 con 0x55e608b731d0 2024-09-10T11:11:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cc9ffb640 10 client.16095 handle_command_reply: tid=0 2024-09-10T11:11:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 client.16095 shutdown 2024-09-10T11:11:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 -- 172.21.15.59:0/1283078136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aecaf0 msgr2=0x55e608af1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aecaf0 0x55e608af1cf0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55e608b0a930 tx=0x7f0cd40046c0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 -- 172.21.15.59:0/1283078136 shutdown_connections 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55e608b731d0 0x55e608b755f0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e608af7cb0 0x55e608af2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cc9ffb640 0 client.16095 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e608aed410 0x55e608af2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 --2- 172.21.15.59:0/1283078136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e608aecaf0 0x55e608af1cf0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 -- 172.21.15.59:0/1283078136 >> 172.21.15.59:0/1283078136 conn(0x55e608ae9060 msgr2=0x55e608aee550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 -- 172.21.15.59:0/1283078136 shutdown_connections 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 1 -- 172.21.15.59:0/1283078136 wait complete. 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.891+0000 7f0cebc72740 20 client.16095 trim_cache size 0 max 16384 2024-09-10T11:11:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:11:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:11:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:11:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:11:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cd00a2da0 msgr2=0x7f0cd00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cd00a2da0 0x7f0cd00a5260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55e608ae9ec0 tx=0x7f0cd4005f90 comp rx=0 tx=0).stop 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 msgr2=0x7f0ce4198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 0x7f0ce4198880 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00e9f0 tx=0x7f0ccc00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/3685454895 shutdown_connections 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cd00a2da0 0x7f0cd00a5260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ce4107b80 0x7f0ce419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ce4102480 0x7f0ce4198880 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 --2- 172.21.15.59:0/3685454895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ce4101ae0 0x7f0ce4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/3685454895 >> 172.21.15.59:0/3685454895 conn(0x7f0ce40fd7e0 msgr2=0x7f0ce40fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/3685454895 shutdown_connections 2024-09-10T11:11:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:43.892+0000 7f0ce8ed7640 1 -- 172.21.15.59:0/3685454895 wait complete. 2024-09-10T11:11:44.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:43 smithi115 ceph-mon[34719]: pgmap v322: 97 pgs: 97 active+clean; 4.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:44.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:43 smithi059 ceph-mon[30978]: pgmap v322: 97 pgs: 97 active+clean; 4.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:44.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:43 smithi181 ceph-mon[35409]: pgmap v322: 97 pgs: 97 active+clean; 4.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:46.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:45 smithi115 ceph-mon[34719]: pgmap v323: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:11:46.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:45 smithi059 ceph-mon[30978]: pgmap v323: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:11:46.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:45 smithi181 ceph-mon[35409]: pgmap v323: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:11:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:47 smithi115 ceph-mon[34719]: pgmap v324: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:11:48.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:47 smithi059 ceph-mon[30978]: pgmap v324: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:11:48.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:47 smithi181 ceph-mon[35409]: pgmap v324: 97 pgs: 97 active+clean; 4.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-10T11:11:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:49 smithi115 ceph-mon[34719]: pgmap v325: 97 pgs: 97 active+clean; 4.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 57 KiB/s wr, 16 op/s 2024-09-10T11:11:50.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:49 smithi059 ceph-mon[30978]: pgmap v325: 97 pgs: 97 active+clean; 4.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 57 KiB/s wr, 16 op/s 2024-09-10T11:11:50.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:49 smithi181 ceph-mon[35409]: pgmap v325: 97 pgs: 97 active+clean; 4.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 57 KiB/s wr, 16 op/s 2024-09-10T11:11:52.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:51 smithi115 ceph-mon[34719]: pgmap v326: 97 pgs: 97 active+clean; 4.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:11:52.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:51 smithi059 ceph-mon[30978]: pgmap v326: 97 pgs: 97 active+clean; 4.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:11:52.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:51 smithi181 ceph-mon[35409]: pgmap v326: 97 pgs: 97 active+clean; 4.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:11:54.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:53 smithi115 ceph-mon[34719]: pgmap v327: 97 pgs: 97 active+clean; 4.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:11:54.239 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:53 smithi181 ceph-mon[35409]: pgmap v327: 97 pgs: 97 active+clean; 4.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:11:54.260 INFO:tasks.workunit.client.0.smithi059.stdout:499/600: open fd = 3 2024-09-10T11:11:54.260 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.260 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:500/600: open fd = 3 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:501/600: open fd = 3 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:502/600: open fd = 3 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:503/600: open fd = 3 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:504/600: open fd = 3 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:505/600: open fd = 3 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.262 INFO:tasks.workunit.client.0.smithi059.stdout:506/600: open fd = 3 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:507/600: open fd = 3 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:508/600: open fd = 3 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:509/600: open fd = 3 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.263 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:510/600: open fd = 3 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:511/600: open fd = 3 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:512/600: open fd = 3 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.264 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:513/600: open fd = 3 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:514/600: open fd = 3 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:515/600: open fd = 3 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:516/600: open fd = 3 2024-09-10T11:11:54.265 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:517/600: open fd = 3 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:518/600: open fd = 3 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:519/600: open fd = 3 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.266 INFO:tasks.workunit.client.0.smithi059.stdout:520/600: open fd = 3 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:521/600: open fd = 3 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:522/600: open fd = 3 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.267 INFO:tasks.workunit.client.0.smithi059.stdout:523/600: open fd = 3 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:524/600: open fd = 3 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:525/600: open fd = 3 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:526/600: open fd = 3 2024-09-10T11:11:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:527/600: open fd = 3 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:528/600: open fd = 3 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:529/600: open fd = 3 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.269 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:530/600: open fd = 3 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:531/600: open fd = 3 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:532/600: open fd = 3 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.270 INFO:tasks.workunit.client.0.smithi059.stdout:533/600: open fd = 3 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:534/600: open fd = 3 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:535/600: open fd = 3 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:536/600: open fd = 3 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:537/600: open fd = 3 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:538/600: open fd = 3 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:539/600: open fd = 3 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:540/600: open fd = 3 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:541/600: open fd = 3 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:542/600: open fd = 3 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.273 INFO:tasks.workunit.client.0.smithi059.stdout:543/600: open fd = 3 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:544/600: open fd = 3 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:545/600: open fd = 3 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.274 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:546/600: open fd = 3 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:547/600: open fd = 3 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:548/600: open fd = 3 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:549/600: open fd = 3 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:550/600: open fd = 3 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:551/600: open fd = 3 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:552/600: open fd = 3 2024-09-10T11:11:54.276 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:553/600: open fd = 3 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:554/600: open fd = 3 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:555/600: open fd = 3 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.277 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:556/600: open fd = 3 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:557/600: open fd = 3 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:558/600: open fd = 3 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.279 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.279 INFO:tasks.workunit.client.0.smithi059.stdout:559/600: open fd = 3 2024-09-10T11:11:54.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.279 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.279 INFO:tasks.workunit.client.0.smithi059.stdout:560/600: open fd = 3 2024-09-10T11:11:54.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.279 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:11:54.279 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:11:54.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:53 smithi059 ceph-mon[30978]: pgmap v327: 97 pgs: 97 active+clean; 4.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T11:11:56.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:55 smithi059 ceph-mon[30978]: pgmap v328: 97 pgs: 97 active+clean; 4.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:11:56.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:55 smithi181 ceph-mon[35409]: pgmap v328: 97 pgs: 97 active+clean; 4.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:11:56.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:55 smithi115 ceph-mon[34719]: pgmap v328: 97 pgs: 97 active+clean; 4.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:11:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.992+0000 7ffa86082640 1 -- 172.21.15.59:0/2011059716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801009b0 msgr2=0x7ffa80100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.992+0000 7ffa86082640 1 --2- 172.21.15.59:0/2011059716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801009b0 0x7ffa80100e10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009930 tx=0x7ffa7402a420 comp rx=0 tx=0).stop 2024-09-10T11:11:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.992+0000 7ffa86082640 1 -- 172.21.15.59:0/2011059716 shutdown_connections 2024-09-10T11:11:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.992+0000 7ffa86082640 1 --2- 172.21.15.59:0/2011059716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa80101350 0x7ffa8010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.992+0000 7ffa86082640 1 --2- 172.21.15.59:0/2011059716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801009b0 0x7ffa80100e10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.992+0000 7ffa86082640 1 --2- 172.21.15.59:0/2011059716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa801069c0 0x7ffa80106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.992+0000 7ffa86082640 1 -- 172.21.15.59:0/2011059716 >> 172.21.15.59:0/2011059716 conn(0x7ffa80077990 msgr2=0x7ffa800fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.992+0000 7ffa86082640 1 -- 172.21.15.59:0/2011059716 shutdown_connections 2024-09-10T11:11:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.992+0000 7ffa86082640 1 -- 172.21.15.59:0/2011059716 wait complete. 2024-09-10T11:11:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa86082640 1 Processor -- start 2024-09-10T11:11:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa86082640 1 -- start start 2024-09-10T11:11:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa86082640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa801009b0 0x7ffa8010e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa86082640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa80101350 0x7ffa8010e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa86082640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801069c0 0x7ffa8010ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa86082640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80111ef0 con 0x7ffa801069c0 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa86082640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80111d70 con 0x7ffa801009b0 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa86082640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80112070 con 0x7ffa80101350 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801069c0 0x7ffa8010ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801069c0 0x7ffa8010ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52996/0 (socket says 172.21.15.59:52996) 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa7ffff640 1 -- 172.21.15.59:0/2326063042 learned_addr learned my addr 172.21.15.59:0/2326063042 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.993+0000 7ffa7effd640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa80101350 0x7ffa8010e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa801009b0 0x7ffa8010e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7ffff640 1 -- 172.21.15.59:0/2326063042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa80101350 msgr2=0x7ffa8010e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7ffff640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa80101350 0x7ffa8010e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7ffff640 1 -- 172.21.15.59:0/2326063042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa801009b0 msgr2=0x7ffa8010e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7ffff640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa801009b0 0x7ffa8010e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7ffff640 1 -- 172.21.15.59:0/2326063042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa801a6890 con 0x7ffa801069c0 2024-09-10T11:11:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7effd640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa80101350 0x7ffa8010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:11:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7ffff640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801069c0 0x7ffa8010ed90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800d750 tx=0x7ffa7800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7cff9640 1 -- 172.21.15.59:0/2326063042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78017070 con 0x7ffa801069c0 2024-09-10T11:11:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7cff9640 1 -- 172.21.15.59:0/2326063042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa78005500 con 0x7ffa801069c0 2024-09-10T11:11:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa86082640 1 -- 172.21.15.59:0/2326063042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa801a6b80 con 0x7ffa801069c0 2024-09-10T11:11:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa7cff9640 1 -- 172.21.15.59:0/2326063042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78004d90 con 0x7ffa801069c0 2024-09-10T11:11:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.994+0000 7ffa86082640 1 -- 172.21.15.59:0/2326063042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa801a7050 con 0x7ffa801069c0 2024-09-10T11:11:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa7cff9640 1 -- 172.21.15.59:0/2326063042 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ffa78004f30 con 0x7ffa801069c0 2024-09-10T11:11:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa88e1f740 1 Processor -- start 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa88e1f740 1 -- start start 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 0x55a9935f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa7cff9640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ffa680a2da0 0x7ffa680a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 0x55a9935fd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9936000a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a9935572f0 con 0x55a9935fdcb0 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a9934ff270 con 0x55a9935f2af0 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a9935532b0 con 0x55a9935f3410 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.997+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9936000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ffa680a2da0 0x7ffa680a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9936000a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53012/0 (socket says 172.21.15.59:53012) 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7ffff640 1 -- 172.21.15.59:0/3561781953 learned_addr learned my addr 172.21.15.59:0/3561781953 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7cff9640 1 -- 172.21.15.59:0/2326063042 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7ffa780ceec0 con 0x7ffa801069c0 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7effd640 1 --2- 172.21.15.59:0/3561781953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 0x55a9935f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7effd640 1 --2- 172.21.15.59:0/3561781953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 0x55a9935fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7ffff640 1 -- 172.21.15.59:0/3561781953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 msgr2=0x55a9935fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7ffff640 1 --2- 172.21.15.59:0/3561781953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 0x55a9935fd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7ffff640 1 -- 172.21.15.59:0/3561781953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 msgr2=0x55a9935f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7ffff640 1 --2- 172.21.15.59:0/3561781953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 0x55a9935f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7ffff640 1 -- 172.21.15.59:0/3561781953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9934fe340 con 0x55a9935fdcb0 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ffa680a2da0 0x7ffa680a5260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa70005fd0 tx=0x7ffa70009680 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa7ffff640 1 --2- 172.21.15.59:0/3561781953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9936000a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ffa7809b090 tx=0x7ffa78018f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f4343757508f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa65ffb640 1 -- 172.21.15.59:0/3561781953 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78020040 con 0x55a9935fdcb0 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa65ffb640 1 -- 172.21.15.59:0/3561781953 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7809ba90 con 0x55a9935fdcb0 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.998+0000 7ffa65ffb640 1 -- 172.21.15.59:0/3561781953 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78009c60 con 0x55a9935fdcb0 2024-09-10T11:11:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 -- 172.21.15.59:0/3561781953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 msgr2=0x55a9936000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/3561781953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9936000a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ffa7809b090 tx=0x7ffa78018f10 comp rx=0 tx=0).stop 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 -- 172.21.15.59:0/3561781953 shutdown_connections 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/3561781953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9936000a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/3561781953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 0x55a9935fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/3561781953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 0x55a9935f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 -- 172.21.15.59:0/3561781953 >> 172.21.15.59:0/3561781953 conn(0x55a9935ef060 msgr2=0x55a9935ef440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 -- 172.21.15.59:0/3561781953 shutdown_connections 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 -- 172.21.15.59:0/3561781953 wait complete. 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:56.999+0000 7ffa88e1f740 1 -- start start 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa88e1f740 1 Processor -- start 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 0x55a9935fac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 0x55a9935fb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9935fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a993600880 con 0x55a9935fdcb0 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a9934e0290 con 0x55a9935f2af0 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a993600a00 con 0x55a9935f3410 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa88e1f740 10 client.0 _ll_register_callbacks cb 0x55a993511140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9935fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9935fb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53016/0 (socket says 172.21.15.59:53016) 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa7effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 0x55a9935fb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa7ffff640 1 -- 172.21.15.59:0/1971827497 learned_addr learned my addr 172.21.15.59:0/1971827497 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.000+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 0x55a9935fac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa7ffff640 1 -- 172.21.15.59:0/1971827497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 msgr2=0x55a9935fb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa7ffff640 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 0x55a9935fb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa7ffff640 1 -- 172.21.15.59:0/1971827497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 msgr2=0x55a9935fac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa7ffff640 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 0x55a9935fac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa7ffff640 1 -- 172.21.15.59:0/1971827497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a99326a210 con 0x55a9935fdcb0 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 0x55a9935fac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa7ffff640 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9935fb6a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ffa7809bc40 tx=0x7ffa78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e8650d34e533b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa5effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa5effd640 1 -- 172.21.15.59:0/1971827497 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78020050 con 0x55a9935fdcb0 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa5effd640 1 -- 172.21.15.59:0/1971827497 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7ffa780cc840 con 0x55a9935fdcb0 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1971827497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa7809ba90 con 0x55a9935fdcb0 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa5effd640 1 -- 172.21.15.59:0/1971827497 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffa780056b0 con 0x55a9935fdcb0 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa88e1f740 10 client.16107 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1971827497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a993336620 con 0x55a9935fdcb0 2024-09-10T11:11:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa5effd640 1 -- 172.21.15.59:0/1971827497 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7809ba90 con 0x55a9935fdcb0 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.001+0000 7ffa5effd640 1 -- 172.21.15.59:0/1971827497 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ffa78092cb0 con 0x55a9935fdcb0 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.002+0000 7ffa88e1f740 10 client.16107 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.002+0000 7ffa88e1f740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.002+0000 7ffa88e1f740 20 client.16107 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.002+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a99360db00 0x55a99360fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.002+0000 7ffa88e1f740 4 client.16107 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.002+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1971827497 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a993564a20 con 0x55a99360db00 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.002+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a99360db00 0x55a99360fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.002+0000 7ffa5effd640 10 client.16107 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.002+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a99360db00 0x55a99360fef0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27d1faa675f653c6 server_cookie=a9654f76cef556b3 in_seq=0 out_seq=0 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa5effd640 1 -- 172.21.15.59:0/1971827497 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a993564a20 con 0x55a99360db00 2024-09-10T11:11:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa5effd640 10 client.16107 handle_command_reply: tid=0 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 client.16107 shutdown 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1971827497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 msgr2=0x55a9935fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9935fb6a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ffa7809bc40 tx=0x7ffa78009bd0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1971827497 shutdown_connections 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a99360db00 0x55a99360fef0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935fdcb0 0x55a9935fb6a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f3410 0x55a9935fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1971827497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f2af0 0x55a9935fac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1971827497 >> 172.21.15.59:0/1971827497 conn(0x55a9935ef060 msgr2=0x55a9935f4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa5effd640 0 client.16107 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.003+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1971827497 shutdown_connections 2024-09-10T11:11:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.004+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1971827497 wait complete. 2024-09-10T11:11:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.004+0000 7ffa88e1f740 20 client.16107 trim_cache size 0 max 16384 2024-09-10T11:11:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.018+0000 7ffa88e1f740 1 Processor -- start 2024-09-10T11:11:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.018+0000 7ffa88e1f740 1 -- start start 2024-09-10T11:11:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.018+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f2af0 0x55a9935f5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.018+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f3410 0x55a9935f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.018+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935fdcb0 0x55a9935fb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.018+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801b23b0 con 0x55a9935f2af0 2024-09-10T11:11:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.018+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801afc80 con 0x55a9935f3410 2024-09-10T11:11:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.018+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801adaf0 con 0x55a9935fdcb0 2024-09-10T11:11:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa7f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f2af0 0x55a9935f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa7f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f2af0 0x55a9935f5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53024/0 (socket says 172.21.15.59:53024) 2024-09-10T11:11:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa7f7fe640 1 -- 172.21.15.59:0/1396033987 learned_addr learned my addr 172.21.15.59:0/1396033987 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa7f7fe640 1 -- 172.21.15.59:0/1396033987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935fdcb0 msgr2=0x55a9935fb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/1396033987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935fdcb0 0x55a9935fb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa7f7fe640 1 -- 172.21.15.59:0/1396033987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f3410 msgr2=0x55a9935f94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/1396033987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f3410 0x55a9935f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa7f7fe640 1 -- 172.21.15.59:0/1396033987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9935f3240 con 0x55a9935f2af0 2024-09-10T11:11:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/1396033987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f2af0 0x55a9935f5560 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ffa70012630 tx=0x7ffa70016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62386933424d719 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa657fa640 1 -- 172.21.15.59:0/1396033987 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70003970 con 0x55a9935f2af0 2024-09-10T11:11:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa657fa640 1 -- 172.21.15.59:0/1396033987 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa70004020 con 0x55a9935f2af0 2024-09-10T11:11:57.024 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.019+0000 7ffa657fa640 1 -- 172.21.15.59:0/1396033987 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70021740 con 0x55a9935f2af0 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1396033987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f2af0 msgr2=0x55a9935f5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1396033987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f2af0 0x55a9935f5560 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ffa70012630 tx=0x7ffa70016000 comp rx=0 tx=0).stop 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1396033987 shutdown_connections 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1396033987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935fdcb0 0x55a9935fb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1396033987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935f3410 0x55a9935f94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/1396033987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f2af0 0x55a9935f5560 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1396033987 >> 172.21.15.59:0/1396033987 conn(0x55a9935ef060 msgr2=0x55a9935fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1396033987 shutdown_connections 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 -- 172.21.15.59:0/1396033987 wait complete. 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 -- start start 2024-09-10T11:11:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.020+0000 7ffa88e1f740 1 Processor -- start 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f2af0 0x55a9936102c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f3410 0x55a993610800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa88e1f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935fdcb0 0x55a993676430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801ae140 con 0x55a9935f3410 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801af5b0 con 0x55a9935fdcb0 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa88e1f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801ae810 con 0x55a9935f2af0 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa88e1f740 10 client.0 _ll_register_callbacks cb 0x7ffa74009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f3410 0x55a993610800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f3410 0x55a993610800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53032/0 (socket says 172.21.15.59:53032) 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7effd640 1 -- 172.21.15.59:0/18725832 learned_addr learned my addr 172.21.15.59:0/18725832 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f2af0 0x55a9936102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7effd640 1 -- 172.21.15.59:0/18725832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f2af0 msgr2=0x55a9936102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7effd640 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f2af0 0x55a9936102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7effd640 1 -- 172.21.15.59:0/18725832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935fdcb0 msgr2=0x55a993676430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7effd640 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935fdcb0 0x55a993676430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7effd640 1 -- 172.21.15.59:0/18725832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a993676b20 con 0x55a9935f3410 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f2af0 0x55a9936102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa7effd640 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f3410 0x55a993610800 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ffa7402a940 tx=0x7ffa74031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5052e215a2ee27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa5effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa5effd640 1 -- 172.21.15.59:0/18725832 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74043070 con 0x55a9935f3410 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa5effd640 1 -- 172.21.15.59:0/18725832 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7ffa740035f0 con 0x55a9935f3410 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.021+0000 7ffa88e1f740 1 -- 172.21.15.59:0/18725832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa70004020 con 0x55a9935f3410 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa5effd640 1 -- 172.21.15.59:0/18725832 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffa74035040 con 0x55a9935f3410 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa88e1f740 10 client.16113 fetch_fsmap learned FSMap version 26 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa88e1f740 1 -- 172.21.15.59:0/18725832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a993677e60 con 0x55a9935f3410 2024-09-10T11:11:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa5effd640 1 -- 172.21.15.59:0/18725832 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa70004020 con 0x55a9935f3410 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa5effd640 1 -- 172.21.15.59:0/18725832 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ffa7403a040 con 0x55a9935f3410 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa88e1f740 10 client.16113 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa88e1f740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa88e1f740 20 client.16113 populate_metadata read hostname 'smithi059' 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a993678660 0x55a99367aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa88e1f740 4 client.16113 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa88e1f740 1 -- 172.21.15.59:0/18725832 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a99355ed70 con 0x55a993678660 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.022+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a993678660 0x55a99367aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.023+0000 7ffa5effd640 10 client.16113 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.023+0000 7ffa7f7fe640 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a993678660 0x55a99367aa80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aaab0f44de60a3f server_cookie=a8d73c04f1f0a2d3 in_seq=0 out_seq=0 2024-09-10T11:11:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa5effd640 1 -- 172.21.15.59:0/18725832 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a99355ed70 con 0x55a993678660 2024-09-10T11:11:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa5effd640 10 client.16113 handle_command_reply: tid=0 2024-09-10T11:11:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 client.16113 shutdown 2024-09-10T11:11:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 -- 172.21.15.59:0/18725832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f3410 msgr2=0x55a993610800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f3410 0x55a993610800 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ffa7402a940 tx=0x7ffa74031a70 comp rx=0 tx=0).stop 2024-09-10T11:11:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 -- 172.21.15.59:0/18725832 shutdown_connections 2024-09-10T11:11:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x55a993678660 0x55a99367aa80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9935fdcb0 0x55a993676430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9935f3410 0x55a993610800 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa5effd640 0 client.16113 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:11:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 --2- 172.21.15.59:0/18725832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a9935f2af0 0x55a9936102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 -- 172.21.15.59:0/18725832 >> 172.21.15.59:0/18725832 conn(0x55a9935ef060 msgr2=0x55a993608c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 -- 172.21.15.59:0/18725832 shutdown_connections 2024-09-10T11:11:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 1 -- 172.21.15.59:0/18725832 wait complete. 2024-09-10T11:11:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.037+0000 7ffa88e1f740 20 client.16113 trim_cache size 0 max 16384 2024-09-10T11:11:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:11:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:11:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:11:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:11:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 -- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ffa680a2da0 msgr2=0x7ffa680a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ffa680a2da0 0x7ffa680a5260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa70005fd0 tx=0x7ffa70009680 comp rx=0 tx=0).stop 2024-09-10T11:11:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 -- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801069c0 msgr2=0x7ffa8010ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:11:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801069c0 0x7ffa8010ed90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800d750 tx=0x7ffa7800dc10 comp rx=0 tx=0).stop 2024-09-10T11:11:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 -- 172.21.15.59:0/2326063042 shutdown_connections 2024-09-10T11:11:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa801069c0 0x7ffa8010ed90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7ffa680a2da0 0x7ffa680a5260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa80101350 0x7ffa8010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 --2- 172.21.15.59:0/2326063042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa801009b0 0x7ffa8010e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:11:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 -- 172.21.15.59:0/2326063042 >> 172.21.15.59:0/2326063042 conn(0x7ffa80077990 msgr2=0x7ffa80103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:11:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 -- 172.21.15.59:0/2326063042 shutdown_connections 2024-09-10T11:11:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:11:57.038+0000 7ffa86082640 1 -- 172.21.15.59:0/2326063042 wait complete. 2024-09-10T11:11:58.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:57 smithi059 ceph-mon[30978]: pgmap v329: 97 pgs: 97 active+clean; 4.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:58.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:57 smithi181 ceph-mon[35409]: pgmap v329: 97 pgs: 97 active+clean; 4.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:11:58.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:57 smithi115 ceph-mon[34719]: pgmap v329: 97 pgs: 97 active+clean; 4.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:00.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:11:59 smithi059 ceph-mon[30978]: pgmap v330: 97 pgs: 97 active+clean; 5.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-10T11:12:00.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:11:59 smithi181 ceph-mon[35409]: pgmap v330: 97 pgs: 97 active+clean; 5.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-10T11:12:00.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:11:59 smithi115 ceph-mon[34719]: pgmap v330: 97 pgs: 97 active+clean; 5.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-10T11:12:02.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:01 smithi059 ceph-mon[30978]: pgmap v331: 97 pgs: 97 active+clean; 5.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:02.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:01 smithi181 ceph-mon[35409]: pgmap v331: 97 pgs: 97 active+clean; 5.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:02.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:01 smithi115 ceph-mon[34719]: pgmap v331: 97 pgs: 97 active+clean; 5.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:04.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:03 smithi059 ceph-mon[30978]: pgmap v332: 97 pgs: 97 active+clean; 5.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:04.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:03 smithi181 ceph-mon[35409]: pgmap v332: 97 pgs: 97 active+clean; 5.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:04.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:03 smithi115 ceph-mon[34719]: pgmap v332: 97 pgs: 97 active+clean; 5.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:06.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:05 smithi059 ceph-mon[30978]: pgmap v333: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-09-10T11:12:06.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:05 smithi181 ceph-mon[35409]: pgmap v333: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-09-10T11:12:06.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:05 smithi115 ceph-mon[34719]: pgmap v333: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-09-10T11:12:08.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:07 smithi059 ceph-mon[30978]: pgmap v334: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 84 KiB/s wr, 28 op/s 2024-09-10T11:12:08.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:07 smithi059 ceph-mon[30978]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T11:12:08.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:07 smithi181 ceph-mon[35409]: pgmap v334: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 84 KiB/s wr, 28 op/s 2024-09-10T11:12:08.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:07 smithi181 ceph-mon[35409]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T11:12:08.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:07 smithi115 ceph-mon[34719]: pgmap v334: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 84 KiB/s wr, 28 op/s 2024-09-10T11:12:08.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:07 smithi115 ceph-mon[34719]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T11:12:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.137+0000 7f081c6af640 1 -- 172.21.15.59:0/3635176931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08141009b0 msgr2=0x7f0814100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.137+0000 7f081c6af640 1 --2- 172.21.15.59:0/3635176931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08141009b0 0x7f0814100e10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0804009930 tx=0x7f080402a420 comp rx=0 tx=0).stop 2024-09-10T11:12:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.137+0000 7f081c6af640 1 -- 172.21.15.59:0/3635176931 shutdown_connections 2024-09-10T11:12:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.137+0000 7f081c6af640 1 --2- 172.21.15.59:0/3635176931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0814101350 0x7f081410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.137+0000 7f081c6af640 1 --2- 172.21.15.59:0/3635176931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08141009b0 0x7f0814100e10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.137+0000 7f081c6af640 1 --2- 172.21.15.59:0/3635176931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08141069c0 0x7f0814106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.137+0000 7f081c6af640 1 -- 172.21.15.59:0/3635176931 >> 172.21.15.59:0/3635176931 conn(0x7f0814077990 msgr2=0x7f08140fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.137+0000 7f081c6af640 1 -- 172.21.15.59:0/3635176931 shutdown_connections 2024-09-10T11:12:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.137+0000 7f081c6af640 1 -- 172.21.15.59:0/3635176931 wait complete. 2024-09-10T11:12:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f081c6af640 1 Processor -- start 2024-09-10T11:12:10.140 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f081c6af640 1 -- start start 2024-09-10T11:12:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f081c6af640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08141009b0 0x7f0814197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f081c6af640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814101350 0x7f08141977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.142 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f081c6af640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08141069c0 0x7f081419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f081c6af640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0814110e00 con 0x7f0814101350 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f081c6af640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0814110c80 con 0x7f08141069c0 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f081c6af640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0814110f80 con 0x7f08141009b0 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f0819c4a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814101350 0x7f08141977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f0819c4a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814101350 0x7f08141977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38708/0 (socket says 172.21.15.59:38708) 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f0819c4a640 1 -- 172.21.15.59:0/1825634347 learned_addr learned my addr 172.21.15.59:0/1825634347 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.138+0000 7f081a44b640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08141009b0 0x7f0814197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f081ac4c640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08141069c0 0x7f081419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f0819c4a640 1 -- 172.21.15.59:0/1825634347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08141009b0 msgr2=0x7f0814197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f0819c4a640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08141009b0 0x7f0814197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f0819c4a640 1 -- 172.21.15.59:0/1825634347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08141069c0 msgr2=0x7f081419bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f0819c4a640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08141069c0 0x7f081419bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f0819c4a640 1 -- 172.21.15.59:0/1825634347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081419c270 con 0x7f0814101350 2024-09-10T11:12:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f081a44b640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08141009b0 0x7f0814197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:12:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f0819c4a640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814101350 0x7f08141977c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0804009230 tx=0x7f0804004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f080b7fe640 1 -- 172.21.15.59:0/1825634347 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080403f030 con 0x7f0814101350 2024-09-10T11:12:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f081c6af640 1 -- 172.21.15.59:0/1825634347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081419c500 con 0x7f0814101350 2024-09-10T11:12:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f080b7fe640 1 -- 172.21.15.59:0/1825634347 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0804003ad0 con 0x7f0814101350 2024-09-10T11:12:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f080b7fe640 1 -- 172.21.15.59:0/1825634347 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804035070 con 0x7f0814101350 2024-09-10T11:12:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.139+0000 7f081c6af640 1 -- 172.21.15.59:0/1825634347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08141a3df0 con 0x7f0814101350 2024-09-10T11:12:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f080b7fe640 1 -- 172.21.15.59:0/1825634347 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0804042030 con 0x7f0814101350 2024-09-10T11:12:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f081f43e740 1 Processor -- start 2024-09-10T11:12:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f081f43e740 1 -- start start 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f081f43e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07821ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f081f43e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a0782c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f081f43e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a0782f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f081f43e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562a077862f0 con 0x562a07822410 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f081f43e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562a0772e270 con 0x562a07821af0 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f081f43e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a077822b0 con 0x562a0782ccb0 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.142+0000 7f080b7fe640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f08000a2da0 0x7f08000a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081a44b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a0782c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081ac4c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07821ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081a44b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a0782c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38712/0 (socket says 172.21.15.59:38712) 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f080b7fe640 1 -- 172.21.15.59:0/1825634347 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8644+0+0 (secure 0 0 0) 0x7f08040efa80 con 0x7f0814101350 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081a44b640 1 -- 172.21.15.59:0/3062754515 learned_addr learned my addr 172.21.15.59:0/3062754515 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081ac4c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07821ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.59:45852/0 (socket says 172.21.15.59:45852) 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f0819c4a640 1 --2- 172.21.15.59:0/3062754515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a0782f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081ac4c640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f08000a2da0 0x7f08000a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081a44b640 1 -- 172.21.15.59:0/3062754515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 msgr2=0x562a0782f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081a44b640 1 --2- 172.21.15.59:0/3062754515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a0782f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081a44b640 1 -- 172.21.15.59:0/3062754515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 msgr2=0x562a07821ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081a44b640 1 --2- 172.21.15.59:0/3062754515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07821ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081a44b640 1 -- 172.21.15.59:0/3062754515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a0772d340 con 0x562a07822410 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081ac4c640 1 --2- 172.21.15.59:0/3062754515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07821ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081ac4c640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f08000a2da0 0x7f08000a5260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f080c005c40 tx=0x7f080c005bd0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f081a44b640 1 --2- 172.21.15.59:0/3062754515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a0782c770 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f081000bcc0 tx=0x7f081000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bba0ec2d95ff8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.143+0000 7f0808ff9640 1 -- 172.21.15.59:0/3062754515 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810015070 con 0x562a07822410 2024-09-10T11:12:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f0808ff9640 1 -- 172.21.15.59:0/3062754515 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0810005500 con 0x562a07822410 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f0808ff9640 1 -- 172.21.15.59:0/3062754515 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08100116a0 con 0x562a07822410 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f081f43e740 1 -- 172.21.15.59:0/3062754515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 msgr2=0x562a0782c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f081f43e740 1 --2- 172.21.15.59:0/3062754515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a0782c770 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f081000bcc0 tx=0x7f081000f730 comp rx=0 tx=0).stop 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f081f43e740 1 -- 172.21.15.59:0/3062754515 shutdown_connections 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f081f43e740 1 --2- 172.21.15.59:0/3062754515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a0782f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f081f43e740 1 --2- 172.21.15.59:0/3062754515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a0782c770 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f081f43e740 1 --2- 172.21.15.59:0/3062754515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07821ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f081f43e740 1 -- 172.21.15.59:0/3062754515 >> 172.21.15.59:0/3062754515 conn(0x562a0781e060 msgr2=0x562a0781e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f081f43e740 1 -- 172.21.15.59:0/3062754515 shutdown_connections 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.144+0000 7f081f43e740 1 -- 172.21.15.59:0/3062754515 wait complete. 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081f43e740 1 -- start start 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081f43e740 1 Processor -- start 2024-09-10T11:12:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081f43e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07821af0 0x562a07829ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081f43e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07822410 0x562a0782a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081f43e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a0782a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081f43e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562a07831a90 con 0x562a07821af0 2024-09-10T11:12:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081f43e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562a0770f290 con 0x562a07822410 2024-09-10T11:12:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081f43e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562a07831c10 con 0x562a0782ccb0 2024-09-10T11:12:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081f43e740 10 client.0 _ll_register_callbacks cb 0x562a07740140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:12:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081a44b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07821af0 0x562a07829ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081a44b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07821af0 0x562a07829ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38724/0 (socket says 172.21.15.59:38724) 2024-09-10T11:12:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081a44b640 1 -- 172.21.15.59:0/1796777315 learned_addr learned my addr 172.21.15.59:0/1796777315 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f0819c4a640 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07822410 0x562a0782a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.145+0000 7f081ac4c640 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a0782a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f081a44b640 1 -- 172.21.15.59:0/1796777315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 msgr2=0x562a0782a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f081a44b640 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a0782a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f081a44b640 1 -- 172.21.15.59:0/1796777315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07822410 msgr2=0x562a0782a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f081a44b640 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07822410 0x562a0782a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f081a44b640 1 -- 172.21.15.59:0/1796777315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a07499210 con 0x562a07821af0 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f081a44b640 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07821af0 0x562a07829ae0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f081000fc30 tx=0x7f081000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6343d7e66918c88c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f07fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f07fdffb640 1 -- 172.21.15.59:0/1796777315 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810028060 con 0x562a07821af0 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f07fdffb640 1 -- 172.21.15.59:0/1796777315 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8644+0+0 (secure 0 0 0) 0x7f08100046c0 con 0x562a07821af0 2024-09-10T11:12:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f081f43e740 1 -- 172.21.15.59:0/1796777315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0810005500 con 0x562a07821af0 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f07fdffb640 1 -- 172.21.15.59:0/1796777315 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0810015070 con 0x562a07821af0 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f081f43e740 10 client.16125 fetch_fsmap learned FSMap version 26 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.146+0000 7f081f43e740 1 -- 172.21.15.59:0/1796777315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562a07565620 con 0x562a07821af0 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f07fdffb640 1 -- 172.21.15.59:0/1796777315 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0810005500 con 0x562a07821af0 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f07fdffb640 1 -- 172.21.15.59:0/1796777315 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f08100119e0 con 0x562a07821af0 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f081f43e740 10 client.16125 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f081f43e740 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f081f43e740 20 client.16125 populate_metadata read hostname 'smithi059' 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f081f43e740 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x562a0783ed00 0x562a078410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f081f43e740 4 client.16125 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f081f43e740 1 -- 172.21.15.59:0/1796777315 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a07793a20 con 0x562a0783ed00 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f0819c4a640 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x562a0783ed00 0x562a078410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f0819c4a640 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x562a0783ed00 0x562a078410f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79f3b312f5178a2 server_cookie=4caa45f94b0a8ac in_seq=0 out_seq=0 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.147+0000 7f07fdffb640 10 client.16125 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f07fdffb640 1 -- 172.21.15.59:0/1796777315 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a07793a20 con 0x562a0783ed00 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f07fdffb640 10 client.16125 handle_command_reply: tid=0 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 client.16125 shutdown 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 -- 172.21.15.59:0/1796777315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07821af0 msgr2=0x562a07829ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07821af0 0x562a07829ae0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f081000fc30 tx=0x7f081000b410 comp rx=0 tx=0).stop 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 -- 172.21.15.59:0/1796777315 shutdown_connections 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x562a0783ed00 0x562a078410f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a0782a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07822410 0x562a0782a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f07fdffb640 0 client.16125 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 --2- 172.21.15.59:0/1796777315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07821af0 0x562a07829ae0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 -- 172.21.15.59:0/1796777315 >> 172.21.15.59:0/1796777315 conn(0x562a0781e060 msgr2=0x562a07823dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.148+0000 7f081f43e740 1 -- 172.21.15.59:0/1796777315 shutdown_connections 2024-09-10T11:12:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.149+0000 7f081f43e740 1 -- 172.21.15.59:0/1796777315 wait complete. 2024-09-10T11:12:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.149+0000 7f081f43e740 20 client.16125 trim_cache size 0 max 16384 2024-09-10T11:12:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f081f43e740 1 Processor -- start 2024-09-10T11:12:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f081f43e740 1 -- start start 2024-09-10T11:12:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f081f43e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a07821af0 0x562a07826d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f081f43e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07827280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f081f43e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a0782ccb0 0x562a0782b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f081f43e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08141ae090 con 0x562a07822410 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f081f43e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f08141ab960 con 0x562a0782ccb0 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f081f43e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f08141a97d0 con 0x562a07821af0 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f0819c4a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07827280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f0819c4a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07827280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38730/0 (socket says 172.21.15.59:38730) 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.163+0000 7f0819c4a640 1 -- 172.21.15.59:0/1985997493 learned_addr learned my addr 172.21.15.59:0/1985997493 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f081a44b640 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a07821af0 0x562a07826d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f0819c4a640 1 -- 172.21.15.59:0/1985997493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a07821af0 msgr2=0x562a07826d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f0819c4a640 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a07821af0 0x562a07826d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f0819c4a640 1 -- 172.21.15.59:0/1985997493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a0782ccb0 msgr2=0x562a0782b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f081ac4c640 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a0782ccb0 0x562a0782b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f0819c4a640 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a0782ccb0 0x562a0782b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.170 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f0819c4a640 1 -- 172.21.15.59:0/1985997493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a07822240 con 0x562a07822410 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f081ac4c640 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a0782ccb0 0x562a0782b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f0819c4a640 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07827280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0804009900 tx=0x7f08040ef040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba2a315b67ad824 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f07fffff640 1 -- 172.21.15.59:0/1985997493 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804049040 con 0x562a07822410 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f07fffff640 1 -- 172.21.15.59:0/1985997493 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08040c02d0 con 0x562a07822410 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.164+0000 7f07fffff640 1 -- 172.21.15.59:0/1985997493 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08040ed560 con 0x562a07822410 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 -- 172.21.15.59:0/1985997493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 msgr2=0x562a07827280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07827280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0804009900 tx=0x7f08040ef040 comp rx=0 tx=0).stop 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 -- 172.21.15.59:0/1985997493 shutdown_connections 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a0782ccb0 0x562a0782b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07827280 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 --2- 172.21.15.59:0/1985997493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a07821af0 0x562a07826d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 -- 172.21.15.59:0/1985997493 >> 172.21.15.59:0/1985997493 conn(0x562a0781e060 msgr2=0x562a07828bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:10.171 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 -- 172.21.15.59:0/1985997493 shutdown_connections 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 -- 172.21.15.59:0/1985997493 wait complete. 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 -- start start 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 Processor -- start 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07841960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07841ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a078a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08141a9e20 con 0x562a07822410 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f08141ab290 con 0x562a07821af0 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f08141aa4f0 con 0x562a0782ccb0 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f081f43e740 10 client.0 _ll_register_callbacks cb 0x7f080c009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f0819c4a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07841ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f0819c4a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07841ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38740/0 (socket says 172.21.15.59:38740) 2024-09-10T11:12:10.172 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.165+0000 7f0819c4a640 1 -- 172.21.15.59:0/2813154796 learned_addr learned my addr 172.21.15.59:0/2813154796 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f081a44b640 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07841960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f0819c4a640 1 -- 172.21.15.59:0/2813154796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 msgr2=0x562a078a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f081ac4c640 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a078a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f0819c4a640 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a078a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f0819c4a640 1 -- 172.21.15.59:0/2813154796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 msgr2=0x562a07841960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f0819c4a640 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07841960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f0819c4a640 1 -- 172.21.15.59:0/2813154796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a078a0c60 con 0x562a07822410 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f081ac4c640 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a078a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f0819c4a640 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07841ea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f08040bbc20 tx=0x7f08040045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cadc1c994667c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f07fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f07fdffb640 1 -- 172.21.15.59:0/2813154796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804086060 con 0x562a07822410 2024-09-10T11:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f07fdffb640 1 -- 172.21.15.59:0/2813154796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8644+0+0 (secure 0 0 0) 0x7f0804003c80 con 0x562a07822410 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f081f43e740 1 -- 172.21.15.59:0/2813154796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08040c02d0 con 0x562a07822410 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f07fdffb640 1 -- 172.21.15.59:0/2813154796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0804049070 con 0x562a07822410 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f081f43e740 10 client.16131 fetch_fsmap learned FSMap version 26 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f081f43e740 1 -- 172.21.15.59:0/2813154796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562a078a9160 con 0x562a07822410 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.166+0000 7f07fdffb640 1 -- 172.21.15.59:0/2813154796 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08040c02d0 con 0x562a07822410 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f07fdffb640 1 -- 172.21.15.59:0/2813154796 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f08040c4700 con 0x562a07822410 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f081f43e740 10 client.16131 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f081f43e740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f081f43e740 20 client.16131 populate_metadata read hostname 'smithi059' 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f081f43e740 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x562a078a9750 0x562a078abb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f081f43e740 4 client.16131 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:12:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f081f43e740 1 -- 172.21.15.59:0/2813154796 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a0778dd70 con 0x562a078a9750 2024-09-10T11:12:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f081a44b640 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x562a078a9750 0x562a078abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f07fdffb640 10 client.16131 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:12:10.175 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.167+0000 7f081a44b640 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x562a078a9750 0x562a078abb70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e60bd2b08c3ef6a0 server_cookie=7a74b0d39c395f23 in_seq=0 out_seq=0 2024-09-10T11:12:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.180+0000 7f07fdffb640 1 -- 172.21.15.59:0/2813154796 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a0778dd70 con 0x562a078a9750 2024-09-10T11:12:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.180+0000 7f07fdffb640 10 client.16131 handle_command_reply: tid=0 2024-09-10T11:12:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.180+0000 7f081f43e740 1 client.16131 shutdown 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.180+0000 7f081f43e740 1 -- 172.21.15.59:0/2813154796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 msgr2=0x562a07841ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.180+0000 7f081f43e740 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07841ea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f08040bbc20 tx=0x7f08040045f0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081f43e740 1 -- 172.21.15.59:0/2813154796 shutdown_connections 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081f43e740 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x562a078a9750 0x562a078abb70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081f43e740 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a0782ccb0 0x562a078a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081f43e740 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a07822410 0x562a07841ea0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081f43e740 1 --2- 172.21.15.59:0/2813154796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562a07821af0 0x562a07841960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f07fdffb640 0 client.16131 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081f43e740 1 -- 172.21.15.59:0/2813154796 >> 172.21.15.59:0/2813154796 conn(0x562a0781e060 msgr2=0x562a07839ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081f43e740 1 -- 172.21.15.59:0/2813154796 shutdown_connections 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081f43e740 1 -- 172.21.15.59:0/2813154796 wait complete. 2024-09-10T11:12:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081f43e740 20 client.16131 trim_cache size 0 max 16384 2024-09-10T11:12:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:12:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:12:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:12:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081c6af640 1 -- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f08000a2da0 msgr2=0x7f08000a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081c6af640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f08000a2da0 0x7f08000a5260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f080c005c40 tx=0x7f080c005bd0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081c6af640 1 -- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814101350 msgr2=0x7f08141977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.181+0000 7f081c6af640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814101350 0x7f08141977c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0804009230 tx=0x7f0804004270 comp rx=0 tx=0).stop 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.182+0000 7f081c6af640 1 -- 172.21.15.59:0/1825634347 shutdown_connections 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.182+0000 7f081c6af640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08141069c0 0x7f081419bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.182+0000 7f081c6af640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814101350 0x7f08141977c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.182+0000 7f081c6af640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f08000a2da0 0x7f08000a5260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.182+0000 7f081c6af640 1 --2- 172.21.15.59:0/1825634347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08141009b0 0x7f0814197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.182+0000 7f081c6af640 1 -- 172.21.15.59:0/1825634347 >> 172.21.15.59:0/1825634347 conn(0x7f0814077990 msgr2=0x7f0814103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:10.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.182+0000 7f081c6af640 1 -- 172.21.15.59:0/1825634347 shutdown_connections 2024-09-10T11:12:10.188 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:10.182+0000 7f081c6af640 1 -- 172.21.15.59:0/1825634347 wait complete. 2024-09-10T11:12:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:09 smithi059 ceph-mon[30978]: pgmap v336: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 KiB/s wr, 32 op/s 2024-09-10T11:12:10.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:09 smithi181 ceph-mon[35409]: pgmap v336: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 KiB/s wr, 32 op/s 2024-09-10T11:12:10.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:09 smithi115 ceph-mon[34719]: pgmap v336: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 KiB/s wr, 32 op/s 2024-09-10T11:12:12.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:11 smithi059 ceph-mon[30978]: pgmap v337: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 KiB/s wr, 32 op/s 2024-09-10T11:12:12.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:11 smithi181 ceph-mon[35409]: pgmap v337: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 KiB/s wr, 32 op/s 2024-09-10T11:12:12.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:11 smithi115 ceph-mon[34719]: pgmap v337: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 KiB/s wr, 32 op/s 2024-09-10T11:12:14.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:13 smithi059 ceph-mon[30978]: pgmap v338: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 KiB/s wr, 32 op/s 2024-09-10T11:12:14.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:13 smithi059 ceph-mon[30978]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T11:12:14.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:13 smithi181 ceph-mon[35409]: pgmap v338: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 KiB/s wr, 32 op/s 2024-09-10T11:12:14.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:13 smithi181 ceph-mon[35409]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T11:12:14.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:13 smithi115 ceph-mon[34719]: pgmap v338: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 95 KiB/s wr, 32 op/s 2024-09-10T11:12:14.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:13 smithi115 ceph-mon[34719]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T11:12:16.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:15 smithi059 ceph-mon[30978]: pgmap v340: 97 pgs: 97 active+clean; 1.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-09-10T11:12:16.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:15 smithi181 ceph-mon[35409]: pgmap v340: 97 pgs: 97 active+clean; 1.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-09-10T11:12:16.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:15 smithi115 ceph-mon[34719]: pgmap v340: 97 pgs: 97 active+clean; 1.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-09-10T11:12:18.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:17 smithi059 ceph-mon[30978]: pgmap v341: 97 pgs: 97 active+clean; 1.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:12:18.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:17 smithi181 ceph-mon[35409]: pgmap v341: 97 pgs: 97 active+clean; 1.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:12:18.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:17 smithi115 ceph-mon[34719]: pgmap v341: 97 pgs: 97 active+clean; 1.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-09-10T11:12:20.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:20 smithi059 ceph-mon[30978]: pgmap v342: 97 pgs: 97 active+clean; 1.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-10T11:12:20.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:20 smithi181 ceph-mon[35409]: pgmap v342: 97 pgs: 97 active+clean; 1.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-10T11:12:20.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:20 smithi115 ceph-mon[34719]: pgmap v342: 97 pgs: 97 active+clean; 1.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-10T11:12:22.261 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:22 smithi115 ceph-mon[34719]: pgmap v343: 97 pgs: 97 active+clean; 1.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-10T11:12:22.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:22 smithi059 ceph-mon[30978]: pgmap v343: 97 pgs: 97 active+clean; 1.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-10T11:12:22.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:22 smithi181 ceph-mon[35409]: pgmap v343: 97 pgs: 97 active+clean; 1.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-10T11:12:23.285 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 -- 172.21.15.59:0/2439673075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 msgr2=0x7f5404100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 --2- 172.21.15.59:0/2439673075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 0x7f5404100e50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009cd0 tx=0x7f53f802a8e0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 -- 172.21.15.59:0/2439673075 shutdown_connections 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 --2- 172.21.15.59:0/2439673075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404101390 0x7f540410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 --2- 172.21.15.59:0/2439673075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 0x7f5404100e50 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 --2- 172.21.15.59:0/2439673075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5404106a00 0x7f5404106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 -- 172.21.15.59:0/2439673075 >> 172.21.15.59:0/2439673075 conn(0x7f54040fc6b0 msgr2=0x7f54040fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 -- 172.21.15.59:0/2439673075 shutdown_connections 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 -- 172.21.15.59:0/2439673075 wait complete. 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 Processor -- start 2024-09-10T11:12:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.282+0000 7f540ad11640 1 -- start start 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f540ad11640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 0x7f5404199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f540ad11640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404101390 0x7f54041997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f540ad11640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5404106a00 0x7f54041a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f540ad11640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5404110e90 con 0x7f54041009f0 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f540ad11640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5404110d10 con 0x7f5404101390 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f540ad11640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5404111010 con 0x7f5404106a00 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5408aad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 0x7f5404199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5408aad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 0x7f5404199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59484/0 (socket says 172.21.15.59:59484) 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5408aad640 1 -- 172.21.15.59:0/2807723107 learned_addr learned my addr 172.21.15.59:0/2807723107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f54092ae640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5404106a00 0x7f54041a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5403fff640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404101390 0x7f54041997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5408aad640 1 -- 172.21.15.59:0/2807723107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5404106a00 msgr2=0x7f54041a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5408aad640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5404106a00 0x7f54041a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5408aad640 1 -- 172.21.15.59:0/2807723107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404101390 msgr2=0x7f54041997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5408aad640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404101390 0x7f54041997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5408aad640 1 -- 172.21.15.59:0/2807723107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54041a4820 con 0x7f54041009f0 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5403fff640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404101390 0x7f54041997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.283+0000 7f5408aad640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 0x7f5404199260 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f53f400d770 tx=0x7f53f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.284+0000 7f5401ffb640 1 -- 172.21.15.59:0/2807723107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4017070 con 0x7f54041009f0 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.284+0000 7f540ad11640 1 -- 172.21.15.59:0/2807723107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54041a49f0 con 0x7f54041009f0 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.284+0000 7f5401ffb640 1 -- 172.21.15.59:0/2807723107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4005500 con 0x7f54041009f0 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.284+0000 7f5401ffb640 1 -- 172.21.15.59:0/2807723107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4004e00 con 0x7f54041009f0 2024-09-10T11:12:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.284+0000 7f540ad11640 1 -- 172.21.15.59:0/2807723107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54041a4f10 con 0x7f54041009f0 2024-09-10T11:12:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.287+0000 7f5401ffb640 1 -- 172.21.15.59:0/2807723107 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f53f4004fa0 con 0x7f54041009f0 2024-09-10T11:12:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.287+0000 7f540daa7740 1 Processor -- start 2024-09-10T11:12:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.287+0000 7f540daa7740 1 -- start start 2024-09-10T11:12:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f540daa7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f540daa7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 0x5556ab1b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f540daa7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1b80c0 0x5556ab1ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f540daa7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5556ab10d2f0 con 0x5556ab1b80c0 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f540daa7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5556ab0b5270 con 0x5556ab1acf00 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f540daa7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5556ab1092b0 con 0x5556ab1ad820 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5403fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1b80c0 0x5556ab1ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5403fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1b80c0 0x5556ab1ba4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59500/0 (socket says 172.21.15.59:59500) 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5403fff640 1 -- 172.21.15.59:0/1395809844 learned_addr learned my addr 172.21.15.59:0/1395809844 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f54092ae640 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5408aad640 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 0x5556ab1b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5401ffb640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53ec0a2da0 0x7f53ec0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5403fff640 1 -- 172.21.15.59:0/1395809844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 msgr2=0x5556ab1b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5403fff640 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 0x5556ab1b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5403fff640 1 -- 172.21.15.59:0/1395809844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 msgr2=0x5556ab1ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5403fff640 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5403fff640 1 -- 172.21.15.59:0/1395809844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ab0b4340 con 0x5556ab1b80c0 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f54092ae640 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f54092ae640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53ec0a2da0 0x7f53ec0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5401ffb640 1 -- 172.21.15.59:0/2807723107 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f53f40ceed0 con 0x7f54041009f0 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.288+0000 7f5403fff640 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1b80c0 0x5556ab1ba4b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f53f802ae00 tx=0x7f53f80314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0b92ee6588e5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.289+0000 7f53eaffd640 1 -- 172.21.15.59:0/1395809844 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8031ac0 con 0x5556ab1b80c0 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.289+0000 7f54092ae640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53ec0a2da0 0x7f53ec0a5260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53fc005d00 tx=0x7f53fc0046c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.289+0000 7f53eaffd640 1 -- 172.21.15.59:0/1395809844 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f8036040 con 0x5556ab1b80c0 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.289+0000 7f53eaffd640 1 -- 172.21.15.59:0/1395809844 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8004620 con 0x5556ab1b80c0 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.289+0000 7f540daa7740 1 -- 172.21.15.59:0/1395809844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1b80c0 msgr2=0x5556ab1ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.289+0000 7f540daa7740 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1b80c0 0x5556ab1ba4b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f53f802ae00 tx=0x7f53f80314e0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.289+0000 7f540daa7740 1 -- 172.21.15.59:0/1395809844 shutdown_connections 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.289+0000 7f540daa7740 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1b80c0 0x5556ab1ba4b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 0x5556ab1b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 --2- 172.21.15.59:0/1395809844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 -- 172.21.15.59:0/1395809844 >> 172.21.15.59:0/1395809844 conn(0x5556ab1a9470 msgr2=0x5556ab1a9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 -- 172.21.15.59:0/1395809844 shutdown_connections 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 -- 172.21.15.59:0/1395809844 wait complete. 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 -- start start 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 Processor -- start 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1b80c0 0x5556ab1b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5556ab1bac90 con 0x5556ab1ad820 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5556ab096290 con 0x5556ab1acf00 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.290+0000 7f540daa7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5556ab1bae10 con 0x5556ab1b80c0 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f540daa7740 10 client.0 _ll_register_callbacks cb 0x5556ab0c7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5403fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5403fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59514/0 (socket says 172.21.15.59:59514) 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5403fff640 1 -- 172.21.15.59:0/3504270480 learned_addr learned my addr 172.21.15.59:0/3504270480 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5408aad640 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f54092ae640 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1b80c0 0x5556ab1b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5403fff640 1 -- 172.21.15.59:0/3504270480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1b80c0 msgr2=0x5556ab1b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5403fff640 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1b80c0 0x5556ab1b5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5403fff640 1 -- 172.21.15.59:0/3504270480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 msgr2=0x5556ab1b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5403fff640 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5403fff640 1 -- 172.21.15.59:0/3504270480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556aae20210 con 0x5556ab1ad820 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5408aad640 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f5403fff640 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1b54d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f53f8004650 tx=0x7f53f8004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448483f99dd81f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f53e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f53e3fff640 1 -- 172.21.15.59:0/3504270480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8031d70 con 0x5556ab1ad820 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f53e3fff640 1 -- 172.21.15.59:0/3504270480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f53f8003b80 con 0x5556ab1ad820 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f540daa7740 1 -- 172.21.15.59:0/3504270480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f8036040 con 0x5556ab1ad820 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f53e3fff640 1 -- 172.21.15.59:0/3504270480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f53f8056050 con 0x5556ab1ad820 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f540daa7740 10 client.16143 fetch_fsmap learned FSMap version 26 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.291+0000 7f540daa7740 1 -- 172.21.15.59:0/3504270480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5556aaeec620 con 0x5556ab1ad820 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.292+0000 7f53e3fff640 1 -- 172.21.15.59:0/3504270480 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f8036040 con 0x5556ab1ad820 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.292+0000 7f53e3fff640 1 -- 172.21.15.59:0/3504270480 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f53f8030070 con 0x5556ab1ad820 2024-09-10T11:12:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.292+0000 7f540daa7740 10 client.16143 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:12:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.292+0000 7f540daa7740 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:12:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.292+0000 7f540daa7740 20 client.16143 populate_metadata read hostname 'smithi059' 2024-09-10T11:12:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.292+0000 7f540daa7740 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5556ab1c7e90 0x5556ab1ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.292+0000 7f540daa7740 4 client.16143 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:12:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.292+0000 7f540daa7740 1 -- 172.21.15.59:0/3504270480 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556ab11aa20 con 0x5556ab1c7e90 2024-09-10T11:12:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.292+0000 7f5408aad640 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5556ab1c7e90 0x5556ab1ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f5408aad640 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5556ab1c7e90 0x5556ab1ca280 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f70d810f565747 server_cookie=2996c0a42a28495d in_seq=0 out_seq=0 2024-09-10T11:12:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f53e3fff640 10 client.16143 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:12:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f53e3fff640 1 -- 172.21.15.59:0/3504270480 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556ab11aa20 con 0x5556ab1c7e90 2024-09-10T11:12:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f53e3fff640 10 client.16143 handle_command_reply: tid=0 2024-09-10T11:12:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f540daa7740 1 client.16143 shutdown 2024-09-10T11:12:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f540daa7740 1 -- 172.21.15.59:0/3504270480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 msgr2=0x5556ab1b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f540daa7740 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1b54d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f53f8004650 tx=0x7f53f8004680 comp rx=0 tx=0).stop 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f540daa7740 1 -- 172.21.15.59:0/3504270480 shutdown_connections 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f540daa7740 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5556ab1c7e90 0x5556ab1ca280 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.293+0000 7f540daa7740 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1b80c0 0x5556ab1b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.294+0000 7f540daa7740 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1b54d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.294+0000 7f540daa7740 1 --2- 172.21.15.59:0/3504270480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1acf00 0x5556ab1b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.294+0000 7f540daa7740 1 -- 172.21.15.59:0/3504270480 >> 172.21.15.59:0/3504270480 conn(0x5556ab1a9470 msgr2=0x5556ab1a41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.294+0000 7f53e3fff640 0 client.16143 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.294+0000 7f540daa7740 1 -- 172.21.15.59:0/3504270480 shutdown_connections 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.294+0000 7f540daa7740 1 -- 172.21.15.59:0/3504270480 wait complete. 2024-09-10T11:12:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.294+0000 7f540daa7740 20 client.16143 trim_cache size 0 max 16384 2024-09-10T11:12:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f540daa7740 1 Processor -- start 2024-09-10T11:12:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f540daa7740 1 -- start start 2024-09-10T11:12:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f540daa7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1acf00 0x5556ab1b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f540daa7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f540daa7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 0x5556ab1cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f540daa7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54041ae020 con 0x5556ab1ad820 2024-09-10T11:12:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f540daa7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f54041ab8f0 con 0x5556ab1b80c0 2024-09-10T11:12:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f540daa7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f54041a9780 con 0x5556ab1acf00 2024-09-10T11:12:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f5403fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f5403fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59526/0 (socket says 172.21.15.59:59526) 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f5403fff640 1 -- 172.21.15.59:0/116181374 learned_addr learned my addr 172.21.15.59:0/116181374 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f5408aad640 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1acf00 0x5556ab1b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f5403fff640 1 -- 172.21.15.59:0/116181374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1acf00 msgr2=0x5556ab1b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f5403fff640 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1acf00 0x5556ab1b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f5403fff640 1 -- 172.21.15.59:0/116181374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 msgr2=0x5556ab1cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.309+0000 7f54092ae640 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 0x5556ab1cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.310+0000 7f5403fff640 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 0x5556ab1cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.310+0000 7f5403fff640 1 -- 172.21.15.59:0/116181374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ab1a3790 con 0x5556ab1ad820 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.310+0000 7f54092ae640 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 0x5556ab1cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.310+0000 7f5403fff640 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1cf850 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f53f802ae00 tx=0x7f53f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9bee20edef2135 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.310+0000 7f53ea7fc640 1 -- 172.21.15.59:0/116181374 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8030da0 con 0x5556ab1ad820 2024-09-10T11:12:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.310+0000 7f53ea7fc640 1 -- 172.21.15.59:0/116181374 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f8036040 con 0x5556ab1ad820 2024-09-10T11:12:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.310+0000 7f53ea7fc640 1 -- 172.21.15.59:0/116181374 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8003e00 con 0x5556ab1ad820 2024-09-10T11:12:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 -- 172.21.15.59:0/116181374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 msgr2=0x5556ab1cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1cf850 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f53f802ae00 tx=0x7f53f8009b60 comp rx=0 tx=0).stop 2024-09-10T11:12:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 -- 172.21.15.59:0/116181374 shutdown_connections 2024-09-10T11:12:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 0x5556ab1cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1ad820 0x5556ab1cf850 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 --2- 172.21.15.59:0/116181374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1acf00 0x5556ab1b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 -- 172.21.15.59:0/116181374 >> 172.21.15.59:0/116181374 conn(0x5556ab1a9470 msgr2=0x5556ab1b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 -- 172.21.15.59:0/116181374 shutdown_connections 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 -- 172.21.15.59:0/116181374 wait complete. 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 -- start start 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.311+0000 7f540daa7740 1 Processor -- start 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f540daa7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1acf00 0x5556ab1c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f540daa7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 0x5556ab1c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f540daa7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 0x5556ab1b1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f540daa7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54041a9dd0 con 0x5556ab1acf00 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f540daa7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f54041ab220 con 0x5556ab1b80c0 2024-09-10T11:12:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f540daa7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f54041aa480 con 0x5556ab1ad820 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f540daa7740 10 client.0 _ll_register_callbacks cb 0x7f53f8031430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5408aad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1acf00 0x5556ab1c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5408aad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1acf00 0x5556ab1c0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59536/0 (socket says 172.21.15.59:59536) 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5408aad640 1 -- 172.21.15.59:0/478186872 learned_addr learned my addr 172.21.15.59:0/478186872 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5403fff640 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 0x5556ab1c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f54092ae640 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 0x5556ab1b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5408aad640 1 -- 172.21.15.59:0/478186872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 msgr2=0x5556ab1c07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5408aad640 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 0x5556ab1c07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5408aad640 1 -- 172.21.15.59:0/478186872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 msgr2=0x5556ab1b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5408aad640 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 0x5556ab1b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5408aad640 1 -- 172.21.15.59:0/478186872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ab1b1f90 con 0x5556ab1acf00 2024-09-10T11:12:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5403fff640 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 0x5556ab1c07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f5408aad640 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1acf00 0x5556ab1c0290 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f53f4097d10 tx=0x7f53f40048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5c898559227127 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.312+0000 7f53e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f53e3fff640 1 -- 172.21.15.59:0/478186872 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4020040 con 0x5556ab1acf00 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f53e3fff640 1 -- 172.21.15.59:0/478186872 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f53f4009cc0 con 0x5556ab1acf00 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f540daa7740 1 -- 172.21.15.59:0/478186872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f8036040 con 0x5556ab1acf00 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f53e3fff640 1 -- 172.21.15.59:0/478186872 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f53f409b340 con 0x5556ab1acf00 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f540daa7740 10 client.16149 fetch_fsmap learned FSMap version 26 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f540daa7740 1 -- 172.21.15.59:0/478186872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5556ab232280 con 0x5556ab1acf00 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f53e3fff640 1 -- 172.21.15.59:0/478186872 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f8036040 con 0x5556ab1acf00 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f53e3fff640 1 -- 172.21.15.59:0/478186872 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f53f40b4120 con 0x5556ab1acf00 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f540daa7740 10 client.16149 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f540daa7740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T11:12:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f540daa7740 20 client.16149 populate_metadata read hostname 'smithi059' 2024-09-10T11:12:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f540daa7740 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5556ab2329a0 0x5556ab234db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f540daa7740 4 client.16149 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T11:12:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f540daa7740 1 -- 172.21.15.59:0/478186872 --> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5556ab114d70 con 0x5556ab2329a0 2024-09-10T11:12:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.313+0000 7f5403fff640 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5556ab2329a0 0x5556ab234db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.314+0000 7f5403fff640 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5556ab2329a0 0x5556ab234db0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b26f844aa4f12141 server_cookie=ff97e6019c9f5ae4 in_seq=0 out_seq=0 2024-09-10T11:12:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.314+0000 7f53e3fff640 10 client.16149 ms_handle_connect on v2:172.21.15.115:6838/411505011 2024-09-10T11:12:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f53e3fff640 1 -- 172.21.15.59:0/478186872 <== mds.0 v2:172.21.15.115:6838/411505011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5556ab114d70 con 0x5556ab2329a0 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f53e3fff640 10 client.16149 handle_command_reply: tid=0 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f540daa7740 1 client.16149 shutdown 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f540daa7740 1 -- 172.21.15.59:0/478186872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1acf00 msgr2=0x5556ab1c0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f540daa7740 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1acf00 0x5556ab1c0290 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f53f4097d10 tx=0x7f53f40048a0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f540daa7740 1 -- 172.21.15.59:0/478186872 shutdown_connections 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f540daa7740 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.115:6838/411505011,v1:172.21.15.115:6839/411505011] conn(0x5556ab2329a0 0x5556ab234db0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f540daa7740 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5556ab1b80c0 0x5556ab1b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f53e3fff640 0 client.16149 ms_handle_reset on v2:172.21.15.115:6838/411505011 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f540daa7740 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5556ab1ad820 0x5556ab1c07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f540daa7740 1 --2- 172.21.15.59:0/478186872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556ab1acf00 0x5556ab1c0290 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.327+0000 7f540daa7740 1 -- 172.21.15.59:0/478186872 >> 172.21.15.59:0/478186872 conn(0x5556ab1a9470 msgr2=0x5556ab1b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540daa7740 1 -- 172.21.15.59:0/478186872 shutdown_connections 2024-09-10T11:12:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540daa7740 1 -- 172.21.15.59:0/478186872 wait complete. 2024-09-10T11:12:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540daa7740 20 client.16149 trim_cache size 0 max 16384 2024-09-10T11:12:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:{ 2024-09-10T11:12:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "message": "", 2024-09-10T11:12:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout: "return_code": 0 2024-09-10T11:12:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stdout:} 2024-09-10T11:12:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 -- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53ec0a2da0 msgr2=0x7f53ec0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53ec0a2da0 0x7f53ec0a5260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53fc005d00 tx=0x7f53fc0046c0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 -- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 msgr2=0x7f5404199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 0x7f5404199260 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f53f400d770 tx=0x7f53f400dc30 comp rx=0 tx=0).stop 2024-09-10T11:12:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 -- 172.21.15.59:0/2807723107 shutdown_connections 2024-09-10T11:12:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f53ec0a2da0 0x7f53ec0a5260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5404106a00 0x7f54041a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5404101390 0x7f54041997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 --2- 172.21.15.59:0/2807723107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54041009f0 0x7f5404199260 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.328+0000 7f540ad11640 1 -- 172.21.15.59:0/2807723107 >> 172.21.15.59:0/2807723107 conn(0x7f54040fc6b0 msgr2=0x7f54040fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.329+0000 7f540ad11640 1 -- 172.21.15.59:0/2807723107 shutdown_connections 2024-09-10T11:12:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi059.front.sepia.ceph.com.smithi059.stderr:2024-09-10T11:12:23.329+0000 7f540ad11640 1 -- 172.21.15.59:0/2807723107 wait complete. 2024-09-10T11:12:24.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:24 smithi059 ceph-mon[30978]: pgmap v344: 97 pgs: 97 active+clean; 1.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-10T11:12:24.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:24 smithi181 ceph-mon[35409]: pgmap v344: 97 pgs: 97 active+clean; 1.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-10T11:12:24.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:24 smithi115 ceph-mon[34719]: pgmap v344: 97 pgs: 97 active+clean; 1.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-10T11:12:26.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:26 smithi059 ceph-mon[30978]: pgmap v345: 97 pgs: 97 active+clean; 2.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-10T11:12:26.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:26 smithi181 ceph-mon[35409]: pgmap v345: 97 pgs: 97 active+clean; 2.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-10T11:12:26.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:26 smithi115 ceph-mon[34719]: pgmap v345: 97 pgs: 97 active+clean; 2.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-10T11:12:28.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:28 smithi059 ceph-mon[30978]: pgmap v346: 97 pgs: 97 active+clean; 2.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:12:28.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:28 smithi181 ceph-mon[35409]: pgmap v346: 97 pgs: 97 active+clean; 2.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:12:28.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:28 smithi115 ceph-mon[34719]: pgmap v346: 97 pgs: 97 active+clean; 2.1 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-10T11:12:30.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:30 smithi059 ceph-mon[30978]: pgmap v347: 97 pgs: 97 active+clean; 2.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:12:30.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:30 smithi181 ceph-mon[35409]: pgmap v347: 97 pgs: 97 active+clean; 2.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:12:30.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:30 smithi115 ceph-mon[34719]: pgmap v347: 97 pgs: 97 active+clean; 2.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 16 op/s 2024-09-10T11:12:32.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:32 smithi059 ceph-mon[30978]: pgmap v348: 97 pgs: 97 active+clean; 2.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:12:32.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:32 smithi181 ceph-mon[35409]: pgmap v348: 97 pgs: 97 active+clean; 2.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:12:32.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:32 smithi115 ceph-mon[34719]: pgmap v348: 97 pgs: 97 active+clean; 2.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:12:34.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:34 smithi059 ceph-mon[30978]: pgmap v349: 97 pgs: 97 active+clean; 2.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:12:34.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:34 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:12:34.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:34 smithi181 ceph-mon[35409]: pgmap v349: 97 pgs: 97 active+clean; 2.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:12:34.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:34 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:12:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:34 smithi115 ceph-mon[34719]: pgmap v349: 97 pgs: 97 active+clean; 2.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-10T11:12:34.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:34 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:561/600: open fd = 3 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:562/600: open fd = 3 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:563/600: open fd = 3 2024-09-10T11:12:34.573 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:564/600: open fd = 3 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:565/600: open fd = 3 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:566/600: open fd = 3 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.574 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:567/600: open fd = 3 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:568/600: open fd = 3 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:569/600: open fd = 3 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:570/600: open fd = 3 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.575 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:571/600: open fd = 3 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:572/600: open fd = 3 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:573/600: open fd = 3 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:574/600: open fd = 3 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.576 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:575/600: open fd = 3 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:576/600: open fd = 3 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:577/600: open fd = 3 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.577 INFO:tasks.workunit.client.0.smithi059.stdout:578/600: open fd = 3 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:579/600: open fd = 3 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:580/600: open fd = 3 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:581/600: open fd = 3 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.578 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:582/600: open fd = 3 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:583/600: open fd = 3 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:584/600: open fd = 3 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:585/600: open fd = 3 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:586/600: open fd = 3 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:587/600: open fd = 3 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:588/600: open fd = 3 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:589/600: open fd = 3 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:590/600: open fd = 3 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:591/600: open fd = 3 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:592/600: open fd = 3 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:593/600: open fd = 3 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:594/600: open fd = 3 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:595/600: open fd = 3 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.582 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:596/600: open fd = 3 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:597/600: open fd = 3 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:598/600: open fd = 3 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:599/600: open fd = 3 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.583 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.584 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.584 INFO:tasks.workunit.client.0.smithi059.stdout:600/600: open fd = 3 2024-09-10T11:12:34.584 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.584 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T11:12:34.584 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T11:12:34.584 INFO:tasks.workunit.client.0.smithi059.stderr:+ echo OK 2024-09-10T11:12:34.585 INFO:tasks.workunit.client.0.smithi059.stdout:OK 2024-09-10T11:12:34.585 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T11:12:34.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T11:12:34.667 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-10T11:12:34.667 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T11:12:35.001 DEBUG:teuthology.parallel:result is None 2024-09-10T11:12:35.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T11:12:35.036 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T11:12:35.036 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-10T11:12:35.047 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:12:35.085 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-10T11:12:35.094 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-10T11:12:35.094 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T11:12:35.094 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:12:35.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-10T11:12:35.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-10T11:12:35.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T11:12:35.287 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:35 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:12:35.288 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:35 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:12:35.288 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:35 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:12:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.368+0000 7f8b32817640 1 -- 172.21.15.59:0/3556692968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c1009f0 msgr2=0x7f8b2c100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.368+0000 7f8b32817640 1 --2- 172.21.15.59:0/3556692968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c1009f0 0x7f8b2c100e50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009930 tx=0x7f8b2002a420 comp rx=0 tx=0).stop 2024-09-10T11:12:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.368+0000 7f8b32817640 1 -- 172.21.15.59:0/3556692968 shutdown_connections 2024-09-10T11:12:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.368+0000 7f8b32817640 1 --2- 172.21.15.59:0/3556692968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b2c101390 0x7f8b2c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.368+0000 7f8b32817640 1 --2- 172.21.15.59:0/3556692968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c1009f0 0x7f8b2c100e50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.368+0000 7f8b32817640 1 --2- 172.21.15.59:0/3556692968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c106a00 0x7f8b2c106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.368+0000 7f8b32817640 1 -- 172.21.15.59:0/3556692968 >> 172.21.15.59:0/3556692968 conn(0x7f8b2c0fc6b0 msgr2=0x7f8b2c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.368+0000 7f8b32817640 1 -- 172.21.15.59:0/3556692968 shutdown_connections 2024-09-10T11:12:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.368+0000 7f8b32817640 1 -- 172.21.15.59:0/3556692968 wait complete. 2024-09-10T11:12:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b32817640 1 Processor -- start 2024-09-10T11:12:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b32817640 1 -- start start 2024-09-10T11:12:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b32817640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c1009f0 0x7f8b2c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b32817640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c101390 0x7f8b2c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b32817640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b2c106a00 0x7f8b2c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b32817640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c110e90 con 0x7f8b2c101390 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b32817640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c110d10 con 0x7f8b2c1009f0 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b32817640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c111010 con 0x7f8b2c106a00 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b2b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c101390 0x7f8b2c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b2b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c101390 0x7f8b2c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41072/0 (socket says 172.21.15.59:41072) 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b2b7fe640 1 -- 172.21.15.59:0/773895104 learned_addr learned my addr 172.21.15.59:0/773895104 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b2bfff640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c1009f0 0x7f8b2c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.369+0000 7f8b30db4640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b2c106a00 0x7f8b2c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b2b7fe640 1 -- 172.21.15.59:0/773895104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b2c106a00 msgr2=0x7f8b2c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b2b7fe640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b2c106a00 0x7f8b2c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b2b7fe640 1 -- 172.21.15.59:0/773895104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c1009f0 msgr2=0x7f8b2c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b2b7fe640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c1009f0 0x7f8b2c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b2b7fe640 1 -- 172.21.15.59:0/773895104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c19d3d0 con 0x7f8b2c101390 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b2b7fe640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c101390 0x7f8b2c198920 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8b2002a940 tx=0x7f8b20003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b297fa640 1 -- 172.21.15.59:0/773895104 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2003f070 con 0x7f8b2c101390 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2c19d660 con 0x7f8b2c101390 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b297fa640 1 -- 172.21.15.59:0/773895104 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b20031c90 con 0x7f8b2c101390 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b297fa640 1 -- 172.21.15.59:0/773895104 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20035030 con 0x7f8b2c101390 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.370+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2c1a4f50 con 0x7f8b2c101390 2024-09-10T11:12:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.371+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b2c102130 con 0x7f8b2c101390 2024-09-10T11:12:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.372+0000 7f8b297fa640 1 -- 172.21.15.59:0/773895104 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8b20042070 con 0x7f8b2c101390 2024-09-10T11:12:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.373+0000 7f8b297fa640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8b140a2da0 0x7f8b140a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.373+0000 7f8b297fa640 1 -- 172.21.15.59:0/773895104 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f8b200f0130 con 0x7f8b2c101390 2024-09-10T11:12:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.373+0000 7f8b2bfff640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8b140a2da0 0x7f8b140a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.374+0000 7f8b2bfff640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8b140a2da0 0x7f8b140a5260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009990 tx=0x7f8b1c009110 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:35.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.376+0000 7f8b297fa640 1 -- 172.21.15.59:0/773895104 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b200bcda0 con 0x7f8b2c101390 2024-09-10T11:12:35.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:35 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:12:35.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:35 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:12:35.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:35 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:12:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:35 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:12:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:35 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:12:35.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:35 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' 2024-09-10T11:12:35.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.573+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 --> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f8b2c109fc0 con 0x7f8b140a2da0 2024-09-10T11:12:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.581+0000 7f8b297fa640 1 -- 172.21.15.59:0/773895104 <== mgr.15132 v2:172.21.15.59:6800/3897711076 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f8b2c109fc0 con 0x7f8b140a2da0 2024-09-10T11:12:35.583 INFO:teuthology.orchestra.run.smithi059.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T11:01:24", "first": "2024-09-10T11:02:00", "last": "2024-09-10T11:12:00", "last_pruned": "2024-09-10T11:12:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-09-10T11:12:35.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8b140a2da0 msgr2=0x7f8b140a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8b140a2da0 0x7f8b140a5260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009990 tx=0x7f8b1c009110 comp rx=0 tx=0).stop 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c101390 msgr2=0x7f8b2c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c101390 0x7f8b2c198920 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8b2002a940 tx=0x7f8b20003b90 comp rx=0 tx=0).stop 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 shutdown_connections 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8b140a2da0 0x7f8b140a5260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b2c106a00 0x7f8b2c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b2c101390 0x7f8b2c198920 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 --2- 172.21.15.59:0/773895104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c1009f0 0x7f8b2c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 >> 172.21.15.59:0/773895104 conn(0x7f8b2c0fc6b0 msgr2=0x7f8b2c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 shutdown_connections 2024-09-10T11:12:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.584+0000 7f8b32817640 1 -- 172.21.15.59:0/773895104 wait complete. 2024-09-10T11:12:35.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T11:12:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.740+0000 7f988aaac640 1 -- 172.21.15.59:0/3290297059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 msgr2=0x7f988410d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.740+0000 7f988aaac640 1 --2- 172.21.15.59:0/3290297059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 0x7f988410d8c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f987c009cd0 tx=0x7f987c02a8e0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.740+0000 7f988aaac640 1 -- 172.21.15.59:0/3290297059 shutdown_connections 2024-09-10T11:12:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.740+0000 7f988aaac640 1 --2- 172.21.15.59:0/3290297059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 0x7f988410d8c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.740+0000 7f988aaac640 1 --2- 172.21.15.59:0/3290297059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98841009f0 0x7f9884100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.740+0000 7f988aaac640 1 --2- 172.21.15.59:0/3290297059 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9884106a00 0x7f9884106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.740+0000 7f988aaac640 1 -- 172.21.15.59:0/3290297059 >> 172.21.15.59:0/3290297059 conn(0x7f98840fc6b0 msgr2=0x7f98840fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.740+0000 7f988aaac640 1 -- 172.21.15.59:0/3290297059 shutdown_connections 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.740+0000 7f988aaac640 1 -- 172.21.15.59:0/3290297059 wait complete. 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f988aaac640 1 Processor -- start 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f988aaac640 1 -- start start 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f988aaac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98841009f0 0x7f9884198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f988aaac640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 0x7f98841988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f988aaac640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884106a00 0x7f988419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f988aaac640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9884110e40 con 0x7f9884101390 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f988aaac640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9884110cc0 con 0x7f9884106a00 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f988aaac640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9884110fc0 con 0x7f98841009f0 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f9883fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 0x7f98841988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f9883fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 0x7f98841988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41094/0 (socket says 172.21.15.59:41094) 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f9883fff640 1 -- 172.21.15.59:0/678178312 learned_addr learned my addr 172.21.15.59:0/678178312 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f9889049640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884106a00 0x7f988419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.741+0000 7f9888848640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98841009f0 0x7f9884198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9883fff640 1 -- 172.21.15.59:0/678178312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98841009f0 msgr2=0x7f9884198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9883fff640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98841009f0 0x7f9884198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9883fff640 1 -- 172.21.15.59:0/678178312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884106a00 msgr2=0x7f988419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9883fff640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884106a00 0x7f988419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9883fff640 1 -- 172.21.15.59:0/678178312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988419d370 con 0x7f9884101390 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9888848640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98841009f0 0x7f9884198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9883fff640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 0x7f98841988c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f987000d950 tx=0x7f987000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9881ffb640 1 -- 172.21.15.59:0/678178312 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870017030 con 0x7f9884101390 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988419d660 con 0x7f9884101390 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9881ffb640 1 -- 172.21.15.59:0/678178312 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9870004020 con 0x7f9884101390 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f9881ffb640 1 -- 172.21.15.59:0/678178312 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98700047a0 con 0x7f9884101390 2024-09-10T11:12:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.742+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98841a4ef0 con 0x7f9884101390 2024-09-10T11:12:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.743+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9884100e50 con 0x7f9884101390 2024-09-10T11:12:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.744+0000 7f9881ffb640 1 -- 172.21.15.59:0/678178312 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f98700041d0 con 0x7f9884101390 2024-09-10T11:12:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.745+0000 7f9881ffb640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f98740a2da0 0x7f98740a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.745+0000 7f9881ffb640 1 -- 172.21.15.59:0/678178312 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f98700ceed0 con 0x7f9884101390 2024-09-10T11:12:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.745+0000 7f9888848640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f98740a2da0 0x7f98740a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.746+0000 7f9888848640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f98740a2da0 0x7f98740a5260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9878005fd0 tx=0x7f98780094d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.749+0000 7f9881ffb640 1 -- 172.21.15.59:0/678178312 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f987009ba40 con 0x7f9884101390 2024-09-10T11:12:35.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.947+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 --> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f9884104700 con 0x7f98740a2da0 2024-09-10T11:12:35.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.954+0000 7f9881ffb640 1 -- 172.21.15.59:0/678178312 <== mgr.15132 v2:172.21.15.59:6800/3897711076 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f9884104700 con 0x7f98740a2da0 2024-09-10T11:12:35.956 INFO:teuthology.orchestra.run.smithi059.stdout:/ 1m 6m3h 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f98740a2da0 msgr2=0x7f98740a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f98740a2da0 0x7f98740a5260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9878005fd0 tx=0x7f98780094d0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 msgr2=0x7f98841988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 0x7f98841988c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f987000d950 tx=0x7f987000de10 comp rx=0 tx=0).stop 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 shutdown_connections 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9884106a00 0x7f988419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9884101390 0x7f98841988c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f98740a2da0 0x7f98740a5260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 --2- 172.21.15.59:0/678178312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98841009f0 0x7f9884198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 >> 172.21.15.59:0/678178312 conn(0x7f98840fc6b0 msgr2=0x7f98840fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 shutdown_connections 2024-09-10T11:12:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:35.957+0000 7f988aaac640 1 -- 172.21.15.59:0/678178312 wait complete. 2024-09-10T11:12:35.969 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T11:12:35.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:12:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 -- 172.21.15.59:0/438841977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 msgr2=0x7f4c5c103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 --2- 172.21.15.59:0/438841977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 0x7f4c5c103070 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009900 tx=0x7f4c4c02a480 comp rx=0 tx=0).stop 2024-09-10T11:12:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 -- 172.21.15.59:0/438841977 shutdown_connections 2024-09-10T11:12:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 --2- 172.21.15.59:0/438841977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c5c10c0e0 0x7f4c5c10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 --2- 172.21.15.59:0/438841977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c1035b0 0x7f4c5c10ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 --2- 172.21.15.59:0/438841977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 0x7f4c5c103070 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 -- 172.21.15.59:0/438841977 >> 172.21.15.59:0/438841977 conn(0x7f4c5c0fc6a0 msgr2=0x7f4c5c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 -- 172.21.15.59:0/438841977 shutdown_connections 2024-09-10T11:12:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 -- 172.21.15.59:0/438841977 wait complete. 2024-09-10T11:12:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 Processor -- start 2024-09-10T11:12:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.084+0000 7f4c622c9640 1 -- start start 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c622c9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 0x7f4c5c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c622c9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c1035b0 0x7f4c5c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c622c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c5c10c0e0 0x7f4c5c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c622c9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c111ec0 con 0x7f4c5c102c90 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c622c9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c111d40 con 0x7f4c5c1035b0 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c622c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c112040 con 0x7f4c5c10c0e0 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 0x7f4c5c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 0x7f4c5c1983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41112/0 (socket says 172.21.15.59:41112) 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5bfff640 1 -- 172.21.15.59:0/1863451327 learned_addr learned my addr 172.21.15.59:0/1863451327 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c60866640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c5c10c0e0 0x7f4c5c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5b7fe640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c1035b0 0x7f4c5c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5bfff640 1 -- 172.21.15.59:0/1863451327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c5c10c0e0 msgr2=0x7f4c5c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5bfff640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c5c10c0e0 0x7f4c5c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5bfff640 1 -- 172.21.15.59:0/1863451327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c1035b0 msgr2=0x7f4c5c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5bfff640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c1035b0 0x7f4c5c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5bfff640 1 -- 172.21.15.59:0/1863451327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c19d390 con 0x7f4c5c102c90 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c60866640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c5c10c0e0 0x7f4c5c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5b7fe640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c1035b0 0x7f4c5c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.085+0000 7f4c5bfff640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 0x7f4c5c1983a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006010 tx=0x7f4c4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.086+0000 7f4c597fa640 1 -- 172.21.15.59:0/1863451327 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c03f030 con 0x7f4c5c102c90 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.086+0000 7f4c597fa640 1 -- 172.21.15.59:0/1863451327 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c4c003ce0 con 0x7f4c5c102c90 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.086+0000 7f4c597fa640 1 -- 172.21.15.59:0/1863451327 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c035070 con 0x7f4c5c102c90 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.086+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5c19d620 con 0x7f4c5c102c90 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.086+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5c1a4f10 con 0x7f4c5c102c90 2024-09-10T11:12:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.087+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5c103070 con 0x7f4c5c102c90 2024-09-10T11:12:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.088+0000 7f4c597fa640 1 -- 172.21.15.59:0/1863451327 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4c4c042030 con 0x7f4c5c102c90 2024-09-10T11:12:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.089+0000 7f4c597fa640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4c440a2d80 0x7f4c440a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.089+0000 7f4c5b7fe640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4c440a2d80 0x7f4c440a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.089+0000 7f4c597fa640 1 -- 172.21.15.59:0/1863451327 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f4c4c0efd90 con 0x7f4c5c102c90 2024-09-10T11:12:36.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.089+0000 7f4c5b7fe640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4c440a2d80 0x7f4c440a5240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0feca0 tx=0x7f4c50009670 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.092+0000 7f4c597fa640 1 -- 172.21.15.59:0/1863451327 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c4c0bc9c0 con 0x7f4c5c102c90 2024-09-10T11:12:36.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.269+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c5c107150 con 0x7f4c5c102c90 2024-09-10T11:12:36.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.271+0000 7f4c597fa640 1 -- 172.21.15.59:0/1863451327 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+23299 (secure 0 0 0) 0x7f4c4c0bc2c0 con 0x7f4c5c102c90 2024-09-10T11:12:36.273 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:12:36.274 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":97,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T11:12:13.722673+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:59:27.480743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:59:30.088912+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/2735068879":"2024-09-11T11:01:22.217825+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2362644310":"2024-09-11T11:01:22.217825+0000","172.21.15.59:6801/3145930564":"2024-09-11T11:01:22.217825+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3145930564":"2024-09-11T11:01:22.217825+0000","172.21.15.59:0/626509906":"2024-09-11T11:01:22.217825+0000","172.21.15.59:0/2665068071":"2024-09-11T11:01:22.217825+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:12:36.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4c440a2d80 msgr2=0x7f4c440a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4c440a2d80 0x7f4c440a5240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0feca0 tx=0x7f4c50009670 comp rx=0 tx=0).stop 2024-09-10T11:12:36.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 msgr2=0x7f4c5c1983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 0x7f4c5c1983a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006010 tx=0x7f4c4c0042f0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 shutdown_connections 2024-09-10T11:12:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f4c440a2d80 0x7f4c440a5240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c5c10c0e0 0x7f4c5c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c5c1035b0 0x7f4c5c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 --2- 172.21.15.59:0/1863451327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5c102c90 0x7f4c5c1983a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 >> 172.21.15.59:0/1863451327 conn(0x7f4c5c0fc6a0 msgr2=0x7f4c5c0fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:36.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 shutdown_connections 2024-09-10T11:12:36.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.273+0000 7f4c622c9640 1 -- 172.21.15.59:0/1863451327 wait complete. 2024-09-10T11:12:36.284 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:36 smithi059 ceph-mon[30978]: pgmap v350: 97 pgs: 97 active+clean; 2.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:12:36.286 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T10:54:53.126290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T10:59:27.480743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T10:59:30.088912+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 96, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T11:12:36.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T11:12:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.391+0000 7f0e2e56d640 1 -- 172.21.15.59:0/138046514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 msgr2=0x7f0e2810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.391+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/138046514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 0x7f0e2810e550 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009ca0 tx=0x7f0e2002a950 comp rx=0 tx=0).stop 2024-09-10T11:12:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.391+0000 7f0e2e56d640 1 -- 172.21.15.59:0/138046514 shutdown_connections 2024-09-10T11:12:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.391+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/138046514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 0x7f0e2810e550 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.391+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/138046514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e28103600 0x7f0e2810bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.391+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/138046514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e28102ce0 0x7f0e281030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.391+0000 7f0e2e56d640 1 -- 172.21.15.59:0/138046514 >> 172.21.15.59:0/138046514 conn(0x7f0e280fc690 msgr2=0x7f0e280feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.391+0000 7f0e2e56d640 1 -- 172.21.15.59:0/138046514 shutdown_connections 2024-09-10T11:12:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.391+0000 7f0e2e56d640 1 -- 172.21.15.59:0/138046514 wait complete. 2024-09-10T11:12:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2e56d640 1 Processor -- start 2024-09-10T11:12:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2e56d640 1 -- start start 2024-09-10T11:12:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2e56d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e28102ce0 0x7f0e28100930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2e56d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e28103600 0x7f0e28100e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2e56d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 0x7f0e281013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2e56d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0e28111eb0 con 0x7f0e2810c0b0 2024-09-10T11:12:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2e56d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0e28111d30 con 0x7f0e28102ce0 2024-09-10T11:12:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2e56d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0e28112030 con 0x7f0e28103600 2024-09-10T11:12:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2cb0a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 0x7f0e281013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2cb0a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 0x7f0e281013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41140/0 (socket says 172.21.15.59:41140) 2024-09-10T11:12:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.392+0000 7f0e2cb0a640 1 -- 172.21.15.59:0/4007208741 learned_addr learned my addr 172.21.15.59:0/4007208741 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e27fff640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e28102ce0 0x7f0e28100930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e277fe640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e28103600 0x7f0e28100e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e2cb0a640 1 -- 172.21.15.59:0/4007208741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e28103600 msgr2=0x7f0e28100e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e2cb0a640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e28103600 0x7f0e28100e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e2cb0a640 1 -- 172.21.15.59:0/4007208741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e28102ce0 msgr2=0x7f0e28100930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e2cb0a640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e28102ce0 0x7f0e28100930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e2cb0a640 1 -- 172.21.15.59:0/4007208741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e281a68a0 con 0x7f0e2810c0b0 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e2cb0a640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 0x7f0e281013b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0e20004af0 tx=0x7f0e2002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e257fa640 1 -- 172.21.15.59:0/4007208741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20034040 con 0x7f0e2810c0b0 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e281a6b30 con 0x7f0e2810c0b0 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e257fa640 1 -- 172.21.15.59:0/4007208741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e20030920 con 0x7f0e2810c0b0 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e257fa640 1 -- 172.21.15.59:0/4007208741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20004820 con 0x7f0e2810c0b0 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.393+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e281a7020 con 0x7f0e2810c0b0 2024-09-10T11:12:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.394+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e281030c0 con 0x7f0e2810c0b0 2024-09-10T11:12:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.396+0000 7f0e257fa640 1 -- 172.21.15.59:0/4007208741 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0e20037020 con 0x7f0e2810c0b0 2024-09-10T11:12:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.396+0000 7f0e257fa640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0e100a2d00 0x7f0e100a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.396+0000 7f0e257fa640 1 -- 172.21.15.59:0/4007208741 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f0e200f0260 con 0x7f0e2810c0b0 2024-09-10T11:12:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.396+0000 7f0e27fff640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0e100a2d00 0x7f0e100a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.397+0000 7f0e27fff640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0e100a2d00 0x7f0e100a51c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800bbe0 tx=0x7f0e1800b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.399+0000 7f0e257fa640 1 -- 172.21.15.59:0/4007208741 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e200bcf40 con 0x7f0e2810c0b0 2024-09-10T11:12:36.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:36 smithi181 ceph-mon[35409]: pgmap v350: 97 pgs: 97 active+clean; 2.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:12:36.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:36 smithi115 ceph-mon[34719]: pgmap v350: 97 pgs: 97 active+clean; 2.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-10T11:12:36.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.574+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e28107160 con 0x7f0e2810c0b0 2024-09-10T11:12:36.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.575+0000 7f0e257fa640 1 -- 172.21.15.59:0/4007208741 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) ==== 93+0+10 (secure 0 0 0) 0x7f0e200bc840 con 0x7f0e2810c0b0 2024-09-10T11:12:36.577 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-09-10T11:12:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0e100a2d00 msgr2=0x7f0e100a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0e100a2d00 0x7f0e100a51c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800bbe0 tx=0x7f0e1800b390 comp rx=0 tx=0).stop 2024-09-10T11:12:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 msgr2=0x7f0e281013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 0x7f0e281013b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0e20004af0 tx=0x7f0e2002f5d0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 shutdown_connections 2024-09-10T11:12:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2810c0b0 0x7f0e281013b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0e100a2d00 0x7f0e100a51c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e28103600 0x7f0e28100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 --2- 172.21.15.59:0/4007208741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e28102ce0 0x7f0e28100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 >> 172.21.15.59:0/4007208741 conn(0x7f0e280fc690 msgr2=0x7f0e280fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 shutdown_connections 2024-09-10T11:12:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.577+0000 7f0e2e56d640 1 -- 172.21.15.59:0/4007208741 wait complete. 2024-09-10T11:12:36.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T11:12:36.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.694+0000 7f0ccef0a640 1 -- 172.21.15.59:0/1721454813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 msgr2=0x7f0cc810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.694+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/1721454813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 0x7f0cc810d880 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009cd0 tx=0x7f0cc002a8e0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.694+0000 7f0ccef0a640 1 -- 172.21.15.59:0/1721454813 shutdown_connections 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.694+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/1721454813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 0x7f0cc810d880 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.694+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/1721454813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc81009b0 0x7f0cc8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.694+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/1721454813 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0cc81069c0 0x7f0cc8106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.694+0000 7f0ccef0a640 1 -- 172.21.15.59:0/1721454813 >> 172.21.15.59:0/1721454813 conn(0x7f0cc80fc690 msgr2=0x7f0cc80feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 -- 172.21.15.59:0/1721454813 shutdown_connections 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 -- 172.21.15.59:0/1721454813 wait complete. 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 Processor -- start 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 -- start start 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc81009b0 0x7f0cc8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 0x7f0cc8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0cc81069c0 0x7f0cc819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc8110e00 con 0x7f0cc8101350 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc8110c80 con 0x7f0cc81009b0 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.695+0000 7f0ccef0a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc8110f80 con 0x7f0cc81069c0 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 0x7f0cc8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 0x7f0cc8198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47186/0 (socket says 172.21.15.59:47186) 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc7fff640 1 -- 172.21.15.59:0/2860058280 learned_addr learned my addr 172.21.15.59:0/2860058280 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0ccd4a7640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0cc81069c0 0x7f0cc819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cccca6640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc81009b0 0x7f0cc8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc7fff640 1 -- 172.21.15.59:0/2860058280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0cc81069c0 msgr2=0x7f0cc819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc7fff640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0cc81069c0 0x7f0cc819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc7fff640 1 -- 172.21.15.59:0/2860058280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc81009b0 msgr2=0x7f0cc8198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc7fff640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc81009b0 0x7f0cc8198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc7fff640 1 -- 172.21.15.59:0/2860058280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc819d3f0 con 0x7f0cc8101350 2024-09-10T11:12:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0ccd4a7640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0cc81069c0 0x7f0cc819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:12:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc7fff640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 0x7f0cc8198940 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400e9f0 tx=0x7f0cb400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc5ffb640 1 -- 172.21.15.59:0/2860058280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400cd80 con 0x7f0cc8101350 2024-09-10T11:12:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc5ffb640 1 -- 172.21.15.59:0/2860058280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cb4010910 con 0x7f0cc8101350 2024-09-10T11:12:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc819d6e0 con 0x7f0cc8101350 2024-09-10T11:12:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0cc5ffb640 1 -- 172.21.15.59:0/2860058280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4018990 con 0x7f0cc8101350 2024-09-10T11:12:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.696+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc81a4f70 con 0x7f0cc8101350 2024-09-10T11:12:36.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.697+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc8100e10 con 0x7f0cc8101350 2024-09-10T11:12:36.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.699+0000 7f0cc5ffb640 1 -- 172.21.15.59:0/2860058280 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0cb4010ac0 con 0x7f0cc8101350 2024-09-10T11:12:36.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.699+0000 7f0cc5ffb640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cb80a2d00 0x7f0cb80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:36.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.699+0000 7f0cc5ffb640 1 -- 172.21.15.59:0/2860058280 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f0cb40cf8f0 con 0x7f0cc8101350 2024-09-10T11:12:36.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.699+0000 7f0cccca6640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cb80a2d00 0x7f0cb80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:36.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.700+0000 7f0cccca6640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cb80a2d00 0x7f0cb80a51c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc005fd0 tx=0x7f0cbc00b510 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:36.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.703+0000 7f0cc5ffb640 1 -- 172.21.15.59:0/2860058280 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cb409c4c0 con 0x7f0cc8101350 2024-09-10T11:12:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.879+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0cc802d7c0 con 0x7f0cc8101350 2024-09-10T11:12:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.879+0000 7f0cc5ffb640 1 -- 172.21.15.59:0/2860058280 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) ==== 104+0+11 (secure 0 0 0) 0x7f0cb409bdc0 con 0x7f0cc8101350 2024-09-10T11:12:36.881 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-09-10T11:12:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cb80a2d00 msgr2=0x7f0cb80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cb80a2d00 0x7f0cb80a51c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc005fd0 tx=0x7f0cbc00b510 comp rx=0 tx=0).stop 2024-09-10T11:12:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 msgr2=0x7f0cc8198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 0x7f0cc8198940 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400e9f0 tx=0x7f0cb400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 shutdown_connections 2024-09-10T11:12:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f0cb80a2d00 0x7f0cb80a51c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0cc81069c0 0x7f0cc819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc8101350 0x7f0cc8198940 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 --2- 172.21.15.59:0/2860058280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cc81009b0 0x7f0cc8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.881+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 >> 172.21.15.59:0/2860058280 conn(0x7f0cc80fc690 msgr2=0x7f0cc806a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.882+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 shutdown_connections 2024-09-10T11:12:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.882+0000 7f0ccef0a640 1 -- 172.21.15.59:0/2860058280 wait complete. 2024-09-10T11:12:36.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.999+0000 7fccaae0e640 1 -- 172.21.15.59:0/886381445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca4103600 msgr2=0x7fcca410bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.999+0000 7fccaae0e640 1 --2- 172.21.15.59:0/886381445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca4103600 0x7fcca410bae0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009900 tx=0x7fcc9802a480 comp rx=0 tx=0).stop 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.999+0000 7fccaae0e640 1 -- 172.21.15.59:0/886381445 shutdown_connections 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.999+0000 7fccaae0e640 1 --2- 172.21.15.59:0/886381445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcca410c0b0 0x7fcca410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.999+0000 7fccaae0e640 1 --2- 172.21.15.59:0/886381445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca4103600 0x7fcca410bae0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:36.999+0000 7fccaae0e640 1 --2- 172.21.15.59:0/886381445 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcca4102ce0 0x7fcca41030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 -- 172.21.15.59:0/886381445 >> 172.21.15.59:0/886381445 conn(0x7fcca40fc690 msgr2=0x7fcca40feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 -- 172.21.15.59:0/886381445 shutdown_connections 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 -- 172.21.15.59:0/886381445 wait complete. 2024-09-10T11:12:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 Processor -- start 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 -- start start 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcca4102ce0 0x7fcca41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcca4103600 0x7fcca4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca410c0b0 0x7fcca419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4111eb0 con 0x7fcca410c0b0 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4111d30 con 0x7fcca4102ce0 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fccaae0e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4112030 con 0x7fcca4103600 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fcca93ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca410c0b0 0x7fcca419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fcca93ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca410c0b0 0x7fcca419cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47212/0 (socket says 172.21.15.59:47212) 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.000+0000 7fcca93ab640 1 -- 172.21.15.59:0/3327425399 learned_addr learned my addr 172.21.15.59:0/3327425399 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca3fff640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcca4103600 0x7fcca4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca8baa640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcca4102ce0 0x7fcca41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca93ab640 1 -- 172.21.15.59:0/3327425399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcca4103600 msgr2=0x7fcca4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca93ab640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcca4103600 0x7fcca4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca93ab640 1 -- 172.21.15.59:0/3327425399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcca4102ce0 msgr2=0x7fcca41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca93ab640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcca4102ce0 0x7fcca41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca93ab640 1 -- 172.21.15.59:0/3327425399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca419d4c0 con 0x7fcca410c0b0 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca3fff640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcca4103600 0x7fcca4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca8baa640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcca4102ce0 0x7fcca41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca93ab640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca410c0b0 0x7fcca419cd90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00cad0 tx=0x7fcc9c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca1ffb640 1 -- 172.21.15.59:0/3327425399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00ae20 con 0x7fcca410c0b0 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca419d7b0 con 0x7fcca410c0b0 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca1ffb640 1 -- 172.21.15.59:0/3327425399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc9c005020 con 0x7fcca410c0b0 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fcca1ffb640 1 -- 172.21.15.59:0/3327425399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00f6f0 con 0x7fcca410c0b0 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.001+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca41a5040 con 0x7fcca410c0b0 2024-09-10T11:12:37.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.002+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca41030c0 con 0x7fcca410c0b0 2024-09-10T11:12:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.003+0000 7fcca1ffb640 1 -- 172.21.15.59:0/3327425399 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fcc9c0051d0 con 0x7fcca410c0b0 2024-09-10T11:12:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.004+0000 7fcca1ffb640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcc8c0a2d00 0x7fcc8c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.004+0000 7fcca1ffb640 1 -- 172.21.15.59:0/3327425399 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7fcc9c0cf540 con 0x7fcca410c0b0 2024-09-10T11:12:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.004+0000 7fcca8baa640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcc8c0a2d00 0x7fcc8c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.005+0000 7fcca8baa640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcc8c0a2d00 0x7fcc8c0a51c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009b40 tx=0x7fcc94005e50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:37.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.008+0000 7fcca1ffb640 1 -- 172.21.15.59:0/3327425399 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc9c014030 con 0x7fcca410c0b0 2024-09-10T11:12:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.184+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcca4107130 con 0x7fcca410c0b0 2024-09-10T11:12:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.185+0000 7fcca1ffb640 1 -- 172.21.15.59:0/3327425399 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) ==== 100+0+11 (secure 0 0 0) 0x7fcc9c09c110 con 0x7fcca410c0b0 2024-09-10T11:12:37.187 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcc8c0a2d00 msgr2=0x7fcc8c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcc8c0a2d00 0x7fcc8c0a51c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009b40 tx=0x7fcc94005e50 comp rx=0 tx=0).stop 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca410c0b0 msgr2=0x7fcca419cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca410c0b0 0x7fcca419cd90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00cad0 tx=0x7fcc9c00cf90 comp rx=0 tx=0).stop 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 shutdown_connections 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcca410c0b0 0x7fcca419cd90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fcc8c0a2d00 0x7fcc8c0a51c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcca4103600 0x7fcca4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 --2- 172.21.15.59:0/3327425399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcca4102ce0 0x7fcca41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 >> 172.21.15.59:0/3327425399 conn(0x7fcca40fc690 msgr2=0x7fcca40fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 shutdown_connections 2024-09-10T11:12:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.187+0000 7fccaae0e640 1 -- 172.21.15.59:0/3327425399 wait complete. 2024-09-10T11:12:37.200 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:37 smithi059 ceph-mon[30978]: from='client.16155 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:12:37.200 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:37 smithi059 ceph-mon[30978]: from='client.16161 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:12:37.201 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:37 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1863451327' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:12:37.201 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:37 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/4007208741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:12:37.201 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:37 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2860058280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T11:12:37.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T11:12:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.303+0000 7fccc9b52640 1 -- 172.21.15.59:0/2765454562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4101ab0 msgr2=0x7fccc4101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.303+0000 7fccc9b52640 1 --2- 172.21.15.59:0/2765454562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4101ab0 0x7fccc4101f10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009930 tx=0x7fccb802a420 comp rx=0 tx=0).stop 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.304+0000 7fccc9b52640 1 -- 172.21.15.59:0/2765454562 shutdown_connections 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.304+0000 7fccc9b52640 1 --2- 172.21.15.59:0/2765454562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc4102450 0x7fccc410e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.304+0000 7fccc9b52640 1 --2- 172.21.15.59:0/2765454562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4101ab0 0x7fccc4101f10 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.304+0000 7fccc9b52640 1 --2- 172.21.15.59:0/2765454562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc4107ac0 0x7fccc4107ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.304+0000 7fccc9b52640 1 -- 172.21.15.59:0/2765454562 >> 172.21.15.59:0/2765454562 conn(0x7fccc40fd7d0 msgr2=0x7fccc40ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.304+0000 7fccc9b52640 1 -- 172.21.15.59:0/2765454562 shutdown_connections 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.304+0000 7fccc9b52640 1 -- 172.21.15.59:0/2765454562 wait complete. 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.304+0000 7fccc9b52640 1 Processor -- start 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.304+0000 7fccc9b52640 1 -- start start 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc9b52640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc4101ab0 0x7fccc4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc9b52640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4102450 0x7fccc4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:37.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc9b52640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc4107ac0 0x7fccc419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc9b52640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fccc4111f00 con 0x7fccc4102450 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc9b52640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fccc4111d80 con 0x7fccc4101ab0 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc9b52640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fccc4112080 con 0x7fccc4107ac0 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4102450 0x7fccc4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4102450 0x7fccc4198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47228/0 (socket says 172.21.15.59:47228) 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc2ffd640 1 -- 172.21.15.59:0/576536293 learned_addr learned my addr 172.21.15.59:0/576536293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc37fe640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc4101ab0 0x7fccc4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc3fff640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc4107ac0 0x7fccc419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc2ffd640 1 -- 172.21.15.59:0/576536293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc4107ac0 msgr2=0x7fccc419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc2ffd640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc4107ac0 0x7fccc419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc2ffd640 1 -- 172.21.15.59:0/576536293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc4101ab0 msgr2=0x7fccc4198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc2ffd640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc4101ab0 0x7fccc4198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc2ffd640 1 -- 172.21.15.59:0/576536293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc419d400 con 0x7fccc4102450 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc37fe640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc4101ab0 0x7fccc4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:12:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.305+0000 7fccc2ffd640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4102450 0x7fccc4198950 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009a50 tx=0x7fccb8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.306+0000 7fccc0ff9640 1 -- 172.21.15.59:0/576536293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb803f030 con 0x7fccc4102450 2024-09-10T11:12:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.306+0000 7fccc0ff9640 1 -- 172.21.15.59:0/576536293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccb8003ce0 con 0x7fccc4102450 2024-09-10T11:12:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.306+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc419d690 con 0x7fccc4102450 2024-09-10T11:12:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.306+0000 7fccc0ff9640 1 -- 172.21.15.59:0/576536293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8035070 con 0x7fccc4102450 2024-09-10T11:12:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.306+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc41a4f80 con 0x7fccc4102450 2024-09-10T11:12:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.307+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc41031f0 con 0x7fccc4102450 2024-09-10T11:12:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.308+0000 7fccc0ff9640 1 -- 172.21.15.59:0/576536293 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fccb8042030 con 0x7fccc4102450 2024-09-10T11:12:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.308+0000 7fccc0ff9640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fccac0a2d00 0x7fccac0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.309+0000 7fccc0ff9640 1 -- 172.21.15.59:0/576536293 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7fccb80efb00 con 0x7fccc4102450 2024-09-10T11:12:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.309+0000 7fccc37fe640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fccac0a2d00 0x7fccac0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.309+0000 7fccc37fe640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fccac0a2d00 0x7fccac0a51c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fccb40058c0 tx=0x7fccb4005cb0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:37.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.313+0000 7fccc0ff9640 1 -- 172.21.15.59:0/576536293 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fccb80bc6b0 con 0x7fccc4102450 2024-09-10T11:12:37.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:37 smithi181 ceph-mon[35409]: from='client.16155 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:12:37.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:37 smithi181 ceph-mon[35409]: from='client.16161 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:12:37.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:37 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1863451327' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:12:37.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:37 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/4007208741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:12:37.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:37 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2860058280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T11:12:37.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:37 smithi115 ceph-mon[34719]: from='client.16155 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:12:37.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:37 smithi115 ceph-mon[34719]: from='client.16161 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:12:37.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:37 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1863451327' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:12:37.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:37 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/4007208741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:12:37.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:37 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2860058280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T11:12:37.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.536+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fccc410a050 con 0x7fccc4102450 2024-09-10T11:12:37.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.544+0000 7fccc0ff9640 1 -- 172.21.15.59:0/576536293 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740902 (secure 0 0 0) 0x7fccb80bbfb0 con 0x7fccc4102450 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 25, 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "active_gid": 15132, 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "active_name": "x", 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "active_addrs": { 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-10T11:12:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3897711076 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3897711076 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "active_addr": "172.21.15.59:6801/3897711076", 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "active_change": "2024-09-10T11:01:22.218150+0000", 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "active_mgr_features": 4540701547738038271, 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "standbys": [ 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 24806, 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "y", 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_features": 4540701547738038271, 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "available_modules": [ 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "alerts", 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_destination": { 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_destination", 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email address to send alerts to", 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_from_name": { 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_from_name", 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "Ceph", 2024-09-10T11:12:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email From: name", 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_host": { 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_host", 2024-09-10T11:12:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP server", 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_password": { 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_password", 2024-09-10T11:12:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Password to authenticate with", 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_port": { 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_port", 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "465", 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP port", 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_sender": { 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_sender", 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP envelope sender", 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_ssl": { 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_ssl", 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_user": { 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_user", 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "User to authenticate as", 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "balancer", 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "active": { 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "active", 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_time": { 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_time", 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0000", 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_weekday": { 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_weekday", 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_max_iterations": { 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_max_iterations", 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "25", 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "250", 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T11:12:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_metrics": { 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_metrics", 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_step": { 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_step", 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.5", 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0.001", 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "0.999", 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "aggressiveness of optimization", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "end_time": { 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_time", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2359", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:12:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "end_weekday": { 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_weekday", 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "min_score": { 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_score", 2024-09-10T11:12:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "upmap", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-compat", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "none", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "read", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap-read" 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Balancer mode", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_ids": { 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_ids", 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_deviation": { 2024-09-10T11:12:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_deviation", 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_optimizations": { 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_optimizations", 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm", 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_down_multiplier": { 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_down_multiplier", 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_refresh_rate": { 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_refresh_rate", 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "20", 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_starting_port": { 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_starting_port", 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4721", 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T11:12:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_ptrace": { 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_ptrace", 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T11:12:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_interval": { 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_interval", 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_memory_target_ratio": { 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.7", 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_log_destination": { 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm_log_destination", 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "file", 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "file,syslog", 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "syslog" 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "cgroups_split": { 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cgroups_split", 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T11:12:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "config_checks_enabled": { 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_checks_enabled", 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "config_dashboard": { 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_dashboard", 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_alertmanager": { 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_alertmanager", 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_base": { 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_base", 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Container image name, without the tag", 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_elasticsearch": { 2024-09-10T11:12:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_elasticsearch", 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "elasticsearch container image", 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_grafana": { 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_grafana", 2024-09-10T11:12:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_haproxy": { 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_haproxy", 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "HAproxy container image", 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_agent": { 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_agent", 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger agent container image", 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_collector": { 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_collector", 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger collector container image", 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_query": { 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_query", 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger query container image", 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_keepalived": { 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_keepalived", 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Keepalived container image", 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_loki": { 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_loki", 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Loki container image", 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_node_exporter": { 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_node_exporter", 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nvmeof": { 2024-09-10T11:12:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nvmeof", 2024-09-10T11:12:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T11:12:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nvme-of container image", 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_prometheus": { 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_prometheus", 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_promtail": { 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_promtail", 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Promtail container image", 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_samba": { 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_samba", 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Samba/SMB container image", 2024-09-10T11:12:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_snmp_gateway": { 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_snmp_gateway", 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SNMP Gateway container image", 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "container_init": { 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_init", 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "daemon_cache_timeout": { 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "daemon_cache_timeout", 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "default_cephadm_command_timeout": { 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "900", 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "default_registry": { 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_registry", 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io", 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "device_cache_timeout": { 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_cache_timeout", 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1800", 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache device inventory", 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "device_enhanced_scan": { 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_enhanced_scan", 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.622 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "facts_cache_timeout": { 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "facts_cache_timeout", 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache host facts data", 2024-09-10T11:12:37.623 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "grafana_dashboards_path": { 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "grafana_dashboards_path", 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.624 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "host_check_interval": { 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "host_check_interval", 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.625 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to perform a host check", 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "hw_monitoring": { 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hw_monitoring", 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.626 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "inventory_list_all": { 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "inventory_list_all", 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.628 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "log_refresh_metadata": { 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_refresh_metadata", 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.629 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.630 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.631 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.633 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T11:12:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "*", 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "max_count_per_host": { 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_count_per_host", 2024-09-10T11:12:37.635 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of daemons per service per host", 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd_draining_count": { 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_osd_draining_count", 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.636 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "migration_current": { 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "migration_current", 2024-09-10T11:12:37.637 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "internal - do not modify", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "root", 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm-package", 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "root" 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "oob_default_addr": { 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "oob_default_addr", 2024-09-10T11:12:37.639 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "169.254.1.1", 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "prometheus_alerts_path": { 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus_alerts_path", 2024-09-10T11:12:37.640 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.641 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_insecure": { 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_insecure", 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.642 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_password": { 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_password", 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_url": { 2024-09-10T11:12:37.643 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_url", 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_username": { 2024-09-10T11:12:37.644 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_username", 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "secure_monitoring_stack": { 2024-09-10T11:12:37.645 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secure_monitoring_stack", 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "service_discovery_port": { 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "service_discovery_port", 2024-09-10T11:12:37.646 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8765", 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "cephadm service discovery port", 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "ssh_config_file": { 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssh_config_file", 2024-09-10T11:12:37.647 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "use_agent": { 2024-09-10T11:12:37.648 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_agent", 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "use_repo_digest": { 2024-09-10T11:12:37.649 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_repo_digest", 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.650 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_failed_host_check": { 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_failed_host_check", 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_daemons": { 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_daemons", 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_hosts": { 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_hosts", 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crash", 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.654 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.655 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.656 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.657 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.658 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "retain_interval": { 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retain_interval", 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "31536000", 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.659 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_recent_interval": { 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_recent_interval", 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1209600", 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.660 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dashboard", 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T11:12:37.661 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.662 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.663 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_ENABLED": { 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.664 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.665 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.666 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.667 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.668 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.669 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.671 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T11:12:37.672 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T11:12:37.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T11:12:37.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T11:12:37.675 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T11:12:37.676 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_URL": { 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_URL", 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.677 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T11:12:37.678 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.679 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.680 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.681 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.682 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.683 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.684 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.686 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.687 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.688 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.689 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.690 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.691 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.692 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.694 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8", 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.695 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "45", 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.696 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.697 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.699 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T11:12:37.700 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.701 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.702 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "cross_origin_url": { 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cross_origin_url", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.703 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "crt_file": { 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crt_file", 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.704 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "debug": { 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "debug", 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.705 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable/disable debug options", 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "jwt_token_ttl": { 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "jwt_token_ttl", 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.706 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "28800", 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.707 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.708 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.710 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.711 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.712 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "motd": { 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "motd", 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.713 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "The message of the day", 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect_resolve_ip_addr": { 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.714 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.715 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8080", 2024-09-10T11:12:37.716 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl_server_port": { 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl_server_port", 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8443", 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.718 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "redirect", 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.719 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect" 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T11:12:37.720 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "url_prefix": { 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url_prefix", 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.721 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.722 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_monitoring": { 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_monitoring", 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "monitor device health metrics", 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.723 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.724 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.725 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.726 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.727 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "mark_out_threshold": { 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mark_out_threshold", 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.728 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2419200", 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": { 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_name", 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "device_health_metrics", 2024-09-10T11:12:37.729 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "retention_period": { 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retention_period", 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15552000", 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.730 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain device health metrics", 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_frequency": { 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_frequency", 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T11:12:37.731 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "self_heal": { 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "self_heal", 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.732 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.733 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_threshold": { 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_threshold", 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7257600", 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "diskprediction_local", 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.737 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.738 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.739 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "predict_interval": { 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predict_interval", 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.741 INFO:teuthology.orchestra.run.smithi059.stdout: "predictor_model": { 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predictor_model", 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "prophetstor", 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "influx", 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": false, 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "influxdb python module not found", 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "batch_size": { 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "batch_size", 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5000", 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.744 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "database": { 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "database", 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "ceph", 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.745 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": { 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hostname", 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server hostname", 2024-09-10T11:12:37.746 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "30", 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "5", 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T11:12:37.747 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.748 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.749 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.750 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.751 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.752 INFO:teuthology.orchestra.run.smithi059.stdout: "password": { 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "password", 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "password of InfluxDB server user", 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "port": { 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "port", 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8086", 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server port", 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.754 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "false", 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.755 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "threads": { 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threads", 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "32", 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.756 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "username": { 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "username", 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "username of InfluxDB server user", 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "verify_ssl": { 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "verify_ssl", 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "true", 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.758 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "insights", 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.761 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.762 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.763 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "iostat", 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.764 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.765 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.766 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.767 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.769 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "k8sevents", 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_event_retention_days": { 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ceph_event_retention_days", 2024-09-10T11:12:37.770 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7", 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "config_check_secs": { 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_check_secs", 2024-09-10T11:12:37.771 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "10", 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.772 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.773 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.774 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.775 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.776 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.777 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "localpool", 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "failure_domain": { 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "failure_domain", 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "host", 2024-09-10T11:12:37.778 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "failure domain for any created local pool", 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.781 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.782 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.783 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": { 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_size", 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.784 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default min_size for any created local pool", 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "num_rep": { 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "num_rep", 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.785 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3", 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default replica count for any created local pool", 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": { 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_num", 2024-09-10T11:12:37.786 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "128", 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "prefix": { 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prefix", 2024-09-10T11:12:37.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name prefix for any created local pool", 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.788 INFO:teuthology.orchestra.run.smithi059.stdout: "subtree": { 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subtree", 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "rack", 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.789 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mds_autoscaler", 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.790 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.793 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.794 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirroring", 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.795 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.796 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.797 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.798 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.800 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "nfs", 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.801 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.802 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.803 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.804 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.805 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "fail_fs": { 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "fail_fs", 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.807 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.808 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.809 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.810 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.811 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator": { 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T11:12:37.813 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "rook", 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "test_orchestrator" 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Orchestrator backend", 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.814 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_perf_query", 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.816 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.817 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.818 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.819 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_support", 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.822 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.823 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_autoscaler", 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.826 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.827 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.828 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.829 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:37.831 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "threshold": { 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threshold", 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T11:12:37.832 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1.0", 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "scaling threshold", 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "progress", 2024-09-10T11:12:37.833 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_pg_recovery_event": { 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_pg_recovery_event", 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.834 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.836 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.837 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.838 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.839 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "max_completed_events": { 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_completed_events", 2024-09-10T11:12:37.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "50", 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "number of past completed events to remember", 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:37.841 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long the module is going to sleep", 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus", 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "cache": { 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cache", 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.843 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "exclude_perf_counters": { 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "exclude_perf_counters", 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.844 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.845 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.846 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.847 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.848 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.849 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools": { 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools", 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.850 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300", 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_interval": { 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_interval", 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:37.852 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15.0", 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T11:12:37.853 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T11:12:37.854 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "9283", 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "stale_cache_strategy": { 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stale_cache_strategy", 2024-09-10T11:12:37.855 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "log", 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T11:12:37.856 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "default", 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "default", 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "error" 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.857 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.858 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.859 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.862 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.863 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_snap_create": { 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_snap_create", 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.864 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "mirror_snapshot_schedule": { 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.865 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "trash_purge_schedule": { 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "trash_purge_schedule", 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.866 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "restful", 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.867 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_auth": { 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_auth", 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T11:12:37.868 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.869 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.870 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.871 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.872 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.873 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T11:12:37.874 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.876 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rgw", 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.877 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.878 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.879 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.880 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.881 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.882 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rook", 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.883 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.886 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.887 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "storage_class": { 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "storage_class", 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.888 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "local", 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.889 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "selftest", 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.890 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.891 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.893 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.894 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "roption1": { 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption1", 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.895 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "roption2": { 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption2", 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "xyz", 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption1": { 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption1", 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.897 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption2": { 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption2", 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.898 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption3": { 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption3", 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.899 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption4": { 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption4", 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.900 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption5": { 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption5", 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.901 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption6": { 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption6", 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.902 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption7": { 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption7", 2024-09-10T11:12:37.903 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "42", 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "testkey": { 2024-09-10T11:12:37.904 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testkey", 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "testlkey": { 2024-09-10T11:12:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testlkey", 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "testnewline": { 2024-09-10T11:12:37.906 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testnewline", 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.907 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_m_granularity": { 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_m_granularity", 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.908 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "dump_on_update": { 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dump_on_update", 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.909 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "dump database to debug log on update", 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.910 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.911 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.912 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.913 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.914 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stats", 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.915 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.916 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.917 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.918 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.919 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.920 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "status", 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.921 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.923 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.924 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.925 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telegraf", 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.926 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "address": { 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "address", 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.927 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15", 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.928 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.929 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.930 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.931 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.932 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telemetry", 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_basic": { 2024-09-10T11:12:37.934 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_basic", 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_crash": { 2024-09-10T11:12:37.935 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_crash", 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.936 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_device": { 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_device", 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.937 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_ident": { 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_ident", 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.938 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_perf": { 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_perf", 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.939 INFO:teuthology.orchestra.run.smithi059.stdout: "contact": { 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "contact", 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "description": { 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "description", 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "device_url": { 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_url", 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.942 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.943 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "24", 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "8", 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.944 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "last_opt_revision": { 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "last_opt_revision", 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1", 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.945 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard": { 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard", 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.946 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard_description": { 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard_description", 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.947 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.948 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.949 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.950 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.952 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "organization": { 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "organization", 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "proxy": { 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "proxy", 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.954 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "url": { 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url", 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.955 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "test_orchestrator", 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.956 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.957 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.958 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.959 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.960 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.961 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.962 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.963 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.964 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.965 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_clones": { 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_clones", 2024-09-10T11:12:37.966 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4", 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "periodic_async_work": { 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "periodic_async_work", 2024-09-10T11:12:37.967 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Periodically check for async work", 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_delay": { 2024-09-10T11:12:37.968 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_delay", 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.969 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_no_wait": { 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix", 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "discovery_interval": { 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "discovery_interval", 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "100", 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.971 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "identifier": { 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "identifier", 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.972 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:37.973 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.974 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.975 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.976 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.977 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.978 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_host": { 2024-09-10T11:12:37.979 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_host", 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_port": { 2024-09-10T11:12:37.980 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_port", 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10051", 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_sender": { 2024-09-10T11:12:37.981 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_sender", 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.982 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 24811, 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "z", 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_features": 4540701547738038271, 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "available_modules": [ 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "alerts", 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.983 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:37.984 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.985 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.986 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:37.988 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.989 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_destination": { 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_destination", 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email address to send alerts to", 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_from_name": { 2024-09-10T11:12:37.990 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_from_name", 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "Ceph", 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email From: name", 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_host": { 2024-09-10T11:12:37.991 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_host", 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP server", 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.992 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_password": { 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_password", 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Password to authenticate with", 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_port": { 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_port", 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "465", 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP port", 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_sender": { 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_sender", 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP envelope sender", 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_ssl": { 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_ssl", 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.996 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_user": { 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_user", 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "User to authenticate as", 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.997 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "balancer", 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "active": { 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "active", 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.998 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_time": { 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_time", 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:37.999 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0000", 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_weekday": { 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_weekday", 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.000 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_max_iterations": { 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_max_iterations", 2024-09-10T11:12:38.001 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "25", 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "250", 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_metrics": { 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_metrics", 2024-09-10T11:12:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_step": { 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_step", 2024-09-10T11:12:38.003 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.5", 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0.001", 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "0.999", 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "aggressiveness of optimization", 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.004 INFO:teuthology.orchestra.run.smithi059.stdout: "end_time": { 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_time", 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2359", 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.005 INFO:teuthology.orchestra.run.smithi059.stdout: "end_weekday": { 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_weekday", 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.006 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.007 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.009 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.010 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.011 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "min_score": { 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_score", 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.012 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T11:12:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T11:12:38.013 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T11:12:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "upmap", 2024-09-10T11:12:38.016 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-compat", 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "none", 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "read", 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap", 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap-read" 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Balancer mode", 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_ids": { 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_ids", 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.018 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.019 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_deviation": { 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_deviation", 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.020 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_optimizations": { 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_optimizations", 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm", 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_down_multiplier": { 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_down_multiplier", 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.022 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_refresh_rate": { 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_refresh_rate", 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "20", 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.023 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_starting_port": { 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_starting_port", 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4721", 2024-09-10T11:12:38.024 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_ptrace": { 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_ptrace", 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.025 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_interval": { 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_interval", 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.026 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_memory_target_ratio": { 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.027 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.7", 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_log_destination": { 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm_log_destination", 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.028 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "file", 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "file,syslog", 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "syslog" 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "cgroups_split": { 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cgroups_split", 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "config_checks_enabled": { 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_checks_enabled", 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "config_dashboard": { 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_dashboard", 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_alertmanager": { 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_alertmanager", 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_base": { 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_base", 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Container image name, without the tag", 2024-09-10T11:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_elasticsearch": { 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_elasticsearch", 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "elasticsearch container image", 2024-09-10T11:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_grafana": { 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_grafana", 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_haproxy": { 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_haproxy", 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "HAproxy container image", 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_agent": { 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_agent", 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger agent container image", 2024-09-10T11:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_collector": { 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_collector", 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger collector container image", 2024-09-10T11:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_query": { 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_query", 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger query container image", 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_keepalived": { 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_keepalived", 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Keepalived container image", 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_loki": { 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_loki", 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Loki container image", 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_node_exporter": { 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_node_exporter", 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nvmeof": { 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nvmeof", 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nvme-of container image", 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_prometheus": { 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_prometheus", 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_promtail": { 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_promtail", 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Promtail container image", 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_samba": { 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_samba", 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Samba/SMB container image", 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_snmp_gateway": { 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_snmp_gateway", 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SNMP Gateway container image", 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "container_init": { 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_init", 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "daemon_cache_timeout": { 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "daemon_cache_timeout", 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "default_cephadm_command_timeout": { 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "900", 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "default_registry": { 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_registry", 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io", 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "device_cache_timeout": { 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_cache_timeout", 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1800", 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache device inventory", 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "device_enhanced_scan": { 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_enhanced_scan", 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "facts_cache_timeout": { 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "facts_cache_timeout", 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache host facts data", 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "grafana_dashboards_path": { 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "grafana_dashboards_path", 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "host_check_interval": { 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "host_check_interval", 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to perform a host check", 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "hw_monitoring": { 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hw_monitoring", 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "inventory_list_all": { 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "inventory_list_all", 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "log_refresh_metadata": { 2024-09-10T11:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_refresh_metadata", 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "*", 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "max_count_per_host": { 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_count_per_host", 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of daemons per service per host", 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd_draining_count": { 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_osd_draining_count", 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "migration_current": { 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "migration_current", 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "internal - do not modify", 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "root", 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm-package", 2024-09-10T11:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "root" 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "oob_default_addr": { 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "oob_default_addr", 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "169.254.1.1", 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "prometheus_alerts_path": { 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus_alerts_path", 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T11:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_insecure": { 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_insecure", 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T11:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_password": { 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_password", 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_url": { 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_url", 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_username": { 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_username", 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "secure_monitoring_stack": { 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secure_monitoring_stack", 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "service_discovery_port": { 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "service_discovery_port", 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8765", 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "cephadm service discovery port", 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "ssh_config_file": { 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssh_config_file", 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "use_agent": { 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_agent", 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "use_repo_digest": { 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_repo_digest", 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_failed_host_check": { 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_failed_host_check", 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T11:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_daemons": { 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_daemons", 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_hosts": { 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_hosts", 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crash", 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "retain_interval": { 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retain_interval", 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "31536000", 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T11:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_recent_interval": { 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_recent_interval", 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1209600", 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T11:12:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dashboard", 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_ENABLED": { 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T11:12:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T11:12:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_URL": { 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_URL", 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T11:12:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8", 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "45", 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "cross_origin_url": { 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cross_origin_url", 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "crt_file": { 2024-09-10T11:12:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crt_file", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "debug": { 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "debug", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable/disable debug options", 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "jwt_token_ttl": { 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "jwt_token_ttl", 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "28800", 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "motd": { 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "motd", 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "The message of the day", 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect_resolve_ip_addr": { 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.148 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8080", 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.149 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.150 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl_server_port": { 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl_server_port", 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8443", 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.151 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "redirect", 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.152 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect" 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.153 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "url_prefix": { 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url_prefix", 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.154 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_monitoring": { 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_monitoring", 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.156 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "monitor device health metrics", 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.157 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.158 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.160 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.161 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mark_out_threshold": { 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mark_out_threshold", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2419200", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.162 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": { 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_name", 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "device_health_metrics", 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.163 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "retention_period": { 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retention_period", 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15552000", 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain device health metrics", 2024-09-10T11:12:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_frequency": { 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_frequency", 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.165 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "self_heal": { 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "self_heal", 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.166 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T11:12:38.167 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_threshold": { 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_threshold", 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7257600", 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.168 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "diskprediction_local", 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.169 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.170 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.171 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.172 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.173 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.174 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "predict_interval": { 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predict_interval", 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.175 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "predictor_model": { 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predictor_model", 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "prophetstor", 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.176 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.177 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "influx", 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": false, 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "influxdb python module not found", 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "batch_size": { 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "batch_size", 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.178 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5000", 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "database": { 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "database", 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.179 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "ceph", 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": { 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hostname", 2024-09-10T11:12:38.180 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server hostname", 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:38.181 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "30", 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "5", 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.182 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.183 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.185 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.186 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "password": { 2024-09-10T11:12:38.187 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "password", 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "password of InfluxDB server user", 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: "port": { 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "port", 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8086", 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server port", 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "false", 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.190 INFO:teuthology.orchestra.run.smithi059.stdout: "threads": { 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threads", 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "32", 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.191 INFO:teuthology.orchestra.run.smithi059.stdout: "username": { 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "username", 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "username of InfluxDB server user", 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "verify_ssl": { 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "verify_ssl", 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "true", 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.193 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "insights", 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.194 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.195 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.196 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.197 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.198 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.199 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "iostat", 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.200 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.201 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.203 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "k8sevents", 2024-09-10T11:12:38.205 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_event_retention_days": { 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ceph_event_retention_days", 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7", 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.206 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "config_check_secs": { 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_check_secs", 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "10", 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T11:12:38.207 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.208 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.209 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.212 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "localpool", 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.213 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "failure_domain": { 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "failure_domain", 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "host", 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "failure domain for any created local pool", 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.216 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.217 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.218 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": { 2024-09-10T11:12:38.219 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_size", 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default min_size for any created local pool", 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "num_rep": { 2024-09-10T11:12:38.220 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "num_rep", 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3", 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default replica count for any created local pool", 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": { 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_num", 2024-09-10T11:12:38.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "128", 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.222 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "prefix": { 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prefix", 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name prefix for any created local pool", 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.223 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "subtree": { 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subtree", 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "rack", 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T11:12:38.224 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mds_autoscaler", 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.225 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.226 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.227 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.230 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirroring", 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.231 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.232 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.235 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.236 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "nfs", 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.237 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.238 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.239 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.240 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.241 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "fail_fs": { 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "fail_fs", 2024-09-10T11:12:38.242 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.243 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.244 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.245 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.246 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator": { 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rook", 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "test_orchestrator" 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Orchestrator backend", 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.249 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_perf_query", 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.250 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.252 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.253 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.254 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_support", 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.256 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.257 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.260 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_autoscaler", 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.261 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.262 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.263 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.264 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.265 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.266 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "threshold": { 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threshold", 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1.0", 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.267 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "scaling threshold", 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "progress", 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_pg_recovery_event": { 2024-09-10T11:12:38.268 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_pg_recovery_event", 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T11:12:38.269 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.270 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.271 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.272 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.273 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.274 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "max_completed_events": { 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_completed_events", 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.275 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "50", 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "number of past completed events to remember", 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.276 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long the module is going to sleep", 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.277 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus", 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "cache": { 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cache", 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.278 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "exclude_perf_counters": { 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "exclude_perf_counters", 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.279 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.280 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.281 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.282 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.283 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.284 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools": { 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools", 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.285 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300", 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.286 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_interval": { 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_interval", 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15.0", 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.287 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.288 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "9283", 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.289 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "stale_cache_strategy": { 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stale_cache_strategy", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "log", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.290 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "default", 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "default", 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: "error" 2024-09-10T11:12:38.291 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T11:12:38.292 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.293 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.294 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.295 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.296 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_snap_create": { 2024-09-10T11:12:38.298 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_snap_create", 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.299 INFO:teuthology.orchestra.run.smithi059.stdout: "mirror_snapshot_schedule": { 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "trash_purge_schedule": { 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "trash_purge_schedule", 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.301 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "restful", 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_auth": { 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_auth", 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.302 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.305 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.306 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.308 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.309 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.310 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.311 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rgw", 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.312 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.314 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.315 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.316 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rook", 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.317 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.318 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.319 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.320 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.321 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "storage_class": { 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "storage_class", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.322 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "local", 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "selftest", 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.324 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.325 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.327 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: "roption1": { 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption1", 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "roption2": { 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption2", 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "xyz", 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption1": { 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption1", 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.331 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption2": { 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption2", 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.332 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption3": { 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption3", 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.333 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption4": { 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption4", 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption5": { 2024-09-10T11:12:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption5", 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption6": { 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption6", 2024-09-10T11:12:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption7": { 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption7", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "42", 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "testkey": { 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testkey", 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.337 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "testlkey": { 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testlkey", 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.338 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "testnewline": { 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testnewline", 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.339 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.340 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_m_granularity": { 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_m_granularity", 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "dump_on_update": { 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dump_on_update", 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "dump database to debug log on update", 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.343 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.344 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.345 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.346 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.347 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stats", 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.348 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.349 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.350 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.351 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.352 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "status", 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.353 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.354 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.355 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.356 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.357 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telegraf", 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "address": { 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "address", 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.359 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15", 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.360 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.362 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.363 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.364 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.365 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telemetry", 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_basic": { 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_basic", 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.366 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_crash": { 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_crash", 2024-09-10T11:12:38.367 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_device": { 2024-09-10T11:12:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_device", 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_ident": { 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_ident", 2024-09-10T11:12:38.369 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_perf": { 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_perf", 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.370 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "contact": { 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "contact", 2024-09-10T11:12:38.371 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.372 INFO:teuthology.orchestra.run.smithi059.stdout: "description": { 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "description", 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.373 INFO:teuthology.orchestra.run.smithi059.stdout: "device_url": { 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_url", 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.374 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.375 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "24", 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "8", 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.376 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "last_opt_revision": { 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "last_opt_revision", 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1", 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.377 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard": { 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard", 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.378 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard_description": { 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard_description", 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.379 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.381 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.382 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.383 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.384 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "organization": { 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "organization", 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.385 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "proxy": { 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "proxy", 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.386 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "url": { 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url", 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.387 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.388 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "test_orchestrator", 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.389 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.390 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.391 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.392 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.393 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.394 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.396 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.397 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.398 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.399 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_clones": { 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_clones", 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4", 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.400 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "periodic_async_work": { 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "periodic_async_work", 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.401 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Periodically check for async work", 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_delay": { 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_delay", 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.402 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_no_wait": { 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.403 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix", 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.404 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "discovery_interval": { 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "discovery_interval", 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "100", 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.405 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "identifier": { 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "identifier", 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.406 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.407 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.408 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.409 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.410 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.411 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.412 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_host": { 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_host", 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.413 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_port": { 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_port", 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10051", 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.414 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_sender": { 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_sender", 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.415 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "dashboard", 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "restful", 2024-09-10T11:12:38.416 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_schedule" 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "available_modules": [ 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "alerts", 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.417 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.418 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.419 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.420 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.421 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.422 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.425 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_destination": { 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_destination", 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email address to send alerts to", 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.426 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_from_name": { 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_from_name", 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "Ceph", 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email From: name", 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.427 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_host": { 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_host", 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP server", 2024-09-10T11:12:38.428 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_password": { 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_password", 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Password to authenticate with", 2024-09-10T11:12:38.429 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_port": { 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_port", 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "465", 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP port", 2024-09-10T11:12:38.430 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_sender": { 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_sender", 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP envelope sender", 2024-09-10T11:12:38.431 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_ssl": { 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_ssl", 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.432 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_user": { 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_user", 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.433 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "User to authenticate as", 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "balancer", 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "active": { 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "active", 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.434 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_time": { 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_time", 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.435 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0000", 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_weekday": { 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_weekday", 2024-09-10T11:12:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_max_iterations": { 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_max_iterations", 2024-09-10T11:12:38.437 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "25", 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "250", 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_metrics": { 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_metrics", 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.438 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_step": { 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_step", 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.439 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.5", 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0.001", 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "0.999", 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "aggressiveness of optimization", 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "end_time": { 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_time", 2024-09-10T11:12:38.440 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2359", 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "end_weekday": { 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_weekday", 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.444 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.445 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.446 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "min_score": { 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_score", 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.447 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.448 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "upmap", 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-compat", 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "none", 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "read", 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap", 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap-read" 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Balancer mode", 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.449 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_ids": { 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_ids", 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.450 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.451 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_deviation": { 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_deviation", 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T11:12:38.452 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_optimizations": { 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_optimizations", 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.453 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm", 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_down_multiplier": { 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_down_multiplier", 2024-09-10T11:12:38.454 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_refresh_rate": { 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_refresh_rate", 2024-09-10T11:12:38.455 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "20", 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_starting_port": { 2024-09-10T11:12:38.456 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_starting_port", 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4721", 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.457 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_ptrace": { 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_ptrace", 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.458 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_interval": { 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_interval", 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_memory_target_ratio": { 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.7", 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.460 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_log_destination": { 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm_log_destination", 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "file", 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "file,syslog", 2024-09-10T11:12:38.461 INFO:teuthology.orchestra.run.smithi059.stdout: "syslog" 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "cgroups_split": { 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cgroups_split", 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.462 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "config_checks_enabled": { 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_checks_enabled", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.463 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "config_dashboard": { 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_dashboard", 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.464 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_alertmanager": { 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_alertmanager", 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_base": { 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_base", 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.466 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Container image name, without the tag", 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_elasticsearch": { 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_elasticsearch", 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.467 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "elasticsearch container image", 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_grafana": { 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_grafana", 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.468 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_haproxy": { 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_haproxy", 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.469 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "HAproxy container image", 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_agent": { 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_agent", 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.470 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger agent container image", 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_collector": { 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_collector", 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.471 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger collector container image", 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_query": { 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_query", 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.472 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger query container image", 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_keepalived": { 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_keepalived", 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.473 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Keepalived container image", 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_loki": { 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_loki", 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Loki container image", 2024-09-10T11:12:38.474 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_node_exporter": { 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_node_exporter", 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.475 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nvmeof": { 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nvmeof", 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nvme-of container image", 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.476 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_prometheus": { 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_prometheus", 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.477 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_promtail": { 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_promtail", 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Promtail container image", 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.478 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_samba": { 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_samba", 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Samba/SMB container image", 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.479 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_snmp_gateway": { 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_snmp_gateway", 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SNMP Gateway container image", 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.480 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "container_init": { 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_init", 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.481 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "daemon_cache_timeout": { 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "daemon_cache_timeout", 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "default_cephadm_command_timeout": { 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "900", 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "default_registry": { 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_registry", 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io", 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.484 INFO:teuthology.orchestra.run.smithi059.stdout: "device_cache_timeout": { 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_cache_timeout", 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1800", 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache device inventory", 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.485 INFO:teuthology.orchestra.run.smithi059.stdout: "device_enhanced_scan": { 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_enhanced_scan", 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "facts_cache_timeout": { 2024-09-10T11:12:38.486 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "facts_cache_timeout", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache host facts data", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "grafana_dashboards_path": { 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "grafana_dashboards_path", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.487 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "host_check_interval": { 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "host_check_interval", 2024-09-10T11:12:38.488 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to perform a host check", 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "hw_monitoring": { 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hw_monitoring", 2024-09-10T11:12:38.489 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "inventory_list_all": { 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "inventory_list_all", 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.490 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.491 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.492 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "log_refresh_metadata": { 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_refresh_metadata", 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T11:12:38.493 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.494 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.495 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.498 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "*", 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "max_count_per_host": { 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_count_per_host", 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of daemons per service per host", 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.500 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd_draining_count": { 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_osd_draining_count", 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T11:12:38.501 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "migration_current": { 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "migration_current", 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "internal - do not modify", 2024-09-10T11:12:38.502 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "root", 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.503 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm-package", 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "root" 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "oob_default_addr": { 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "oob_default_addr", 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.504 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "169.254.1.1", 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "prometheus_alerts_path": { 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus_alerts_path", 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.505 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_insecure": { 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_insecure", 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.506 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_password": { 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_password", 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.507 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_url": { 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_url", 2024-09-10T11:12:38.508 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_username": { 2024-09-10T11:12:38.509 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_username", 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "secure_monitoring_stack": { 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secure_monitoring_stack", 2024-09-10T11:12:38.510 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "service_discovery_port": { 2024-09-10T11:12:38.511 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "service_discovery_port", 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8765", 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "cephadm service discovery port", 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.512 INFO:teuthology.orchestra.run.smithi059.stdout: "ssh_config_file": { 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssh_config_file", 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: "use_agent": { 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_agent", 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.514 INFO:teuthology.orchestra.run.smithi059.stdout: "use_repo_digest": { 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_repo_digest", 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.515 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_failed_host_check": { 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_failed_host_check", 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_daemons": { 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_daemons", 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.517 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_hosts": { 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_hosts", 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.518 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crash", 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.519 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.520 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.521 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.522 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.523 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "retain_interval": { 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retain_interval", 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "31536000", 2024-09-10T11:12:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_recent_interval": { 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_recent_interval", 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1209600", 2024-09-10T11:12:38.525 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dashboard", 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.527 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.528 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.529 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_ENABLED": { 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.530 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.531 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.532 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T11:12:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T11:12:38.537 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T11:12:38.538 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.542 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_URL": { 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_URL", 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.544 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.545 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.546 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.547 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.548 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.549 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.550 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.551 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.552 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.553 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.554 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.556 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.559 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T11:12:38.560 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T11:12:38.561 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8", 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T11:12:38.562 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "45", 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T11:12:38.563 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.565 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.566 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "cross_origin_url": { 2024-09-10T11:12:38.570 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cross_origin_url", 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "crt_file": { 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crt_file", 2024-09-10T11:12:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "debug": { 2024-09-10T11:12:38.572 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "debug", 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable/disable debug options", 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "jwt_token_ttl": { 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "jwt_token_ttl", 2024-09-10T11:12:38.573 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "28800", 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.574 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.576 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.577 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.578 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.579 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "motd": { 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "motd", 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "The message of the day", 2024-09-10T11:12:38.581 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect_resolve_ip_addr": { 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.582 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.583 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8080", 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.584 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.585 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl_server_port": { 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl_server_port", 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8443", 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.586 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "redirect", 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.587 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect" 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.588 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "url_prefix": { 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url_prefix", 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.590 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_monitoring": { 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_monitoring", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "monitor device health metrics", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.591 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.592 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.593 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.594 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.595 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.596 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "mark_out_threshold": { 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mark_out_threshold", 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2419200", 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.597 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": { 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_name", 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "device_health_metrics", 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.598 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "retention_period": { 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retention_period", 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15552000", 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.599 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain device health metrics", 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_frequency": { 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_frequency", 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.600 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "self_heal": { 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "self_heal", 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.601 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.602 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_threshold": { 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_threshold", 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7257600", 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.603 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "diskprediction_local", 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.604 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.605 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.606 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.607 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.608 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.609 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "predict_interval": { 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predict_interval", 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T11:12:38.610 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "predictor_model": { 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predictor_model", 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "prophetstor", 2024-09-10T11:12:38.611 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.612 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "influx", 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": false, 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "influxdb python module not found", 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "batch_size": { 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "batch_size", 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5000", 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T11:12:38.614 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "database": { 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "database", 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "ceph", 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.615 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": { 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hostname", 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server hostname", 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "30", 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "5", 2024-09-10T11:12:38.617 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.619 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.621 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.622 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "password": { 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "password", 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.623 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "password of InfluxDB server user", 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "port": { 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "port", 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.624 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8086", 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server port", 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.625 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "false", 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "threads": { 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threads", 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.626 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "32", 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "username": { 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "username", 2024-09-10T11:12:38.627 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "username of InfluxDB server user", 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "verify_ssl": { 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "verify_ssl", 2024-09-10T11:12:38.628 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "true", 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.629 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "insights", 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.631 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.633 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.634 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "iostat", 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.636 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.637 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.638 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.639 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.640 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "k8sevents", 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_event_retention_days": { 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ceph_event_retention_days", 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.641 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7", 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "config_check_secs": { 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_check_secs", 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.642 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "10", 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.643 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.644 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.645 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.646 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "localpool", 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "failure_domain": { 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "failure_domain", 2024-09-10T11:12:38.648 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "host", 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "failure domain for any created local pool", 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.649 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.650 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.651 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.652 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.653 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.654 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": { 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_size", 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default min_size for any created local pool", 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.655 INFO:teuthology.orchestra.run.smithi059.stdout: "num_rep": { 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "num_rep", 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3", 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default replica count for any created local pool", 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": { 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_num", 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "128", 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "prefix": { 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prefix", 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name prefix for any created local pool", 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.658 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "subtree": { 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subtree", 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "rack", 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T11:12:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mds_autoscaler", 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirroring", 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.669 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.670 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "nfs", 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.671 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.672 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.673 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.674 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.675 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.676 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "fail_fs": { 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "fail_fs", 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.677 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.678 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.679 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.680 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator": { 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.683 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "rook", 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "test_orchestrator" 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Orchestrator backend", 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.684 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_perf_query", 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.685 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.687 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.688 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.689 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_support", 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.690 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.691 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.692 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.693 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.694 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_autoscaler", 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.696 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.697 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.698 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.699 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.700 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.701 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "threshold": { 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threshold", 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1.0", 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "scaling threshold", 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T11:12:38.703 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "progress", 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_pg_recovery_event": { 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_pg_recovery_event", 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.704 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T11:12:38.705 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.706 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.707 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.708 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.709 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.710 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "max_completed_events": { 2024-09-10T11:12:38.711 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_completed_events", 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "50", 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "number of past completed events to remember", 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T11:12:38.712 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long the module is going to sleep", 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.713 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus", 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "cache": { 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cache", 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.714 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "exclude_perf_counters": { 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "exclude_perf_counters", 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.715 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.716 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.717 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.718 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.719 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools": { 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools", 2024-09-10T11:12:38.721 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T11:12:38.722 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300", 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.723 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_interval": { 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_interval", 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15.0", 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.724 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.725 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "9283", 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "stale_cache_strategy": { 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stale_cache_strategy", 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "log", 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "default", 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "default", 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "error" 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.728 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T11:12:38.729 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.730 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.731 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.732 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.733 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.734 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.735 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_snap_create": { 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_snap_create", 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.736 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "mirror_snapshot_schedule": { 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.737 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "trash_purge_schedule": { 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "trash_purge_schedule", 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.738 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "restful", 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_auth": { 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_auth", 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.739 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.740 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.741 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.742 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.744 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.745 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.746 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.747 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rgw", 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.748 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.749 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.750 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.751 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.752 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rook", 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.754 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.755 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.756 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.757 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.758 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "storage_class": { 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "storage_class", 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "local", 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.759 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "selftest", 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.760 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.761 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.762 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.763 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.764 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "roption1": { 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption1", 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.765 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "roption2": { 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption2", 2024-09-10T11:12:38.766 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "xyz", 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption1": { 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption1", 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.767 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption2": { 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption2", 2024-09-10T11:12:38.768 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption3": { 2024-09-10T11:12:38.769 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption3", 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption4": { 2024-09-10T11:12:38.770 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption4", 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.771 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption5": { 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption5", 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption6": { 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption6", 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption7": { 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption7", 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "42", 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "testkey": { 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testkey", 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "testlkey": { 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testlkey", 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "testnewline": { 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testnewline", 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.777 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_m_granularity": { 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_m_granularity", 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.778 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "dump_on_update": { 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dump_on_update", 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.779 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "dump database to debug log on update", 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.780 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.781 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.782 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.783 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stats", 2024-09-10T11:12:38.785 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.786 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.787 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.788 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.789 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.790 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "status", 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.791 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.793 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.794 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.795 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telegraf", 2024-09-10T11:12:38.796 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "address": { 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "address", 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.797 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15", 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.798 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.800 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.801 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.802 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.803 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telemetry", 2024-09-10T11:12:38.804 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_basic": { 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_basic", 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T11:12:38.805 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_crash": { 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_crash", 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.806 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_device": { 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_device", 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.807 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_ident": { 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_ident", 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.808 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_perf": { 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_perf", 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.809 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "contact": { 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "contact", 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "description": { 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "description", 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.811 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "device_url": { 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_url", 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.812 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.813 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.814 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "24", 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "8", 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "last_opt_revision": { 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "last_opt_revision", 2024-09-10T11:12:38.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1", 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard": { 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard", 2024-09-10T11:12:38.816 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard_description": { 2024-09-10T11:12:38.817 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard_description", 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.818 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.819 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.820 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.821 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "organization": { 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "organization", 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "proxy": { 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "proxy", 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "url": { 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url", 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "test_orchestrator", 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.827 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.830 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.831 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.832 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.833 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.834 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.835 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.836 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_clones": { 2024-09-10T11:12:38.837 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_clones", 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4", 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "periodic_async_work": { 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "periodic_async_work", 2024-09-10T11:12:38.838 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Periodically check for async work", 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_delay": { 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_delay", 2024-09-10T11:12:38.839 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_no_wait": { 2024-09-10T11:12:38.840 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix", 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "discovery_interval": { 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "discovery_interval", 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "100", 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.842 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "identifier": { 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "identifier", 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.843 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.844 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.845 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T11:12:38.846 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T11:12:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T11:12:38.848 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.849 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_host": { 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_host", 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.850 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_port": { 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_port", 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10051", 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.851 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_sender": { 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_sender", 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T11:12:38.852 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "dashboard": "https://172.21.15.59:8443/" 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "always_on_modules": { 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "octopus": [ 2024-09-10T11:12:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "pacific": [ 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T11:12:38.854 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "quincy": [ 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T11:12:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "reef": [ 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T11:12:38.856 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "squid": [ 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T11:12:38.857 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "last_failure_osd_epoch": 86, 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "active_clients": [ 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 4070085365 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.858 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "libcephsqlite", 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 718106664 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2024-09-10T11:12:38.859 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1596201973 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T11:12:38.860 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1686749766 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2274317223 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:38.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2073532502 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T11:12:38.862 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:12:38.864 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:38 smithi115 ceph-mon[34719]: pgmap v351: 97 pgs: 97 active+clean; 2.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:38.864 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:38 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3327425399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T11:12:38.864 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:38 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/576536293' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T11:12:38.864 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:38 smithi181 ceph-mon[35409]: pgmap v351: 97 pgs: 97 active+clean; 2.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:38.864 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:38 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3327425399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T11:12:38.864 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:38 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/576536293' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fccac0a2d00 msgr2=0x7fccac0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fccac0a2d00 0x7fccac0a51c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fccb40058c0 tx=0x7fccb4005cb0 comp rx=0 tx=0).stop 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4102450 msgr2=0x7fccc4198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4102450 0x7fccc4198950 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009a50 tx=0x7fccb8004270 comp rx=0 tx=0).stop 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 shutdown_connections 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fccac0a2d00 0x7fccac0a51c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fccc4107ac0 0x7fccc419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4102450 0x7fccc4198950 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 --2- 172.21.15.59:0/576536293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc4101ab0 0x7fccc4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 >> 172.21.15.59:0/576536293 conn(0x7fccc40fd7d0 msgr2=0x7fccc40fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:38.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 shutdown_connections 2024-09-10T11:12:38.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:37.549+0000 7fccc9b52640 1 -- 172.21.15.59:0/576536293 wait complete. 2024-09-10T11:12:38.924 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T11:12:38.924 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T11:12:38.924 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:38 smithi059 ceph-mon[30978]: pgmap v351: 97 pgs: 97 active+clean; 2.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-10T11:12:38.925 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:38 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3327425399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T11:12:38.925 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:38 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/576536293' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T11:12:39.195 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:12:39.707 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:12:39.707 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:39.707 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 0, 2024-09-10T11:12:39.707 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2, 2024-09-10T11:12:39.707 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 0, 2024-09-10T11:12:39.707 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 0, 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.001446581, 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.000255207, 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 6, 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 167, 2024-09-10T11:12:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 3392, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 186848, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.015156922, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.009383719, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.003657932, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 165, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.016281429, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000098675 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.710 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 186848 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 226, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 216, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1444416, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 132544, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2024-09-10T11:12:39.711 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.044763185, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.016065780, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.040041519, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 215, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.013282109, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000061777 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 1444416, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 132544 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:39.713 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:39.714 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:39.715 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 149017, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 31, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:39.716 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 928, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 228, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1412563, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:39.717 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 228, 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 228, 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1412563, 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:39.718 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:12:40.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:40 smithi059 ceph-mon[30978]: pgmap v352: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-09-10T11:12:40.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:40 smithi181 ceph-mon[35409]: pgmap v352: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-09-10T11:12:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:40 smithi115 ceph-mon[34719]: pgmap v352: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-09-10T11:12:40.516 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-10T11:12:40.516 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-10T11:12:40.516 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-10T11:12:40.516 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-10T11:12:40.516 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-10T11:12:40.516 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-10T11:12:40.516 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-10T11:12:40.516 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T11:12:40.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T11:12:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:12:41.392 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:12:41.392 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:41.392 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 0, 2024-09-10T11:12:41.392 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2, 2024-09-10T11:12:41.392 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 0, 2024-09-10T11:12:41.392 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 0, 2024-09-10T11:12:41.392 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-09-10T11:12:41.392 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.001412520, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.000238075, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:41.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 2, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 169, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 320, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 187104, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.015414356, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.011043887, 2024-09-10T11:12:41.394 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.001969113, 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 166, 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.019685069, 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000118584 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T11:12:41.395 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 187104 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 235, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 223, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1448848, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 136192, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.045059679, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.016620012, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.039572388, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:41.396 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 223, 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.017936297, 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000080431 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 1448848, 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 136192 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-10T11:12:41.397 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:41.398 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:41.399 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:41.400 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 148994, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 31, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:41.401 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 928, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:41.402 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 233, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1413213, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 233, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T11:12:41.403 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T11:12:41.404 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 233, 2024-09-10T11:12:41.404 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1413213, 2024-09-10T11:12:41.404 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T11:12:41.404 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:41.404 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:41.404 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:41.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:41.404 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:41.404 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:12:42.112 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T11:12:42.112 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T11:12:42.112 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-10T11:12:42.112 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-10T11:12:42.112 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-10T11:12:42.113 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-10T11:12:42.113 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-10T11:12:42.113 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T11:12:42.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T11:12:42.374 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:12:42.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:42 smithi059 ceph-mon[30978]: pgmap v353: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-10T11:12:42.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:42 smithi181 ceph-mon[35409]: pgmap v353: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-10T11:12:42.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:42 smithi115 ceph-mon[34719]: pgmap v353: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-10T11:12:42.865 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:12:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:42.865 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 0, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 0, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 0, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.001453149, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.000254156, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:42.866 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 6, 2024-09-10T11:12:42.867 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 168, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 3392, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 187024, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.016637602, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.010479134, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.003807467, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 166, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.017933677, 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000108034 2024-09-10T11:12:42.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 187024 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 227, 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 217, 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1444688, 2024-09-10T11:12:42.869 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 133184, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.043272293, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.016630709, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.038033690, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 216, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.013196760, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000061096 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:42.870 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 1444688, 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 133184 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:42.871 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:42.872 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:42.873 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 149017, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 31, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-10T11:12:42.874 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 928, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-10T11:12:42.875 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 229, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1412693, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 229, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 229, 2024-09-10T11:12:42.876 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1412693, 2024-09-10T11:12:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T11:12:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:42.877 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:42.877 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:12:43.642 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-10T11:12:43.642 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-10T11:12:43.642 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-10T11:12:43.642 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-10T11:12:43.643 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-10T11:12:43.643 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-10T11:12:43.643 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-10T11:12:43.643 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T11:12:43.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T11:12:43.905 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:12:44.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:44 smithi059 ceph-mon[30978]: pgmap v354: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-10T11:12:44.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:44 smithi181 ceph-mon[35409]: pgmap v354: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-10T11:12:44.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:44 smithi115 ceph-mon[34719]: pgmap v354: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-10T11:12:44.535 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T11:12:44.535 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:44.535 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 0, 2024-09-10T11:12:44.535 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2, 2024-09-10T11:12:44.535 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 0, 2024-09-10T11:12:44.535 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 0, 2024-09-10T11:12:44.536 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-09-10T11:12:44.536 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2024-09-10T11:12:44.536 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.001244911, 2024-09-10T11:12:44.536 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T11:12:44.536 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.000198518, 2024-09-10T11:12:44.536 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:44.537 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:44.537 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:44.537 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:44.537 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:44.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.537 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:44.537 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:44.537 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 237, 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 225, 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1449392, 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 137472, 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2024-09-10T11:12:44.538 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.047316246, 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.016797593, 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.042133147, 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 225, 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.018051175, 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000080227 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:44.539 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 1449392, 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 137472 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 2, 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 171, 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 320, 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 187456, 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:44.540 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.015806088, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.011259847, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.001902959, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 168, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.015962256, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000095013 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 187456 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:44.542 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:44.543 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:44.544 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:44.545 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:44.545 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:44.545 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:44.545 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-10T11:12:44.545 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:44.545 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:44.546 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:44.546 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:44.546 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 148994, 2024-09-10T11:12:44.546 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 31, 2024-09-10T11:12:44.546 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:44.546 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:44.546 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-10T11:12:44.546 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 928, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:44.547 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 235, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1413473, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 235, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T11:12:44.548 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T11:12:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 235, 2024-09-10T11:12:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1413473, 2024-09-10T11:12:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T11:12:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T11:12:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T11:12:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T11:12:44.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:44.550 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T11:12:44.550 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T11:12:45.257 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T11:12:45.258 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T11:12:45.258 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-10T11:12:45.258 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-10T11:12:45.258 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-10T11:12:45.258 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-10T11:12:45.258 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-10T11:12:45.258 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T11:12:45.258 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T11:12:45.520 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:12:46.022 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-10T11:12:46.022 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:46.022 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3233, 2024-09-10T11:12:46.022 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 2960, 2024-09-10T11:12:46.022 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 2630641, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 5431946, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 15, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 4, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.337626953, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.108499662, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.160388183, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.074863364, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2960, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.172087343, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000058137 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:46.023 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2904, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000634736, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000218 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1886400, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 242912 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 2782, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 4541, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1048502, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 5122686, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 110, 2024-09-10T11:12:46.024 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 8, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.411920287, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.148902498, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.199429863, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.068092116, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 4538, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.288023835, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000063469 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 4900, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000847035, 2024-09-10T11:12:46.025 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000172 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 902176, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 1978464 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3378, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 3744, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 982516, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 18572049, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 11, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 6, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.332898419, 2024-09-10T11:12:46.026 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.142228376, 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.112059555, 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.072397376, 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3742, 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.530229965, 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000141696 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1981, 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000466949, 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000235 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.027 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 42560, 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 1936 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 1, 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-MDSRank": { 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 6167, 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.528279219, 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000247815 2024-09-10T11:12:46.028 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-PurgeQueue": { 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 15, 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000261650, 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000017443 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "request": 767, 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "reply": 767, 2024-09-10T11:12:46.029 INFO:teuthology.orchestra.run.smithi115.stdout: "reply_latency": { 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 767, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 3.227502055, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.004207955 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_reply": 0, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "forward": 0, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_complete": 0, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_keys": 0, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_commit": 347, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_split": 0, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_merge": 0, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes": 43, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_top": 14, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_bottom": 29, 2024-09-10T11:12:46.030 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pin_tail": 0, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pinned": 23, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_expired": 0, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_with_caps": 2, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": 3, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "subtrees": 2, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse": 805, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_hit": 792, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_forward": 0, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_discover": 0, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_remote_ino": 0, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_lock": 0, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "load_cent": 0, 2024-09-10T11:12:46.031 INFO:teuthology.orchestra.run.smithi115.stdout: "q": 0, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "exported": 0, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "exported_inodes": 0, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "imported": 0, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "imported_inodes": 0, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_dir_fetch": 0, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_peer_discover": 0, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rfiles": 5, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rbytes": 298, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rsnaps": 6, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:12:46.032 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_set_tag": 0, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_file_inodes": 0, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_revoke": 617, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_grant": 612, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_trunc": 599, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:12:46.033 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps": 683, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps_dirty": 660, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_cap_release": 2, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "process_request_cap_release": 621 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_cache": { 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update": 7, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update_receipt": 0, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_try_discover": 0, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_send_discover": 0, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_handle_discover": 16, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays": 2, 2024-09-10T11:12:46.034 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_delayed": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_created": 3, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_enqueued": 1, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_reintegrated": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_migrated": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_processing": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_started": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_completed": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:12:46.035 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_exportdir": 0, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_flush": 0, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragstats": 0, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_inodestats": 0 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_log": { 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "evlrg": 0, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "evadd": 2522, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "evex": 2468, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "evtrm": 2468, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "ev": 54, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "evexg": 0, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "evexd": 51, 2024-09-10T11:12:46.036 INFO:teuthology.orchestra.run.smithi115.stdout: "segadd": 56, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "segex": 55, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "segtrm": 55, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "seg": 1, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "segmjr": 1, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "segexg": 0, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "segexd": 1, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "expos": 26035113, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "wrpos": 26616646, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "rdpos": 0, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "jlat": { 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2467, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 5.500132566, 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.002229482 2024-09-10T11:12:46.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "replayed": 0 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_mem": { 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "ino": 36, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "ino+": 36, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "ino-": 0, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "dir": 20, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "dir+": 20, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "dir-": 0, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "dn": 43, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "dn+": 43, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "dn-": 0, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "cap": 3, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "cap+": 18, 2024-09-10T11:12:46.038 INFO:teuthology.orchestra.run.smithi115.stdout: "cap-": 15, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "rss": 55616, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "heap": 231712 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_server": { 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_client_request": 2021, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_server_request": 1, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_request": 767, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_session": 36, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_peer_request": 2, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "req_create_latency": { 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 5, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.003858855, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000771771 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getattr_latency": { 2024-09-10T11:12:46.039 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 108, 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.024417948, 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000226092 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getfilelock_latency": { 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "req_link_latency": { 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookup_latency": { 2024-09-10T11:12:46.040 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2, 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000249386, 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000124693 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookuphash_latency": { 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupino_latency": { 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1, 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000148865, 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000148865 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupname_latency": { 2024-09-10T11:12:46.041 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupparent_latency": { 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupsnap_latency": { 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lssnap_latency": { 2024-09-10T11:12:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 11, 2024-09-10T11:12:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.002452025, 2024-09-10T11:12:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000222911 2024-09-10T11:12:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mkdir_latency": { 2024-09-10T11:12:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 8, 2024-09-10T11:12:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.011615011, 2024-09-10T11:12:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001451876 2024-09-10T11:12:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mknod_latency": { 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mksnap_latency": { 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 11, 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.051517949, 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.004683449 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "req_open_latency": { 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1, 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000293064, 2024-09-10T11:12:46.044 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000293064 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: "req_readdir_latency": { 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2, 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.004134606, 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.002067303 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rename_latency": { 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2, 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001974880, 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000987440 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.045 INFO:teuthology.orchestra.run.smithi115.stdout: "req_renamesnap_latency": { 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "req_snapdiff_latency": { 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmdir_latency": { 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2, 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.009984508, 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.004992254 2024-09-10T11:12:46.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmsnap_latency": { 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 5, 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.022755233, 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.004551046 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmxattr_latency": { 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setattr_latency": { 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 600, 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 3.069531893, 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.005115886 2024-09-10T11:12:46.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setdirlayout_latency": { 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setfilelock_latency": { 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setlayout_latency": { 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.048 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setxattr_latency": { 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 8, 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.021360421, 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.002670052 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "req_symlink_latency": { 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "req_unlink_latency": { 2024-09-10T11:12:46.049 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.003207411, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.003207411 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getvxattr_latency": { 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_sessions": { 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "session_count": 2, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "session_add": 6, 2024-09-10T11:12:46.050 INFO:teuthology.orchestra.run.smithi115.stdout: "session_remove": 4, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_open": 2, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_stale": 0, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "total_load": 108, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "average_load": 54, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "avg_session_uptime": 665, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "mdthresh_evicted": 0 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:46.052 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:46.053 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 343598, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 138, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:46.054 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 8416, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 185, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 176680, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 1425, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:46.055 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "objecter": { 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "op_active": 0, 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "op_laggy": 0, 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send": 4266, 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send_bytes": 23549622, 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "op_resend": 37, 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "op_reply": 4266, 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "op_latency": { 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 4266, 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 27.045467839, 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.006339772 2024-09-10T11:12:46.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "op_inflight": 0, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "oplen_avg": { 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 4266, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 5004 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "op": 4266, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "op_r": 1, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "op_w": 4265, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "op_rmw": 0, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "op_pg": 0, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_stat": 327, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_create": 25, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_read": 1, 2024-09-10T11:12:46.057 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_write": 2468, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writefull": 178, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writesame": 0, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_append": 0, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_zero": 0, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_truncate": 0, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_delete": 523, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_mapext": 0, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_sparse_read": 0, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_clonerange": 0, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_getxattr": 0, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_setxattr": 50, 2024-09-10T11:12:46.058 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:12:46.059 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_rmxattr": 0, 2024-09-10T11:12:46.059 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:12:46.059 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_call": 0, 2024-09-10T11:12:46.059 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_watch": 0, 2024-09-10T11:12:46.059 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_notify": 0, 2024-09-10T11:12:46.059 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:12:46.059 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls": 0, 2024-09-10T11:12:46.059 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:12:46.059 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_other": 599, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_active": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_send": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_resend": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_ping": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_active": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_send": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_resend": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_active": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_send": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_resend": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_active": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_send": 0, 2024-09-10T11:12:46.060 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_resend": 0, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "command_active": 0, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "command_send": 0, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "command_resend": 0, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "map_epoch": 97, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "map_full": 0, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "map_inc": 16, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_sessions": 12, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_open": 12, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_close": 0, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_laggy": 0, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_wr": 821, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_rd": 0, 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_del": 12 2024-09-10T11:12:46.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "oft": { 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_objs": 1, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_updates": 0, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_removes": 0 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "osd-slow-ops": { 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_ops_count": 0 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "purge_queue": { 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops": 0, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops_high_water": 1, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing": 0, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_high_water": 1, 2024-09-10T11:12:46.062 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed_ops": 1, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed": 1, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_item_in_journal": 0 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 9389, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 3655032, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 9389, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:46.063 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 9389, 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 3655032, 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_bytes": { 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-10T11:12:46.064 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 4266, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 23549771, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 4266, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 23549771, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_ops": { 2024-09-10T11:12:46.065 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 1024, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 4266, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 4266, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 4266, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 4266, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.066 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 1, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 149, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 1, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 1, 2024-09-10T11:12:46.067 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 149, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle-0x55d67c7d2960": { 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 2522, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 22422342, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 2522, 2024-09-10T11:12:46.068 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2467, 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 22422342, 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:46.069 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-10T11:12:46.189 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:46 smithi115 ceph-mon[34719]: pgmap v355: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-10T11:12:46.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:46 smithi059 ceph-mon[30978]: pgmap v355: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-10T11:12:46.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:46 smithi181 ceph-mon[35409]: pgmap v355: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-10T11:12:46.840 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-10T11:12:46.840 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-10T11:12:46.840 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=7 2024-09-10T11:12:46.840 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-10T11:12:46.840 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-10T11:12:46.841 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-09-10T11:12:46.841 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-09-10T11:12:46.841 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T11:12:46.841 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T11:12:47.095 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:12:47.579 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-10T11:12:47.579 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:47.579 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 1039, 2024-09-10T11:12:47.579 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 1026, 2024-09-10T11:12:47.579 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1744720, 2024-09-10T11:12:47.579 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 389310, 2024-09-10T11:12:47.579 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:47.579 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 1, 2024-09-10T11:12:47.579 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.132306639, 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.054451322, 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.059108976, 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.022208485, 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1025, 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.061310423, 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000059815 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1480960, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 139680 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 8, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 174, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 3948, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 459082, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 6, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 4, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.012715822, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.007115940, 2024-09-10T11:12:47.581 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.003708706, 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000051401, 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 172, 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.019104048, 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000111070 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-10T11:12:47.582 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 458384 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 1492, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 1494, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 382735, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 474463, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 4, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.094235958, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.021946453, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.027198781, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.039174664, 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:47.583 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1492, 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.040751025, 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000027313 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 1, 2024-09-10T11:12:47.584 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-MDSRank": { 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3823, 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.091402293, 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000023908 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-PurgeQueue": { 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.585 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "request": 0, 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "reply": 0, 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "reply_latency": { 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_reply": 0, 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "forward": 0, 2024-09-10T11:12:47.586 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_complete": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_keys": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_commit": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_split": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_merge": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_top": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_bottom": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pin_tail": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pinned": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_expired": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_with_caps": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": 0, 2024-09-10T11:12:47.587 INFO:teuthology.orchestra.run.smithi115.stdout: "subtrees": 1, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_hit": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_forward": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_discover": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_remote_ino": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_lock": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "load_cent": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "q": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "exported": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "exported_inodes": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "imported": 0, 2024-09-10T11:12:47.588 INFO:teuthology.orchestra.run.smithi115.stdout: "imported_inodes": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_dir_fetch": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_peer_discover": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rfiles": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rbytes": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rsnaps": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_set_tag": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:12:47.589 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_file_inodes": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_cap_release": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "process_request_cap_release": 0 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_cache": { 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update": 0, 2024-09-10T11:12:47.590 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update_receipt": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_try_discover": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_send_discover": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_handle_discover": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_delayed": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_created": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_enqueued": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_reintegrated": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_migrated": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_processing": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_started": 0, 2024-09-10T11:12:47.591 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_completed": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_exportdir": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_flush": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragstats": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_inodestats": 0 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_log": { 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "evlrg": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "evadd": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "evex": 0, 2024-09-10T11:12:47.592 INFO:teuthology.orchestra.run.smithi115.stdout: "evtrm": 0, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "ev": 9, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "evexg": 0, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "evexd": 0, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "segadd": 0, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "segex": 0, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "segtrm": 0, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "seg": 2, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "segmjr": 2, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "segexg": 0, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "segexd": 0, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "expos": 4194304, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "wrpos": 4196802, 2024-09-10T11:12:47.593 INFO:teuthology.orchestra.run.smithi115.stdout: "rdpos": 4196661, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "jlat": { 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "replayed": 9 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_mem": { 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "ino": 3, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "ino+": 3, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "ino-": 0, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "dir": 1, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "dir+": 1, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "dir-": 0, 2024-09-10T11:12:47.594 INFO:teuthology.orchestra.run.smithi115.stdout: "dn": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "dn+": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "dn-": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "cap": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "cap+": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "cap-": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "rss": 47984, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "heap": 215328 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_server": { 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_client_request": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_server_request": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_request": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_session": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_peer_request": 0, 2024-09-10T11:12:47.595 INFO:teuthology.orchestra.run.smithi115.stdout: "req_create_latency": { 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getattr_latency": { 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getfilelock_latency": { 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.596 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "req_link_latency": { 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookup_latency": { 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.597 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookuphash_latency": { 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupino_latency": { 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupname_latency": { 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.598 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupparent_latency": { 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupsnap_latency": { 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lssnap_latency": { 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.599 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.600 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mkdir_latency": { 2024-09-10T11:12:47.600 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.600 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.600 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mknod_latency": { 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mksnap_latency": { 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "req_open_latency": { 2024-09-10T11:12:47.601 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "req_readdir_latency": { 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rename_latency": { 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.602 INFO:teuthology.orchestra.run.smithi115.stdout: "req_renamesnap_latency": { 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "req_snapdiff_latency": { 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmdir_latency": { 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.603 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmsnap_latency": { 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmxattr_latency": { 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.604 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setattr_latency": { 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setdirlayout_latency": { 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setfilelock_latency": { 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setlayout_latency": { 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setxattr_latency": { 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "req_symlink_latency": { 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.606 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "req_unlink_latency": { 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getvxattr_latency": { 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.607 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_sessions": { 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "session_count": 1, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "session_add": 4, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "session_remove": 3, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_open": 3, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_stale": 0, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "total_load": 0, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "average_load": 0, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "avg_session_uptime": 4462, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "mdthresh_evicted": 0 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:47.608 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:47.609 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 181313, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 47, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 8416, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 185, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 8512, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 13, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.612 INFO:teuthology.orchestra.run.smithi115.stdout: "objecter": { 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "op_active": 0, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "op_laggy": 0, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send": 2279, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send_bytes": 21, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "op_resend": 3, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "op_reply": 2279, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "op_latency": { 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2279, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.239975538, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000544087 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "op_inflight": 0, 2024-09-10T11:12:47.613 INFO:teuthology.orchestra.run.smithi115.stdout: "oplen_avg": { 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2279, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 2280 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "op": 2279, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "op_r": 2279, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "op_w": 0, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "op_rmw": 0, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "op_pg": 0, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_stat": 1483, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_create": 0, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_read": 794, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_write": 0, 2024-09-10T11:12:47.614 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writefull": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writesame": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_append": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_zero": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_truncate": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_delete": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_mapext": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_sparse_read": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_clonerange": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_getxattr": 1, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_setxattr": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_rmxattr": 0, 2024-09-10T11:12:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_call": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_watch": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_notify": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_other": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_active": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_send": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_resend": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_ping": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_active": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_send": 0, 2024-09-10T11:12:47.616 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_resend": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_active": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_send": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_resend": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_active": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_send": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_resend": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "command_active": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "command_send": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "command_resend": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "map_epoch": 97, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "map_full": 0, 2024-09-10T11:12:47.617 INFO:teuthology.orchestra.run.smithi115.stdout: "map_inc": 14, 2024-09-10T11:12:47.620 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_sessions": 4, 2024-09-10T11:12:47.620 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_open": 4, 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_close": 0, 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_laggy": 0, 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_wr": 0, 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_rd": 2, 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_del": 0 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: "oft": { 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_objs": 0, 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:12:47.621 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_updates": 0, 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_removes": 0 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "osd-slow-ops": { 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_ops_count": 0 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "purge_queue": { 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops": 0, 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing": 0, 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_high_water": 0, 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed_ops": 0, 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed": 0, 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_item_in_journal": 0 2024-09-10T11:12:47.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 2535, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 1887183, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 2535, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2535, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 1887183, 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:47.623 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_bytes": { 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 2279, 2024-09-10T11:12:47.624 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 2503, 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2279, 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 2503, 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_ops": { 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 1024, 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:47.625 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 2279, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 2279, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2279, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 2279, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:12:47.626 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle-0x55a94f8acb40": { 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 0, 2024-09-10T11:12:47.628 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:47.629 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:47.629 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:47.629 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:47.629 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:47.629 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:47.629 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-10T11:12:48.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:48 smithi115 ceph-mon[34719]: pgmap v356: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-10T11:12:48.377 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T11:12:48.378 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T11:12:48.378 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-10T11:12:48.378 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-10T11:12:48.378 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-10T11:12:48.378 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-10T11:12:48.378 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T11:12:48.378 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T11:12:48.378 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T11:12:48.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:48 smithi059 ceph-mon[30978]: pgmap v356: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-10T11:12:48.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:48 smithi181 ceph-mon[35409]: pgmap v356: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-10T11:12:48.625 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 25, 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 162, 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 8662, 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 368981, 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 11, 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 4, 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.013744859, 2024-09-10T11:12:49.119 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.005803262, 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.004822531, 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000517422, 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 161, 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.026135604, 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000162332 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2, 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000143, 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000071 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.120 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 336144 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 335, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 355, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1506453, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 194637, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 12, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 7, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.060085803, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.020738757, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.052091664, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000566325, 2024-09-10T11:12:49.121 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 351, 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.027555920, 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000078506 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 73, 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000014106, 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000193 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1500496, 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 158352 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.122 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 1247, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 824, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 338938, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 445326, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 8, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.103211968, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.049035349, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.059408628, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.004279291, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 824, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.047654884, 2024-09-10T11:12:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000057833 2024-09-10T11:12:49.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.124 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:49.124 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1932, 2024-09-10T11:12:49.124 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000346600, 2024-09-10T11:12:49.124 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000179 2024-09-10T11:12:49.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.124 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 2000, 2024-09-10T11:12:49.124 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 128160 2024-09-10T11:12:49.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.125 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-10T11:12:49.125 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 1, 2024-09-10T11:12:49.125 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-10T11:12:49.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.125 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-MDSRank": { 2024-09-10T11:12:49.125 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-10T11:12:49.125 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-10T11:12:49.125 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 57, 2024-09-10T11:12:49.125 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001794998, 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000031491 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-PurgeQueue": { 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2, 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000007006, 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000003503 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "request": 9, 2024-09-10T11:12:49.126 INFO:teuthology.orchestra.run.smithi115.stdout: "reply": 6, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "reply_latency": { 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 6, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001759703, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000293283 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_reply": 0, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "forward": 3, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_complete": 0, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_keys": 0, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_commit": 11, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_split": 0, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_merge": 0, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes": 16, 2024-09-10T11:12:49.127 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_top": 0, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_bottom": 16, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pin_tail": 0, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pinned": 13, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_expired": 4, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_with_caps": 1, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": 1, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "subtrees": 3, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse": 20, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_hit": 13, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_forward": 2, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_discover": 4, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:12:49.128 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_remote_ino": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_lock": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "load_cent": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "q": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "exported": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "exported_inodes": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "imported": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "imported_inodes": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_dir_fetch": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_peer_discover": 0, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rfiles": 5, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rbytes": 298, 2024-09-10T11:12:49.129 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rsnaps": 6, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_set_tag": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_file_inodes": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:12:49.130 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps": 0, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_cap_release": 0, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "process_request_cap_release": 1 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_cache": { 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update": 0, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update_receipt": 9, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_try_discover": 6, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_send_discover": 8, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_handle_discover": 0, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays": 0, 2024-09-10T11:12:49.131 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_delayed": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_created": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_enqueued": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_reintegrated": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_migrated": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_processing": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_started": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_completed": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:12:49.132 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:12:49.133 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_exportdir": 0, 2024-09-10T11:12:49.133 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_flush": 0, 2024-09-10T11:12:49.133 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:12:49.133 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragstats": 0, 2024-09-10T11:12:49.133 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_inodestats": 0 2024-09-10T11:12:49.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.133 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_log": { 2024-09-10T11:12:49.134 INFO:teuthology.orchestra.run.smithi115.stdout: "evlrg": 0, 2024-09-10T11:12:49.134 INFO:teuthology.orchestra.run.smithi115.stdout: "evadd": 9, 2024-09-10T11:12:49.134 INFO:teuthology.orchestra.run.smithi115.stdout: "evex": 0, 2024-09-10T11:12:49.134 INFO:teuthology.orchestra.run.smithi115.stdout: "evtrm": 0, 2024-09-10T11:12:49.134 INFO:teuthology.orchestra.run.smithi115.stdout: "ev": 9, 2024-09-10T11:12:49.134 INFO:teuthology.orchestra.run.smithi115.stdout: "evexg": 0, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "evexd": 0, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "segadd": 2, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "segex": 0, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "segtrm": 0, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "seg": 2, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "segmjr": 2, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "segexg": 0, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "segexd": 0, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "expos": 4194304, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "wrpos": 4196802, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "rdpos": 0, 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "jlat": { 2024-09-10T11:12:49.135 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 8, 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.013268251, 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001658531 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "replayed": 0 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_mem": { 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "ino": 20, 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "ino+": 22, 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "ino-": 2, 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "dir": 19, 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "dir+": 22, 2024-09-10T11:12:49.136 INFO:teuthology.orchestra.run.smithi115.stdout: "dir-": 3, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "dn": 16, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "dn+": 20, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "dn-": 4, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "cap": 1, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "cap+": 6, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "cap-": 5, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "rss": 53320, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "heap": 223520 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_server": { 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_client_request": 13, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_server_request": 0, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_request": 9, 2024-09-10T11:12:49.137 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_session": 21, 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_peer_request": 1, 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "req_create_latency": { 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getattr_latency": { 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3, 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001349414, 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000449804 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getfilelock_latency": { 2024-09-10T11:12:49.138 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "req_link_latency": { 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookup_latency": { 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2, 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000324553, 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000162276 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.139 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookuphash_latency": { 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupino_latency": { 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1, 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000085736, 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000085736 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupname_latency": { 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.140 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupparent_latency": { 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupsnap_latency": { 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lssnap_latency": { 2024-09-10T11:12:49.141 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mkdir_latency": { 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mknod_latency": { 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mksnap_latency": { 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "req_open_latency": { 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "req_readdir_latency": { 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rename_latency": { 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: "req_renamesnap_latency": { 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.144 INFO:teuthology.orchestra.run.smithi115.stdout: "req_snapdiff_latency": { 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmdir_latency": { 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmsnap_latency": { 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.145 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmxattr_latency": { 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setattr_latency": { 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setdirlayout_latency": { 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.146 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setfilelock_latency": { 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setlayout_latency": { 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.147 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setxattr_latency": { 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "req_symlink_latency": { 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "req_unlink_latency": { 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.148 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getvxattr_latency": { 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_sessions": { 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "session_count": 1, 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "session_add": 4, 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "session_remove": 3, 2024-09-10T11:12:49.149 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_open": 1, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_stale": 0, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "total_load": 5, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "average_load": 1, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "avg_session_uptime": 678, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "mdthresh_evicted": 0 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:49.150 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:49.151 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:49.152 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 272311, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 97, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:49.153 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 8416, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 185, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 86773, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 343, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:49.154 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "objecter": { 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "op_active": 0, 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "op_laggy": 0, 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send": 48, 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send_bytes": 13241, 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "op_resend": 33, 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "op_reply": 48, 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "op_latency": { 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 48, 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 4.262916662, 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.088810763 2024-09-10T11:12:49.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "op_inflight": 0, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "oplen_avg": { 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 48, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 73 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "op": 48, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "op_r": 0, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "op_w": 48, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "op_rmw": 0, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "op_pg": 0, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_stat": 0, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_create": 10, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_read": 0, 2024-09-10T11:12:49.156 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_write": 8, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writefull": 8, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writesame": 0, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_append": 0, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_zero": 0, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_truncate": 0, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_delete": 6, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_mapext": 0, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_sparse_read": 0, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_clonerange": 0, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_getxattr": 0, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_setxattr": 20, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:12:49.157 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_rmxattr": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_call": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_watch": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_notify": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_other": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_active": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_send": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_resend": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_ping": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_active": 0, 2024-09-10T11:12:49.158 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_send": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_resend": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_active": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_send": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_resend": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_active": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_send": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_resend": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "command_active": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "command_send": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "command_resend": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "map_epoch": 97, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "map_full": 0, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "map_inc": 15, 2024-09-10T11:12:49.159 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_sessions": 10, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_open": 10, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_close": 0, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_laggy": 0, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_wr": 20, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_rd": 0, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_del": 1 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "oft": { 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_objs": 1, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_updates": 0, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_removes": 0 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.160 INFO:teuthology.orchestra.run.smithi115.stdout: "osd-slow-ops": { 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_ops_count": 0 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "purge_queue": { 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops": 0, 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing": 0, 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_high_water": 0, 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed_ops": 0, 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed": 0, 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_item_in_journal": 0 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:49.161 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 1603, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 1690872, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 1603, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 1603, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 1690872, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.162 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_bytes": { 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 48, 2024-09-10T11:12:49.163 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 13241, 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 48, 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 13241, 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_ops": { 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 1024, 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:49.164 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 48, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 48, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 48, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 48, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:49.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.166 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle-0x556c2f974960": { 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 9, 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 2498, 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 9, 2024-09-10T11:12:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 8, 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 2498, 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:49.168 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-10T11:12:49.850 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-10T11:12:49.850 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-10T11:12:49.850 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-10T11:12:49.850 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=9 2024-09-10T11:12:49.850 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-10T11:12:49.850 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-10T11:12:49.850 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T11:12:49.850 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T11:12:49.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T11:12:50.092 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:12:50.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:50 smithi115 ceph-mon[34719]: pgmap v357: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T11:12:50.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:50 smithi059 ceph-mon[30978]: pgmap v357: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T11:12:50.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:50 smithi181 ceph-mon[35409]: pgmap v357: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T11:12:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-10T11:12:50.624 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 239, 2024-09-10T11:12:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 227, 2024-09-10T11:12:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1449936, 2024-09-10T11:12:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 138752, 2024-09-10T11:12:50.625 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 4, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 0, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.046132114, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.016090007, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.041651623, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 227, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.018225690, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000080289 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:50.626 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1449936, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 138752 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 2, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 172, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 320, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 187632, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:50.627 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.012517880, 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.008030375, 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.001360809, 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 169, 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.020960722, 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000124027 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:50.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 187632 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 0, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 2, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 0, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 0, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 2, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 1, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.000310365, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T11:12:50.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.000224324, 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:50.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 0, 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:50.631 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:50.632 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:50.632 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:50.632 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:50.632 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:50.632 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:50.632 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:50.632 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:50.632 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:50.633 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:50.634 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:50.635 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 148967, 2024-09-10T11:12:50.635 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 29, 2024-09-10T11:12:50.636 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:50.636 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:50.637 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-10T11:12:50.637 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-10T11:12:50.637 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:50.637 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:50.637 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:50.638 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:50.638 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 0, 2024-09-10T11:12:50.638 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 0, 2024-09-10T11:12:50.638 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:50.638 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:50.639 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:50.639 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-10T11:12:50.639 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 928, 2024-09-10T11:12:50.639 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 2, 2024-09-10T11:12:50.640 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:50.640 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-10T11:12:50.640 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:50.641 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-10T11:12:50.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-10T11:12:50.641 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:50.642 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-10T11:12:50.642 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-10T11:12:50.642 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-10T11:12:50.642 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 237, 2024-09-10T11:12:50.643 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 1413733, 2024-09-10T11:12:50.643 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:50.643 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 237, 2024-09-10T11:12:50.644 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-10T11:12:50.644 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-10T11:12:50.644 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 237, 2024-09-10T11:12:50.645 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 1413733, 2024-09-10T11:12:50.645 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-10T11:12:50.645 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-10T11:12:50.645 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-10T11:12:50.645 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-10T11:12:50.645 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:50.645 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-10T11:12:50.645 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-10T11:12:51.300 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-10T11:12:51.300 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-10T11:12:51.300 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-10T11:12:51.300 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-10T11:12:51.300 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-10T11:12:51.300 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-10T11:12:51.300 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-10T11:12:51.301 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T11:12:51.301 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T11:12:51.559 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:12:52.068 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-10T11:12:52.068 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:52.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 545, 2024-09-10T11:12:52.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 545, 2024-09-10T11:12:52.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 5952448, 2024-09-10T11:12:52.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 206789, 2024-09-10T11:12:52.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 6, 2024-09-10T11:12:52.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.061313831, 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.021973847, 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.031004399, 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.010987602, 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 544, 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.024012981, 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000044141 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.069 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 195056, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 77680 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1094, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 1184, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 8706969, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 596491, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-09-10T11:12:52.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.124754218, 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.039474068, 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.039214837, 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.035417935, 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1183, 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.053721954, 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000045411 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 250128 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 297, 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 299, 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 4269673, 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 94461, 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-09-10T11:12:52.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.033978768, 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.007982390, 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.014029085, 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.009354745, 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 297, 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.013656080, 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000045980 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.073 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3093, 2024-09-10T11:12:52.074 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.082717250, 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000026743 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-10T11:12:52.075 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-10T11:12:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 20, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 5, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 15, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 13, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 2, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-09-10T11:12:52.077 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-10T11:12:52.078 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 5, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 298, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 6, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:12:52.079 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.080 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-10T11:12:52.081 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-10T11:12:52.082 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 1770, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 33, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-10T11:12:52.083 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 26035113, 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 26628167, 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 26616646, 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 1770 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 17, 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 18, 2024-09-10T11:12:52.084 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 1, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 9, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 9, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 0, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 20, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 20, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-09-10T11:12:52.085 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 46784, 2024-09-10T11:12:52.086 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 215328 2024-09-10T11:12:52.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.086 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-10T11:12:52.086 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-09-10T11:12:52.086 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-10T11:12:52.086 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-09-10T11:12:52.086 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-09-10T11:12:52.086 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-10T11:12:52.088 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.091 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-10T11:12:52.091 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.091 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.091 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.091 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.092 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.093 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.095 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.096 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.097 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:52.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 2, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 0, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 0, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 1962, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-10T11:12:52.099 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:52.100 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:52.101 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 206977, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 80, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:52.102 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 8416, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 185, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 100228, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 805, 2024-09-10T11:12:52.103 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 1792, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 26, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 4, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 1792, 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-10T11:12:52.104 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1792, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.988980026, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000551886 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1792, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1793 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 1792, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 1792, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-10T11:12:52.105 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 896, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 893, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-09-10T11:12:52.106 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 2, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:12:52.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-10T11:12:52.108 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 97, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 10, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 7, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 7, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-09-10T11:12:52.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-10T11:12:52.110 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 1932, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 18745037, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 1932, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:52.111 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1932, 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 18745037, 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:52.112 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 1792, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 18237363, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1792, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 18237363, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.113 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 1792, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 1792, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1792, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1792, 2024-09-10T11:12:52.114 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:52.115 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x55e0eda4e640": { 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:52.116 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:52.117 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:52.118 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:52.118 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-10T11:12:52.204 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:52 smithi181 ceph-mon[35409]: pgmap v358: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-10T11:12:52.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:52 smithi059 ceph-mon[30978]: pgmap v358: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-10T11:12:52.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:52 smithi115 ceph-mon[34719]: pgmap v358: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-10T11:12:52.845 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T11:12:52.845 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T11:12:52.845 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-10T11:12:52.845 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-10T11:12:52.845 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-10T11:12:52.845 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-10T11:12:52.845 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T11:12:52.845 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T11:12:52.846 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T11:12:53.102 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:12:53.605 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-10T11:12:53.605 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:53.605 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 256, 2024-09-10T11:12:53.605 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 243, 2024-09-10T11:12:53.605 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1482066, 2024-09-10T11:12:53.605 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 140644, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.045207413, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.016546282, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.041357609, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000015659, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 242, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.015129779, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000062519 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:53.606 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1481232, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 140320 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 707, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 876, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 173772, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 685539, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 7, 2024-09-10T11:12:53.607 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 5, 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.085856732, 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.026710208, 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.020534756, 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.029749994, 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 873, 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.049126875, 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000056273 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.608 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 461344 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1593, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 1593, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 480696, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 505808, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:53.609 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.170692837, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.053152325, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.047531299, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.054266464, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1592, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.075642760, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000047514 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.610 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-10T11:12:53.611 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T11:12:53.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.611 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-10T11:12:53.611 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-10T11:12:53.611 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-10T11:12:53.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.611 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-10T11:12:53.611 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-10T11:12:53.611 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3750, 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.117586255, 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000031356 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-09-10T11:12:53.613 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-09-10T11:12:53.614 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 1, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-10T11:12:53.615 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:12:53.616 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-09-10T11:12:53.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-10T11:12:53.618 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-09-10T11:12:53.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 10, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-10T11:12:53.620 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4197195, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 4197054, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 10 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 3, 2024-09-10T11:12:53.621 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 3, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 0, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 1, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 1, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 0, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 0, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 0, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 48948, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 215328 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.622 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.623 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-10T11:12:53.624 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.625 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.626 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.627 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.628 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.629 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-10T11:12:53.630 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.632 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-10T11:12:53.633 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-10T11:12:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 2, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 5, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 3, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 4, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 3241, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:53.636 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:53.637 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 189383, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 50, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-10T11:12:53.638 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 8416, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 185, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 8512, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 13, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:53.639 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 2295, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 21, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 3, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 2295, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2295, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1.244974941, 2024-09-10T11:12:53.640 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000542472 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2295, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2296 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 2295, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 2295, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 1493, 2024-09-10T11:12:53.641 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 800, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 1, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-09-10T11:12:53.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-10T11:12:53.643 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 97, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-10T11:12:53.644 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 14, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 5, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 5, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-10T11:12:53.645 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.646 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 2552, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 1890732, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 2552, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2552, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1890732, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.647 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 2295, 2024-09-10T11:12:53.648 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 2896, 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2295, 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 2896, 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-10T11:12:53.649 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 2295, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 2295, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2295, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 2295, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.650 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:53.651 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x5633e2d16b40": { 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-10T11:12:53.652 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:53.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:53.654 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-10T11:12:54.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:54 smithi181 ceph-mon[35409]: pgmap v359: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-10T11:12:54.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:54 smithi059 ceph-mon[30978]: pgmap v359: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-10T11:12:54.414 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-10T11:12:54.414 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-10T11:12:54.415 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-10T11:12:54.415 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-10T11:12:54.415 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-10T11:12:54.415 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-10T11:12:54.415 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T11:12:54.415 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T11:12:54.415 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T11:12:54.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:54 smithi115 ceph-mon[34719]: pgmap v359: 97 pgs: 97 active+clean; 2.6 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-10T11:12:54.664 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:12:55.184 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-10T11:12:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1254, 2024-09-10T11:12:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 810, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 341521, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 432851, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 9, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.086924541, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.032748141, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.055966019, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.004955399, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 809, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.049963485, 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000061759 2024-09-10T11:12:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1940, 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000458146, 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000236 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 5248, 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 4256 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 340, 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 373, 2024-09-10T11:12:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1503694, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 205228, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 10, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 6, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.060812325, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.021964929, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.051490437, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000650886, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 372, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.029913509, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000080412 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 100, 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000020167, 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000201 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1497152, 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 163040 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 15, 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 183, 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 3430, 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 490389, 2024-09-10T11:12:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 11, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.013584628, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.007042411, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.004337482, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000119837, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 180, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.030373559, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000168741 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 10, 2024-09-10T11:12:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000001301, 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000130 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 461968 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-10T11:12:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 65, 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.001705626, 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000026240 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000018459, 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000009229 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:55.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 10, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 6, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 6, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.001257257, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000209542 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 4, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-10T11:12:55.192 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 11, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 16, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 16, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 13, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 4, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 1, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 1, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 3, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 21, 2024-09-10T11:12:55.193 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 16, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 1, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 3, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-10T11:12:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 5, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 298, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 6, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:12:55.195 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-10T11:12:55.196 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 11, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 7, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 8, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:12:55.197 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 10, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-10T11:12:55.198 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 10, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 2, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4197195, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 0, 2024-09-10T11:12:55.199 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 9, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.016181117, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001797901 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 0 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 20, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 22, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 2, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 19, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 23, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 4, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 16, 2024-09-10T11:12:55.200 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 20, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 4, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 1, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 4, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 3, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 53060, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 223520 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 10, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 10, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 31, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-10T11:12:55.201 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 4, 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000794988, 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000198747 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.202 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000462269, 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000231134 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.203 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.205 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.206 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-10T11:12:55.206 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.206 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.206 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.207 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.208 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.209 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.211 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.212 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-10T11:12:55.213 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 2, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 5, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 3, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 2, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 4, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 1, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 671, 2024-09-10T11:12:55.214 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:55.215 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:55.216 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 256311, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 95, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 176, 2024-09-10T11:12:55.217 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 2, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 8416, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 185, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 86765, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 342, 2024-09-10T11:12:55.218 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 48, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 13508, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 32, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 48, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 48, 2024-09-10T11:12:55.219 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.228995468, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.004770738 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 48, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 72 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 48, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 0, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 48, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-10T11:12:55.220 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 0, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 10, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 0, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 9, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 8, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 6, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-10T11:12:55.221 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 20, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-10T11:12:55.222 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-10T11:12:55.223 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 97, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 14, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 9, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 9, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 17, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 0, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 2 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.224 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 1, 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-10T11:12:55.225 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 1605, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 1684921, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 1605, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:55.226 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1605, 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1684921, 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:55.227 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 48, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 13508, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 48, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 13508, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-10T11:12:55.228 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 48, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 48, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 48, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 48, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.229 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-10T11:12:55.230 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x5654da178960": { 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 10, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 2891, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:55.231 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 10, 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 9, 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 2891, 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:55.232 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-10T11:12:55.949 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-10T11:12:55.949 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-10T11:12:55.949 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-10T11:12:55.949 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=11 2024-09-10T11:12:55.950 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-10T11:12:55.950 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-10T11:12:55.950 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T11:12:55.950 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T11:12:55.950 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T11:12:56.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:56 smithi181 ceph-mon[35409]: pgmap v360: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-10T11:12:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:12:56.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:56 smithi059 ceph-mon[30978]: pgmap v360: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-10T11:12:56.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:56 smithi115 ceph-mon[34719]: pgmap v360: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-10T11:12:56.752 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-10T11:12:56.752 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:12:56.752 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 237, 2024-09-10T11:12:56.752 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 227, 2024-09-10T11:12:56.752 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1447408, 2024-09-10T11:12:56.752 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 139584, 2024-09-10T11:12:56.752 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 0, 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.044396054, 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.016204242, 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.040257438, 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 226, 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.015557686, 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000068839 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:56.753 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1447408, 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 139584 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 2, 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 174, 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 320, 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 187984, 2024-09-10T11:12:56.754 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.013063638, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.009002011, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.001471136, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 171, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.019652373, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000114926 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:56.755 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 187984 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 4, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 4, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 3072, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 448, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 2, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-09-10T11:12:56.756 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.002197872, 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.000030876, 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.002126049, 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3, 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.003977638, 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001325879 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:56.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 0, 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:12:56.758 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:12:56.759 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-10T11:12:56.760 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 148977, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 30, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:12:56.761 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 928, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 2, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-10T11:12:56.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 239, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 1413993, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 239, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 239, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1413993, 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-10T11:12:56.763 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-10T11:12:56.764 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-10T11:12:56.764 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-10T11:12:56.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:56.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-10T11:12:56.764 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-10T11:12:57.461 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-10T11:12:57.461 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-10T11:12:57.461 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-10T11:12:57.461 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-10T11:12:57.461 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-10T11:12:57.461 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-10T11:12:57.461 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-10T11:12:57.461 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T11:12:57.473 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T11:12:57.473 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T11:12:57.473 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T11:12:57.492 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T11:12:57.493 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T11:12:57.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T11:12:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:12:58.245 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:58 smithi059 ceph-mon[30978]: pgmap v361: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T11:12:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 -- 172.21.15.59:0/4264875846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac100a80 msgr2=0x7f6fac100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 --2- 172.21.15.59:0/4264875846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac100a80 0x7f6fac100ee0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009930 tx=0x7f6f9402a420 comp rx=0 tx=0).stop 2024-09-10T11:12:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 -- 172.21.15.59:0/4264875846 shutdown_connections 2024-09-10T11:12:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 --2- 172.21.15.59:0/4264875846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fac101420 0x7f6fac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 --2- 172.21.15.59:0/4264875846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac100a80 0x7f6fac100ee0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 --2- 172.21.15.59:0/4264875846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fac106a80 0x7f6fac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 -- 172.21.15.59:0/4264875846 >> 172.21.15.59:0/4264875846 conn(0x7f6fac0fc7a0 msgr2=0x7f6fac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 -- 172.21.15.59:0/4264875846 shutdown_connections 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 -- 172.21.15.59:0/4264875846 wait complete. 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 Processor -- start 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 -- start start 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fac100a80 0x7f6fac102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac101420 0x7f6fac102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fac106a80 0x7f6fac1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac110ed0 con 0x7f6fac101420 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac110d50 con 0x7f6fac100a80 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.330+0000 7f6fb160d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac111050 con 0x7f6fac106a80 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac101420 0x7f6fac102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac101420 0x7f6fac102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45364/0 (socket says 172.21.15.59:45364) 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa3fff640 1 -- 172.21.15.59:0/3637412825 learned_addr learned my addr 172.21.15.59:0/3637412825 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fab7fe640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fac106a80 0x7f6fac1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6faaffd640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fac100a80 0x7f6fac102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa3fff640 1 -- 172.21.15.59:0/3637412825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fac106a80 msgr2=0x7f6fac1030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa3fff640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fac106a80 0x7f6fac1030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa3fff640 1 -- 172.21.15.59:0/3637412825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fac100a80 msgr2=0x7f6fac102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa3fff640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fac100a80 0x7f6fac102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa3fff640 1 -- 172.21.15.59:0/3637412825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fac1a68c0 con 0x7f6fac101420 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa3fff640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac101420 0x7f6fac102b90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6f9402a940 tx=0x7f6f94003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa8ff9640 1 -- 172.21.15.59:0/3637412825 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9403f070 con 0x7f6fac101420 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa8ff9640 1 -- 172.21.15.59:0/3637412825 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f94031c90 con 0x7f6fac101420 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fac1a6b50 con 0x7f6fac101420 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.331+0000 7f6fa8ff9640 1 -- 172.21.15.59:0/3637412825 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94035030 con 0x7f6fac101420 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.332+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fac1a7080 con 0x7f6fac101420 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.333+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fac100ee0 con 0x7f6fac101420 2024-09-10T11:12:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.334+0000 7f6fa8ff9640 1 -- 172.21.15.59:0/3637412825 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6f94042070 con 0x7f6fac101420 2024-09-10T11:12:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.335+0000 7f6fa8ff9640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6f980a2d70 0x7f6f980a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:12:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.335+0000 7f6faaffd640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6f980a2d70 0x7f6f980a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:12:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.335+0000 7f6fa8ff9640 1 -- 172.21.15.59:0/3637412825 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f6f940efff0 con 0x7f6fac101420 2024-09-10T11:12:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.335+0000 7f6faaffd640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6f980a2d70 0x7f6f980a5230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005fd0 tx=0x7f6f9c00b510 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:12:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.338+0000 7f6fa8ff9640 1 -- 172.21.15.59:0/3637412825 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f940bccb0 con 0x7f6fac101420 2024-09-10T11:12:58.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:58 smithi181 ceph-mon[35409]: pgmap v361: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T11:12:58.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:58 smithi115 ceph-mon[34719]: pgmap v361: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T11:12:58.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.526+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6fac103b80 con 0x7f6fac101420 2024-09-10T11:12:58.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.526+0000 7f6fa8ff9640 1 -- 172.21.15.59:0/3637412825 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v97) ==== 81+0+945 (secure 0 0 0) 0x7f6fac103b80 con 0x7f6fac101420 2024-09-10T11:12:58.527 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2735068879 2024-09-11T11:01:22.217825+0000 2024-09-10T11:12:58.527 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6800/3094540037 2024-09-11T10:52:15.554183+0000 2024-09-10T11:12:58.527 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1311671881 2024-09-11T10:52:38.625589+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6801/3094540037 2024-09-11T10:52:15.554183+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3551787843 2024-09-11T10:52:38.625589+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3813830687 2024-09-11T10:52:15.554183+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2362644310 2024-09-11T11:01:22.217825+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6801/3145930564 2024-09-11T11:01:22.217825+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3172621917 2024-09-11T10:52:15.554183+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/4100202670 2024-09-11T10:52:15.554183+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2924034396 2024-09-11T10:52:38.625589+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6800/3293737690 2024-09-11T10:52:38.625589+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6801/3293737690 2024-09-11T10:52:38.625589+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6800/3145930564 2024-09-11T11:01:22.217825+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/626509906 2024-09-11T11:01:22.217825+0000 2024-09-10T11:12:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2665068071 2024-09-11T11:01:22.217825+0000 2024-09-10T11:12:58.529 INFO:teuthology.orchestra.run.smithi059.stderr:listed 16 entries 2024-09-10T11:12:58.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6f980a2d70 msgr2=0x7f6f980a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:58.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6f980a2d70 0x7f6f980a5230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005fd0 tx=0x7f6f9c00b510 comp rx=0 tx=0).stop 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac101420 msgr2=0x7f6fac102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac101420 0x7f6fac102b90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6f9402a940 tx=0x7f6f94003b90 comp rx=0 tx=0).stop 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 shutdown_connections 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f6f980a2d70 0x7f6f980a5230 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6fac106a80 0x7f6fac1030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fac101420 0x7f6fac102b90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 --2- 172.21.15.59:0/3637412825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fac100a80 0x7f6fac102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 >> 172.21.15.59:0/3637412825 conn(0x7f6fac0fc7a0 msgr2=0x7f6fac104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 shutdown_connections 2024-09-10T11:12:58.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:12:58.529+0000 7f6fb160d640 1 -- 172.21.15.59:0/3637412825 wait complete. 2024-09-10T11:12:59.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:12:59 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3637412825' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T11:12:59.207 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T11:12:59.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:12:59.207 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T11:12:59.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:12:59.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:12:59.269 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T11:12:59.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:12:59.301 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-09-10T11:12:59.358 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T11:12:59.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:12:59.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T11:12:59.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:12:59.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-09-10T11:12:59.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:12:59 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3637412825' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T11:12:59.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:12:59 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3637412825' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T11:12:59.533 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T11:12:59.545 INFO:tasks.cephadm:Teardown begin 2024-09-10T11:12:59.545 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T11:12:59.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:12:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:13:00.239 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:00 smithi059 ceph-mon[30978]: pgmap v362: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-10T11:13:00.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 -- 172.21.15.59:0/3940397512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854102790 msgr2=0x7f58541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 --2- 172.21.15.59:0/3940397512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854102790 0x7f58541067e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5844009900 tx=0x7f584402a410 comp rx=0 tx=0).stop 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 -- 172.21.15.59:0/3940397512 shutdown_connections 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 --2- 172.21.15.59:0/3940397512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5854106f10 0x7f585410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 --2- 172.21.15.59:0/3940397512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854102790 0x7f58541067e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 --2- 172.21.15.59:0/3940397512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5854101de0 0x7f58541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 -- 172.21.15.59:0/3940397512 >> 172.21.15.59:0/3940397512 conn(0x7f58540fd8c0 msgr2=0x7f58540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 -- 172.21.15.59:0/3940397512 shutdown_connections 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 -- 172.21.15.59:0/3940397512 wait complete. 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 Processor -- start 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.323+0000 7f585baf5640 1 -- start start 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f585baf5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854101de0 0x7f5854198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:00.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f585baf5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5854102790 0x7f5854198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f585baf5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5854106f10 0x7f585419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f585baf5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5854111f70 con 0x7f5854101de0 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f585baf5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5854111df0 con 0x7f5854102790 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f585baf5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f58541120f0 con 0x7f5854106f10 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859891640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854101de0 0x7f5854198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859891640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854101de0 0x7f5854198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45380/0 (socket says 172.21.15.59:45380) 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859891640 1 -- 172.21.15.59:0/3406821179 learned_addr learned my addr 172.21.15.59:0/3406821179 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859090640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5854102790 0x7f5854198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f585a092640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5854106f10 0x7f585419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859891640 1 -- 172.21.15.59:0/3406821179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5854106f10 msgr2=0x7f585419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859891640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5854106f10 0x7f585419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859891640 1 -- 172.21.15.59:0/3406821179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5854102790 msgr2=0x7f5854198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859891640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5854102790 0x7f5854198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859891640 1 -- 172.21.15.59:0/3406821179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585419d4c0 con 0x7f5854101de0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f5859891640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854101de0 0x7f5854198510 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f585000c970 tx=0x7f585000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f584affd640 1 -- 172.21.15.59:0/3406821179 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850007bb0 con 0x7f5854101de0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.324+0000 7f584affd640 1 -- 172.21.15.59:0/3406821179 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5850007d50 con 0x7f5854101de0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.325+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585419d7b0 con 0x7f5854101de0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.325+0000 7f584affd640 1 -- 172.21.15.59:0/3406821179 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585000f450 con 0x7f5854101de0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.325+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58541a5090 con 0x7f5854101de0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.326+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58541021c0 con 0x7f5854101de0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.327+0000 7f584affd640 1 -- 172.21.15.59:0/3406821179 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5850004fe0 con 0x7f5854101de0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.327+0000 7f584affd640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f58400a2cf0 0x7f58400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.328+0000 7f5859090640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f58400a2cf0 0x7f58400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.328+0000 7f584affd640 1 -- 172.21.15.59:0/3406821179 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f58500cf6d0 con 0x7f5854101de0 2024-09-10T11:13:00.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.328+0000 7f5859090640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f58400a2cf0 0x7f58400a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5844009230 tx=0x7f58440058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:00.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.331+0000 7f584affd640 1 -- 172.21.15.59:0/3406821179 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5850014030 con 0x7f5854101de0 2024-09-10T11:13:00.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:00 smithi181 ceph-mon[35409]: pgmap v362: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-10T11:13:00.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:00 smithi115 ceph-mon[34719]: pgmap v362: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-10T11:13:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.542+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5854199870 con 0x7f5854101de0 2024-09-10T11:13:00.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.543+0000 7f584affd640 1 -- 172.21.15.59:0/3406821179 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11908 (secure 0 0 0) 0x7f5854199870 con 0x7f5854101de0 2024-09-10T11:13:00.544 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:13:00.544 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"btime":"2024-09-10T11:05:23:624211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:59:31.833573+0000","modified":"2024-09-10T11:05:23.624187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24470,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/411505011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":411505011},{"type":"v1","addr":"172.21.15.115:6839","nonce":411505011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25204":{"gid":25204,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/332556001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":332556001},{"type":"v1","addr":"172.21.15.181:6837","nonce":332556001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24466,24470,24497]},"id":1}]} 2024-09-10T11:13:00.545 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 26 2024-09-10T11:13:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f58400a2cf0 msgr2=0x7f58400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f58400a2cf0 0x7f58400a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5844009230 tx=0x7f58440058d0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854101de0 msgr2=0x7f5854198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854101de0 0x7f5854198510 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f585000c970 tx=0x7f585000ce30 comp rx=0 tx=0).stop 2024-09-10T11:13:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 shutdown_connections 2024-09-10T11:13:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f58400a2cf0 0x7f58400a51b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5854106f10 0x7f585419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5854102790 0x7f5854198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 --2- 172.21.15.59:0/3406821179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5854101de0 0x7f5854198510 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.545+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 >> 172.21.15.59:0/3406821179 conn(0x7f58540fd8c0 msgr2=0x7f58540fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.546+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 shutdown_connections 2024-09-10T11:13:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:00.546+0000 7f585baf5640 1 -- 172.21.15.59:0/3406821179 wait complete. 2024-09-10T11:13:01.227 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:01 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3406821179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:13:01.255 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:13:01.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:01 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3406821179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:13:01.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:01 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3406821179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:13:01.511 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:13:02.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 -- 172.21.15.59:0/3006295861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84101420 msgr2=0x7f5c8410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 --2- 172.21.15.59:0/3006295861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84101420 0x7f5c8410d950 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009cd0 tx=0x7f5c7c02a8e0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 -- 172.21.15.59:0/3006295861 shutdown_connections 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 --2- 172.21.15.59:0/3006295861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84101420 0x7f5c8410d950 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 --2- 172.21.15.59:0/3006295861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c84100a80 0x7f5c84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 --2- 172.21.15.59:0/3006295861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c84106a80 0x7f5c84106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 -- 172.21.15.59:0/3006295861 >> 172.21.15.59:0/3006295861 conn(0x7f5c840fc7a0 msgr2=0x7f5c840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 -- 172.21.15.59:0/3006295861 shutdown_connections 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 -- 172.21.15.59:0/3006295861 wait complete. 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.005+0000 7f5c8c339640 1 Processor -- start 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8c339640 1 -- start start 2024-09-10T11:13:02.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8c339640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84100a80 0x7f5c841992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8c339640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c84101420 0x7f5c841997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8c339640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c84106a80 0x7f5c841a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8c339640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84110ea0 con 0x7f5c84100a80 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8c339640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84110d20 con 0x7f5c84101420 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8c339640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84111020 con 0x7f5c84106a80 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8a0d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84100a80 0x7f5c841992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8a0d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84100a80 0x7f5c841992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45388/0 (socket says 172.21.15.59:45388) 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8a0d5640 1 -- 172.21.15.59:0/1234405116 learned_addr learned my addr 172.21.15.59:0/1234405116 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c898d4640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c84101420 0x7f5c841997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8a8d6640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c84106a80 0x7f5c841a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8a0d5640 1 -- 172.21.15.59:0/1234405116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c84106a80 msgr2=0x7f5c841a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8a0d5640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c84106a80 0x7f5c841a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8a0d5640 1 -- 172.21.15.59:0/1234405116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c84101420 msgr2=0x7f5c841997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8a0d5640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c84101420 0x7f5c841997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.006+0000 7f5c8a0d5640 1 -- 172.21.15.59:0/1234405116 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c841a4870 con 0x7f5c84100a80 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.007+0000 7f5c8a0d5640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84100a80 0x7f5c841992b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000c890 tx=0x7f5c8000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.007+0000 7f5c7b7fe640 1 -- 172.21.15.59:0/1234405116 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c80004220 con 0x7f5c84100a80 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.007+0000 7f5c7b7fe640 1 -- 172.21.15.59:0/1234405116 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c800043c0 con 0x7f5c84100a80 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.007+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c841a4a40 con 0x7f5c84100a80 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.007+0000 7f5c7b7fe640 1 -- 172.21.15.59:0/1234405116 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c80004a00 con 0x7f5c84100a80 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.007+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c841a4fd0 con 0x7f5c84100a80 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.008+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c84100ee0 con 0x7f5c84100a80 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.009+0000 7f5c7b7fe640 1 -- 172.21.15.59:0/1234405116 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5c800079b0 con 0x7f5c84100a80 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.010+0000 7f5c7b7fe640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c700a2d70 0x7f5c700a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.010+0000 7f5c7b7fe640 1 -- 172.21.15.59:0/1234405116 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f5c800cf040 con 0x7f5c84100a80 2024-09-10T11:13:02.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.010+0000 7f5c898d4640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c700a2d70 0x7f5c700a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:02.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.010+0000 7f5c898d4640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c700a2d70 0x7f5c700a5230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c8406b320 tx=0x7f5c74009110 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:02.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.014+0000 7f5c7b7fe640 1 -- 172.21.15.59:0/1234405116 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c80014030 con 0x7f5c84100a80 2024-09-10T11:13:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.226+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c84109040 con 0x7f5c84100a80 2024-09-10T11:13:02.227 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:02 smithi059 ceph-mon[30978]: pgmap v363: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T11:13:02.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.227+0000 7f5c7b7fe640 1 -- 172.21.15.59:0/1234405116 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11908 (secure 0 0 0) 0x7f5c8009bc10 con 0x7f5c84100a80 2024-09-10T11:13:02.228 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:13:02.228 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"btime":"2024-09-10T11:05:23:624211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2132184928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2132184928},{"type":"v1","addr":"172.21.15.59:6835","nonce":2132184928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/138342907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":138342907},{"type":"v1","addr":"172.21.15.59:6837","nonce":138342907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/1687951839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":1687951839},{"type":"v1","addr":"172.21.15.59:6839","nonce":1687951839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/2789106247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":2789106247},{"type":"v1","addr":"172.21.15.59:6841","nonce":2789106247}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2390302822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2390302822},{"type":"v1","addr":"172.21.15.181:6833","nonce":2390302822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/293569527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":293569527},{"type":"v1","addr":"172.21.15.115:6833","nonce":293569527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:59:31.833573+0000","modified":"2024-09-10T11:05:23.624187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24470,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3551536786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3551536786},{"type":"v1","addr":"172.21.15.181:6835","nonce":3551536786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6835/3263764144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3263764144},{"type":"v1","addr":"172.21.15.115:6835","nonce":3263764144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.181:6839/262209213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":262209213},{"type":"v1","addr":"172.21.15.181:6839","nonce":262209213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.115:6837/417494518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":417494518},{"type":"v1","addr":"172.21.15.115:6837","nonce":417494518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/411505011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":411505011},{"type":"v1","addr":"172.21.15.115:6839","nonce":411505011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25204":{"gid":25204,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/332556001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":332556001},{"type":"v1","addr":"172.21.15.181:6837","nonce":332556001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24466,24470,24497]},"id":1}]} 2024-09-10T11:13:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 26 2024-09-10T11:13:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c700a2d70 msgr2=0x7f5c700a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c700a2d70 0x7f5c700a5230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c8406b320 tx=0x7f5c74009110 comp rx=0 tx=0).stop 2024-09-10T11:13:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84100a80 msgr2=0x7f5c841992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84100a80 0x7f5c841992b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000c890 tx=0x7f5c8000cc90 comp rx=0 tx=0).stop 2024-09-10T11:13:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 shutdown_connections 2024-09-10T11:13:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f5c700a2d70 0x7f5c700a5230 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c84106a80 0x7f5c841a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c84101420 0x7f5c841997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 --2- 172.21.15.59:0/1234405116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c84100a80 0x7f5c841992b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 >> 172.21.15.59:0/1234405116 conn(0x7f5c840fc7a0 msgr2=0x7f5c840fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 shutdown_connections 2024-09-10T11:13:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:02.229+0000 7f5c8c339640 1 -- 172.21.15.59:0/1234405116 wait complete. 2024-09-10T11:13:02.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:02 smithi181 ceph-mon[35409]: pgmap v363: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T11:13:02.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:02 smithi115 ceph-mon[34719]: pgmap v363: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T11:13:02.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:13:03.208 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:13:03.328 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:03 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1234405116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:13:03.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:03 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1234405116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:13:03.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:03 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1234405116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:13:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.672+0000 7f8ad0261640 1 -- 172.21.15.59:0/871202916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8101de0 msgr2=0x7f8ac81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.672+0000 7f8ad0261640 1 --2- 172.21.15.59:0/871202916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8101de0 0x7f8ac81021c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009900 tx=0x7f8ac402a410 comp rx=0 tx=0).stop 2024-09-10T11:13:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.672+0000 7f8ad0261640 1 -- 172.21.15.59:0/871202916 shutdown_connections 2024-09-10T11:13:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.672+0000 7f8ad0261640 1 --2- 172.21.15.59:0/871202916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ac8106f10 0x7f8ac810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.672+0000 7f8ad0261640 1 --2- 172.21.15.59:0/871202916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8102790 0x7f8ac81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.672+0000 7f8ad0261640 1 --2- 172.21.15.59:0/871202916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8101de0 0x7f8ac81021c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.672+0000 7f8ad0261640 1 -- 172.21.15.59:0/871202916 >> 172.21.15.59:0/871202916 conn(0x7f8ac80fd8c0 msgr2=0x7f8ac80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.672+0000 7f8ad0261640 1 -- 172.21.15.59:0/871202916 shutdown_connections 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.672+0000 7f8ad0261640 1 -- 172.21.15.59:0/871202916 wait complete. 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8ad0261640 1 Processor -- start 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8ad0261640 1 -- start start 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8ad0261640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ac8101de0 0x7f8ac819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8ad0261640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8102790 0x7f8ac819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8ad0261640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8106f10 0x7f8ac819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8ad0261640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8111fc0 con 0x7f8ac8102790 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8ad0261640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8111e40 con 0x7f8ac8106f10 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8ad0261640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8112140 con 0x7f8ac8101de0 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8acd7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8102790 0x7f8ac819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8acd7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8102790 0x7f8ac819ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45406/0 (socket says 172.21.15.59:45406) 2024-09-10T11:13:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.673+0000 7f8acd7fc640 1 -- 172.21.15.59:0/1540200287 learned_addr learned my addr 172.21.15.59:0/1540200287 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8acdffd640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ac8101de0 0x7f8ac819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8ace7fe640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8106f10 0x7f8ac819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8acd7fc640 1 -- 172.21.15.59:0/1540200287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ac8101de0 msgr2=0x7f8ac819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8acd7fc640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ac8101de0 0x7f8ac819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8acd7fc640 1 -- 172.21.15.59:0/1540200287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8106f10 msgr2=0x7f8ac819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8acd7fc640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8106f10 0x7f8ac819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8acd7fc640 1 -- 172.21.15.59:0/1540200287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac819f670 con 0x7f8ac8102790 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8acdffd640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ac8101de0 0x7f8ac819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8acd7fc640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8102790 0x7f8ac819ac00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c890 tx=0x7f8ab800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8abeffd640 1 -- 172.21.15.59:0/1540200287 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8004220 con 0x7f8ac8102790 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8abeffd640 1 -- 172.21.15.59:0/1540200287 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab80043c0 con 0x7f8ac8102790 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8abeffd640 1 -- 172.21.15.59:0/1540200287 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80049e0 con 0x7f8ac8102790 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac819f960 con 0x7f8ac8102790 2024-09-10T11:13:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.674+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac81a7240 con 0x7f8ac8102790 2024-09-10T11:13:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.675+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac81021c0 con 0x7f8ac8102790 2024-09-10T11:13:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.676+0000 7f8abeffd640 1 -- 172.21.15.59:0/1540200287 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8ab80079b0 con 0x7f8ac8102790 2024-09-10T11:13:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.677+0000 7f8abeffd640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8ab40a2cf0 0x7f8ab40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.677+0000 7f8acdffd640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8ab40a2cf0 0x7f8ab40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.677+0000 7f8abeffd640 1 -- 172.21.15.59:0/1540200287 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f8ab80cf5e0 con 0x7f8ac8102790 2024-09-10T11:13:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.677+0000 7f8acdffd640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8ab40a2cf0 0x7f8ab40a51b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4000c00 tx=0x7f8ac4005a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.680+0000 7f8abeffd640 1 -- 172.21.15.59:0/1540200287 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ab8014030 con 0x7f8ac8102790 2024-09-10T11:13:03.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.858+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ac819ba20 con 0x7f8ac8102790 2024-09-10T11:13:03.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.859+0000 7f8abeffd640 1 -- 172.21.15.59:0/1540200287 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+23299 (secure 0 0 0) 0x7f8ab809c1b0 con 0x7f8ac8102790 2024-09-10T11:13:03.860 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T11:13:03.860 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":97,"fsid":"86a09b02-6f62-11ef-bcea-c7b262605968","created":"2024-09-10T10:51:53.731664+0000","modified":"2024-09-10T11:12:13.722673+0000","last_up_change":"2024-09-10T10:58:39.088886+0000","last_in_change":"2024-09-10T10:58:15.220679+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:54:53.126290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:59:27.480743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:59:30.088912+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"17d70faa-a04c-428f-ae18-c14cdf3c0b59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6803","nonce":1643826067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6805","nonce":1643826067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6809","nonce":1643826067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1643826067},{"type":"v1","addr":"172.21.15.59:6807","nonce":1643826067}]},"public_addr":"172.21.15.59:6803/1643826067","cluster_addr":"172.21.15.59:6805/1643826067","heartbeat_back_addr":"172.21.15.59:6809/1643826067","heartbeat_front_addr":"172.21.15.59:6807/1643826067","state":["exists","up"]},{"osd":1,"uuid":"9c24fb3f-6b90-4376-8c91-898c13e55505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6801","nonce":2214288825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6803","nonce":2214288825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6807","nonce":2214288825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2214288825},{"type":"v1","addr":"172.21.15.115:6805","nonce":2214288825}]},"public_addr":"172.21.15.115:6801/2214288825","cluster_addr":"172.21.15.115:6803/2214288825","heartbeat_back_addr":"172.21.15.115:6807/2214288825","heartbeat_front_addr":"172.21.15.115:6805/2214288825","state":["exists","up"]},{"osd":2,"uuid":"fedd246c-4643-4cd5-85be-47b00e3c5660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6801","nonce":1826637197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6803","nonce":1826637197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6807","nonce":1826637197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1826637197},{"type":"v1","addr":"172.21.15.181:6805","nonce":1826637197}]},"public_addr":"172.21.15.181:6801/1826637197","cluster_addr":"172.21.15.181:6803/1826637197","heartbeat_back_addr":"172.21.15.181:6807/1826637197","heartbeat_front_addr":"172.21.15.181:6805/1826637197","state":["exists","up"]},{"osd":3,"uuid":"22cc5420-33ee-4291-a301-5e6ff7511d91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6811","nonce":1709553083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6813","nonce":1709553083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6817","nonce":1709553083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1709553083},{"type":"v1","addr":"172.21.15.59:6815","nonce":1709553083}]},"public_addr":"172.21.15.59:6811/1709553083","cluster_addr":"172.21.15.59:6813/1709553083","heartbeat_back_addr":"172.21.15.59:6817/1709553083","heartbeat_front_addr":"172.21.15.59:6815/1709553083","state":["exists","up"]},{"osd":4,"uuid":"c1a99b0b-8b83-41b7-b6f9-400eabf3ea39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6809","nonce":65991145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6811","nonce":65991145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6815","nonce":65991145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":65991145},{"type":"v1","addr":"172.21.15.115:6813","nonce":65991145}]},"public_addr":"172.21.15.115:6809/65991145","cluster_addr":"172.21.15.115:6811/65991145","heartbeat_back_addr":"172.21.15.115:6815/65991145","heartbeat_front_addr":"172.21.15.115:6813/65991145","state":["exists","up"]},{"osd":5,"uuid":"68fcd4ce-1e00-4bf4-b0d9-78798dc5ad48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6809","nonce":361358873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6811","nonce":361358873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6815","nonce":361358873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":361358873},{"type":"v1","addr":"172.21.15.181:6813","nonce":361358873}]},"public_addr":"172.21.15.181:6809/361358873","cluster_addr":"172.21.15.181:6811/361358873","heartbeat_back_addr":"172.21.15.181:6815/361358873","heartbeat_front_addr":"172.21.15.181:6813/361358873","state":["exists","up"]},{"osd":6,"uuid":"39256edb-3181-4fa3-95c6-edecfc3b605c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6819","nonce":1773461334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6821","nonce":1773461334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6825","nonce":1773461334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1773461334},{"type":"v1","addr":"172.21.15.59:6823","nonce":1773461334}]},"public_addr":"172.21.15.59:6819/1773461334","cluster_addr":"172.21.15.59:6821/1773461334","heartbeat_back_addr":"172.21.15.59:6825/1773461334","heartbeat_front_addr":"172.21.15.59:6823/1773461334","state":["exists","up"]},{"osd":7,"uuid":"9149fe7e-5a85-4a89-b5f7-e8724e7a392b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6817","nonce":3436962956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6819","nonce":3436962956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6823","nonce":3436962956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":3436962956},{"type":"v1","addr":"172.21.15.115:6821","nonce":3436962956}]},"public_addr":"172.21.15.115:6817/3436962956","cluster_addr":"172.21.15.115:6819/3436962956","heartbeat_back_addr":"172.21.15.115:6823/3436962956","heartbeat_front_addr":"172.21.15.115:6821/3436962956","state":["exists","up"]},{"osd":8,"uuid":"a4860b6b-96d8-4cae-9ee5-53b84fc6be7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6817","nonce":2351101787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6819","nonce":2351101787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6823","nonce":2351101787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2351101787},{"type":"v1","addr":"172.21.15.181:6821","nonce":2351101787}]},"public_addr":"172.21.15.181:6817/2351101787","cluster_addr":"172.21.15.181:6819/2351101787","heartbeat_back_addr":"172.21.15.181:6823/2351101787","heartbeat_front_addr":"172.21.15.181:6821/2351101787","state":["exists","up"]},{"osd":9,"uuid":"a48ed7c2-30e4-479c-a001-2da89d462ccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6827","nonce":144353588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6829","nonce":144353588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6833","nonce":144353588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":144353588},{"type":"v1","addr":"172.21.15.59:6831","nonce":144353588}]},"public_addr":"172.21.15.59:6827/144353588","cluster_addr":"172.21.15.59:6829/144353588","heartbeat_back_addr":"172.21.15.59:6833/144353588","heartbeat_front_addr":"172.21.15.59:6831/144353588","state":["exists","up"]},{"osd":10,"uuid":"5553312e-2251-488e-b97a-1d203ecd2403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6825","nonce":601478460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6827","nonce":601478460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6831","nonce":601478460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":601478460},{"type":"v1","addr":"172.21.15.115:6829","nonce":601478460}]},"public_addr":"172.21.15.115:6825/601478460","cluster_addr":"172.21.15.115:6827/601478460","heartbeat_back_addr":"172.21.15.115:6831/601478460","heartbeat_front_addr":"172.21.15.115:6829/601478460","state":["exists","up"]},{"osd":11,"uuid":"c6a4c40e-8d21-4145-b284-efb8ba4e8fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6825","nonce":746086660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6827","nonce":746086660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6831","nonce":746086660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":746086660},{"type":"v1","addr":"172.21.15.181:6829","nonce":746086660}]},"public_addr":"172.21.15.181:6825/746086660","cluster_addr":"172.21.15.181:6827/746086660","heartbeat_back_addr":"172.21.15.181:6831/746086660","heartbeat_front_addr":"172.21.15.181:6829/746086660","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:00.511831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:24.973421+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:54:49.952462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:16.060046+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:55:41.183399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:05.534666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:31.361930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:56:56.230460+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:21.303636+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:57:46.450218+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:12.102160+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:58:37.102010+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/2735068879":"2024-09-11T11:01:22.217825+0000","172.21.15.59:6800/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/1311671881":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3094540037":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/3551787843":"2024-09-11T10:52:38.625589+0000","172.21.15.59:0/3813830687":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2362644310":"2024-09-11T11:01:22.217825+0000","172.21.15.59:6801/3145930564":"2024-09-11T11:01:22.217825+0000","172.21.15.59:0/3172621917":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/4100202670":"2024-09-11T10:52:15.554183+0000","172.21.15.59:0/2924034396":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6801/3293737690":"2024-09-11T10:52:38.625589+0000","172.21.15.59:6800/3145930564":"2024-09-11T11:01:22.217825+0000","172.21.15.59:0/626509906":"2024-09-11T11:01:22.217825+0000","172.21.15.59:0/2665068071":"2024-09-11T11:01:22.217825+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:13:03.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8ab40a2cf0 msgr2=0x7f8ab40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8ab40a2cf0 0x7f8ab40a51b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4000c00 tx=0x7f8ac4005a40 comp rx=0 tx=0).stop 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8102790 msgr2=0x7f8ac819ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8102790 0x7f8ac819ac00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c890 tx=0x7f8ab800cd50 comp rx=0 tx=0).stop 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 shutdown_connections 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ac8106f10 0x7f8ac819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac8102790 0x7f8ac819ac00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f8ab40a2cf0 0x7f8ab40a51b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 --2- 172.21.15.59:0/1540200287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8ac8101de0 0x7f8ac819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 >> 172.21.15.59:0/1540200287 conn(0x7f8ac80fd8c0 msgr2=0x7f8ac80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 shutdown_connections 2024-09-10T11:13:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:03.862+0000 7f8ad0261640 1 -- 172.21.15.59:0/1540200287 wait complete. 2024-09-10T11:13:04.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:04 smithi059 ceph-mon[30978]: pgmap v364: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T11:13:04.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:04 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/1540200287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:13:04.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:04 smithi181 ceph-mon[35409]: pgmap v364: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T11:13:04.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:04 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/1540200287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:13:04.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:04 smithi115 ceph-mon[34719]: pgmap v364: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T11:13:04.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:04 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/1540200287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:13:04.656 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T11:13:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:13:05.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.432+0000 7f7371a9a640 1 -- 172.21.15.59:0/1015972322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c106f10 msgr2=0x7f736c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.432+0000 7f7371a9a640 1 --2- 172.21.15.59:0/1015972322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c106f10 0x7f736c10ea90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7364009ca0 tx=0x7f736402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.432+0000 7f7371a9a640 1 -- 172.21.15.59:0/1015972322 shutdown_connections 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.432+0000 7f7371a9a640 1 --2- 172.21.15.59:0/1015972322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c106f10 0x7f736c10ea90 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.432+0000 7f7371a9a640 1 --2- 172.21.15.59:0/1015972322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f736c102790 0x7f736c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.432+0000 7f7371a9a640 1 --2- 172.21.15.59:0/1015972322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f736c101de0 0x7f736c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.432+0000 7f7371a9a640 1 -- 172.21.15.59:0/1015972322 >> 172.21.15.59:0/1015972322 conn(0x7f736c0fd8c0 msgr2=0x7f736c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.432+0000 7f7371a9a640 1 -- 172.21.15.59:0/1015972322 shutdown_connections 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.432+0000 7f7371a9a640 1 -- 172.21.15.59:0/1015972322 wait complete. 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f7371a9a640 1 Processor -- start 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f7371a9a640 1 -- start start 2024-09-10T11:13:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f7371a9a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f736c101de0 0x7f736c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f7371a9a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c102790 0x7f736c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f7371a9a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f736c106f10 0x7f736c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f7371a9a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f736c111f70 con 0x7f736c102790 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f7371a9a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f736c111df0 con 0x7f736c106f10 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f7371a9a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1120f0 con 0x7f736c101de0 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f736affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c102790 0x7f736c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f736affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c102790 0x7f736c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45428/0 (socket says 172.21.15.59:45428) 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f736affd640 1 -- 172.21.15.59:0/2421441445 learned_addr learned my addr 172.21.15.59:0/2421441445 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f736bfff640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f736c106f10 0x7f736c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.433+0000 7f736b7fe640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f736c101de0 0x7f736c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f736affd640 1 -- 172.21.15.59:0/2421441445 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f736c101de0 msgr2=0x7f736c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f736affd640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f736c101de0 0x7f736c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f736affd640 1 -- 172.21.15.59:0/2421441445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f736c106f10 msgr2=0x7f736c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f736affd640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f736c106f10 0x7f736c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f736affd640 1 -- 172.21.15.59:0/2421441445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c19d380 con 0x7f736c102790 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f736affd640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c102790 0x7f736c198910 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f736000d950 tx=0x7f736000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f7368ff9640 1 -- 172.21.15.59:0/2421441445 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360017070 con 0x7f736c102790 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f7368ff9640 1 -- 172.21.15.59:0/2421441445 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7360009c30 con 0x7f736c102790 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f7368ff9640 1 -- 172.21.15.59:0/2421441445 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736000f6b0 con 0x7f736c102790 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c19d670 con 0x7f736c102790 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.434+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c1a4f50 con 0x7f736c102790 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.435+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f736c1021c0 con 0x7f736c102790 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.436+0000 7f7368ff9640 1 -- 172.21.15.59:0/2421441445 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f73600109d0 con 0x7f736c102790 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.437+0000 7f7368ff9640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73540a2d70 0x7f73540a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:05.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.437+0000 7f7368ff9640 1 -- 172.21.15.59:0/2421441445 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f73600cef40 con 0x7f736c102790 2024-09-10T11:13:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.437+0000 7f736b7fe640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73540a2d70 0x7f73540a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.437+0000 7f736b7fe640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73540a2d70 0x7f73540a5230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f735c00bbe0 tx=0x7f735c00b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:05.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.441+0000 7f7368ff9640 1 -- 172.21.15.59:0/2421441445 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7360009de0 con 0x7f736c102790 2024-09-10T11:13:05.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.655+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f736c10a150 con 0x7f736c102790 2024-09-10T11:13:05.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.657+0000 7f7368ff9640 1 -- 172.21.15.59:0/2421441445 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f736009b4c0 con 0x7f736c102790 2024-09-10T11:13:05.658 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73540a2d70 msgr2=0x7f73540a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73540a2d70 0x7f73540a5230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f735c00bbe0 tx=0x7f735c00b390 comp rx=0 tx=0).stop 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c102790 msgr2=0x7f736c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c102790 0x7f736c198910 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f736000d950 tx=0x7f736000de10 comp rx=0 tx=0).stop 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 shutdown_connections 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f736c106f10 0x7f736c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f736c102790 0x7f736c198910 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f73540a2d70 0x7f73540a5230 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 --2- 172.21.15.59:0/2421441445 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f736c101de0 0x7f736c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 >> 172.21.15.59:0/2421441445 conn(0x7f736c0fd8c0 msgr2=0x7f736c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 shutdown_connections 2024-09-10T11:13:05.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:05.660+0000 7f7371a9a640 1 -- 172.21.15.59:0/2421441445 wait complete. 2024-09-10T11:13:05.958 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b[65348]: ignoring --setuser ceph since I am not root 2024-09-10T11:13:05.958 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b[65348]: ignoring --setgroup ceph since I am not root 2024-09-10T11:13:05.958 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-mds[65352]: -- 172.21.15.115:0/1378869410 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559ebd7b5c20 con 0x559ebd793000 2024-09-10T11:13:05.959 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b[65348]: starting mds.b at 2024-09-10T11:13:05.959 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h[65035]: ignoring --setuser ceph since I am not root 2024-09-10T11:13:05.959 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h[65035]: ignoring --setgroup ceph since I am not root 2024-09-10T11:13:05.959 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-mds[65039]: -- 172.21.15.115:0/2676588363 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56538fa59860 con 0x56538fa36800 2024-09-10T11:13:05.959 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h[65035]: starting mds.h at 2024-09-10T11:13:05.959 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e[64734]: ignoring --setuser ceph since I am not root 2024-09-10T11:13:05.959 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e[64734]: ignoring --setgroup ceph since I am not root 2024-09-10T11:13:05.960 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-mds[64738]: -- 172.21.15.115:0/2189852044 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564a5b241860 con 0x564a5b21e800 2024-09-10T11:13:05.960 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:13:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e[64734]: starting mds.e at 2024-09-10T11:13:06.029 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:05 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a[30974]: 2024-09-10T11:13:05.656+0000 7f82cf5f4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T11:13:06.083 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f[65704]: ignoring --setuser ceph since I am not root 2024-09-10T11:13:06.083 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f[65704]: ignoring --setgroup ceph since I am not root 2024-09-10T11:13:06.083 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-mds[65708]: -- 172.21.15.181:0/1451714680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f6083e1860 con 0x55f6083be800 2024-09-10T11:13:06.083 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f[65704]: starting mds.f at 2024-09-10T11:13:06.084 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i[66304]: ignoring --setuser ceph since I am not root 2024-09-10T11:13:06.084 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i[66304]: ignoring --setgroup ceph since I am not root 2024-09-10T11:13:06.084 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-mds[66308]: -- 172.21.15.181:0/1983574494 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e367befc20 con 0x55e367bcd400 2024-09-10T11:13:06.084 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i[66304]: starting mds.i at 2024-09-10T11:13:06.084 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c[66006]: ignoring --setuser ceph since I am not root 2024-09-10T11:13:06.084 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c[66006]: ignoring --setgroup ceph since I am not root 2024-09-10T11:13:06.084 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-mds[66010]: -- 172.21.15.181:0/2756632652 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5618e3fc3860 con 0x5618e3fa0800 2024-09-10T11:13:06.084 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:13:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c[66006]: starting mds.c at 2024-09-10T11:13:06.347 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:06 smithi059 ceph-mon[30978]: pgmap v365: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 KiB/s wr, 26 op/s 2024-09-10T11:13:06.347 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:06 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2421441445' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T11:13:06.347 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:06 smithi059 ceph-mon[30978]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T11:13:06.347 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:06 smithi059 ceph-mon[30978]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T11:13:06.347 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:06 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2421441445' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T11:13:06.347 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:06 smithi059 ceph-mon[30978]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T11:13:06.348 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:06 smithi059 ceph-mon[30978]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T11:13:06.380 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T11:13:06.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:06 smithi181 ceph-mon[35409]: pgmap v365: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 KiB/s wr, 26 op/s 2024-09-10T11:13:06.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:06 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2421441445' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T11:13:06.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:06 smithi181 ceph-mon[35409]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T11:13:06.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:06 smithi181 ceph-mon[35409]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T11:13:06.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:06 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2421441445' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T11:13:06.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:06 smithi181 ceph-mon[35409]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T11:13:06.437 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:06 smithi181 ceph-mon[35409]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T11:13:06.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:06 smithi115 ceph-mon[34719]: pgmap v365: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 KiB/s wr, 26 op/s 2024-09-10T11:13:06.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:06 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2421441445' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T11:13:06.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:06 smithi115 ceph-mon[34719]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T11:13:06.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:06 smithi115 ceph-mon[34719]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T11:13:06.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:06 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2421441445' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T11:13:06.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:06 smithi115 ceph-mon[34719]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T11:13:06.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:06 smithi115 ceph-mon[34719]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T11:13:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:13:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.160+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/1883536823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0101420 msgr2=0x7fdcb010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.160+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/1883536823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0101420 0x7fdcb010d950 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009cd0 tx=0x7fdca802a8e0 comp rx=0 tx=0).stop 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.160+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/1883536823 shutdown_connections 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.160+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/1883536823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0101420 0x7fdcb010d950 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.160+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/1883536823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcb0100a80 0x7fdcb0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.160+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/1883536823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb0106a80 0x7fdcb0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.160+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/1883536823 >> 172.21.15.59:0/1883536823 conn(0x7fdcb00fc7a0 msgr2=0x7fdcb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.160+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/1883536823 shutdown_connections 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.160+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/1883536823 wait complete. 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcb5ccb640 1 Processor -- start 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcb5ccb640 1 -- start start 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcb5ccb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb0100a80 0x7fdcb00fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcb5ccb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcb0101420 0x7fdcb00fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcb5ccb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0106a80 0x7fdcb00fd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcb5ccb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb0110e80 con 0x7fdcb0106a80 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcb5ccb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb0110d00 con 0x7fdcb0100a80 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcb5ccb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb0111000 con 0x7fdcb0101420 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcaffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0106a80 0x7fdcb00fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcaffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0106a80 0x7fdcb00fd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60164/0 (socket says 172.21.15.59:60164) 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.161+0000 7fdcaffff640 1 -- 172.21.15.59:0/3120446319 learned_addr learned my addr 172.21.15.59:0/3120446319 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcaf7fe640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb0100a80 0x7fdcb00fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcaeffd640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcb0101420 0x7fdcb00fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcaffff640 1 -- 172.21.15.59:0/3120446319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcb0101420 msgr2=0x7fdcb00fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcaffff640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcb0101420 0x7fdcb00fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcaffff640 1 -- 172.21.15.59:0/3120446319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb0100a80 msgr2=0x7fdcb00fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcaffff640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb0100a80 0x7fdcb00fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:07.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcaffff640 1 -- 172.21.15.59:0/3120446319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb01a6930 con 0x7fdcb0106a80 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcaffff640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0106a80 0x7fdcb00fd810 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdca8005cc0 tx=0x7fdca8032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcacff9640 1 -- 172.21.15.59:0/3120446319 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8004040 con 0x7fdcb0106a80 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcacff9640 1 -- 172.21.15.59:0/3120446319 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdca80046c0 con 0x7fdcb0106a80 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb01a6bc0 con 0x7fdcb0106a80 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcacff9640 1 -- 172.21.15.59:0/3120446319 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8030e00 con 0x7fdcb0106a80 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.162+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb01a7150 con 0x7fdcb0106a80 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.163+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb0100ee0 con 0x7fdcb0106a80 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.164+0000 7fdcacff9640 1 -- 172.21.15.59:0/3120446319 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fdca80305a0 con 0x7fdcb0106a80 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.165+0000 7fdcacff9640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc980a2d70 0x7fdc980a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.165+0000 7fdcacff9640 1 -- 172.21.15.59:0/3120446319 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8814+0+0 (secure 0 0 0) 0x7fdca802e030 con 0x7fdcb0106a80 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.165+0000 7fdcaf7fe640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc980a2d70 0x7fdc980a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.166+0000 7fdcaf7fe640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc980a2d70 0x7fdc980a5230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009b50 tx=0x7fdca0005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.169+0000 7fdcacff9640 1 -- 172.21.15.59:0/3120446319 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdca804b060 con 0x7fdcb0106a80 2024-09-10T11:13:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:07.381+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdcb010a000 con 0x7fdcb0106a80 2024-09-10T11:13:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: pgmap v367: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-09-10T11:13:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.181:6834/1881518578,v1:172.21.15.181:6835/1881518578] up:boot 2024-09-10T11:13:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.115:6834/3822399299,v1:172.21.15.115:6835/3822399299] up:boot 2024-09-10T11:13:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.115:6836/529931673,v1:172.21.15.115:6837/529931673] up:boot 2024-09-10T11:13:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.181:6836/2062886414,v1:172.21.15.181:6838/2062886414] up:boot 2024-09-10T11:13:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.115:6838/3768536249,v1:172.21.15.115:6839/3768536249] up:boot 2024-09-10T11:13:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: mds.? [v2:172.21.15.181:6837/698064181,v1:172.21.15.181:6839/698064181] up:boot 2024-09-10T11:13:07.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T11:13:07.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:13:07.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:13:07.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:13:07.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:13:07.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:13:07.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:13:07.938 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:07 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3120446319' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:13:07.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: pgmap v367: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-09-10T11:13:07.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.181:6834/1881518578,v1:172.21.15.181:6835/1881518578] up:boot 2024-09-10T11:13:07.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.115:6834/3822399299,v1:172.21.15.115:6835/3822399299] up:boot 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.115:6836/529931673,v1:172.21.15.115:6837/529931673] up:boot 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.181:6836/2062886414,v1:172.21.15.181:6838/2062886414] up:boot 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.115:6838/3768536249,v1:172.21.15.115:6839/3768536249] up:boot 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: mds.? [v2:172.21.15.181:6837/698064181,v1:172.21.15.181:6839/698064181] up:boot 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:13:07.959 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:07 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3120446319' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:13:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.088+0000 7fdcacff9640 1 -- 172.21.15.59:0/3120446319 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7fdca80bd7c0 con 0x7fdcb0106a80 2024-09-10T11:13:08.089 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: pgmap v367: 97 pgs: 97 active+clean; 2.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-09-10T11:13:08.089 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.181:6834/1881518578,v1:172.21.15.181:6835/1881518578] up:boot 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.115:6834/3822399299,v1:172.21.15.115:6835/3822399299] up:boot 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.115:6836/529931673,v1:172.21.15.115:6837/529931673] up:boot 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.181:6836/2062886414,v1:172.21.15.181:6838/2062886414] up:boot 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.115:6838/3768536249,v1:172.21.15.115:6839/3768536249] up:boot 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: mds.? [v2:172.21.15.181:6837/698064181,v1:172.21.15.181:6839/698064181] up:boot 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: from='mgr.15132 172.21.15.59:0/2869986468' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:13:08.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:07 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3120446319' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:13:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.091+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc980a2d70 msgr2=0x7fdc980a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.091+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc980a2d70 0x7fdc980a5230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009b50 tx=0x7fdca0005f90 comp rx=0 tx=0).stop 2024-09-10T11:13:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.091+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0106a80 msgr2=0x7fdcb00fd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.091+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0106a80 0x7fdcb00fd810 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdca8005cc0 tx=0x7fdca8032f40 comp rx=0 tx=0).stop 2024-09-10T11:13:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.092+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 shutdown_connections 2024-09-10T11:13:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.092+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcb0106a80 0x7fdcb00fd810 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.092+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fdc980a2d70 0x7fdc980a5230 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.092+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdcb0101420 0x7fdcb00fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.092+0000 7fdcb5ccb640 1 --2- 172.21.15.59:0/3120446319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb0100a80 0x7fdcb00fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.092+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 >> 172.21.15.59:0/3120446319 conn(0x7fdcb00fc7a0 msgr2=0x7fdcb006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.092+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 shutdown_connections 2024-09-10T11:13:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:08.092+0000 7fdcb5ccb640 1 -- 172.21.15.59:0/3120446319 wait complete. 2024-09-10T11:13:08.739 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:08 smithi059 ceph-mon[30978]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T11:13:08.739 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:08 smithi059 ceph-mon[30978]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T11:13:08.739 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:08 smithi059 ceph-mon[30978]: Cluster is now healthy 2024-09-10T11:13:08.739 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:08 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3120446319' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T11:13:08.740 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:08 smithi059 ceph-mon[30978]: fsmap 12 up:standby 2024-09-10T11:13:08.773 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T11:13:08.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:08 smithi181 ceph-mon[35409]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T11:13:08.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:08 smithi181 ceph-mon[35409]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T11:13:08.936 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:08 smithi181 ceph-mon[35409]: Cluster is now healthy 2024-09-10T11:13:08.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:08 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3120446319' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T11:13:08.937 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:08 smithi181 ceph-mon[35409]: fsmap 12 up:standby 2024-09-10T11:13:08.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:08 smithi115 ceph-mon[34719]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T11:13:08.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:08 smithi115 ceph-mon[34719]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T11:13:08.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:08 smithi115 ceph-mon[34719]: Cluster is now healthy 2024-09-10T11:13:08.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:08 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3120446319' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T11:13:08.958 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:08 smithi115 ceph-mon[34719]: fsmap 12 up:standby 2024-09-10T11:13:09.033 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:13:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.571+0000 7fe8ae914640 1 -- 172.21.15.59:0/4152302401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8104e80 msgr2=0x7fe8a8105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.571+0000 7fe8ae914640 1 --2- 172.21.15.59:0/4152302401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8104e80 0x7fe8a8105330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009ca0 tx=0x7fe8a002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:13:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.571+0000 7fe8ae914640 1 -- 172.21.15.59:0/4152302401 shutdown_connections 2024-09-10T11:13:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.571+0000 7fe8ae914640 1 --2- 172.21.15.59:0/4152302401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8104e80 0x7fe8a8105330 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.571+0000 7fe8ae914640 1 --2- 172.21.15.59:0/4152302401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a806a370 0x7fe8a81009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.571+0000 7fe8ae914640 1 --2- 172.21.15.59:0/4152302401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a8069f00 0x7fe8a8100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.571+0000 7fe8ae914640 1 -- 172.21.15.59:0/4152302401 >> 172.21.15.59:0/4152302401 conn(0x7fe8a8077210 msgr2=0x7fe8a80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.571+0000 7fe8ae914640 1 -- 172.21.15.59:0/4152302401 shutdown_connections 2024-09-10T11:13:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.571+0000 7fe8ae914640 1 -- 172.21.15.59:0/4152302401 wait complete. 2024-09-10T11:13:09.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8ae914640 1 Processor -- start 2024-09-10T11:13:09.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8ae914640 1 -- start start 2024-09-10T11:13:09.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8ae914640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8069f00 0x7fe8a819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:09.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8ae914640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a806a370 0x7fe8a819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:09.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8ae914640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a8104e80 0x7fe8a819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:09.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8ae914640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a8110e70 con 0x7fe8a8069f00 2024-09-10T11:13:09.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8ae914640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a8110cf0 con 0x7fe8a8104e80 2024-09-10T11:13:09.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8ae914640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a8110ff0 con 0x7fe8a806a370 2024-09-10T11:13:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8a7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8069f00 0x7fe8a819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8a7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8069f00 0x7fe8a819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60178/0 (socket says 172.21.15.59:60178) 2024-09-10T11:13:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe8a7fff640 1 -- 172.21.15.59:0/2726397577 learned_addr learned my addr 172.21.15.59:0/2726397577 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:13:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.572+0000 7fe89ffff640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a806a370 0x7fe8a819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8aceb1640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a8104e80 0x7fe8a819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8a7fff640 1 -- 172.21.15.59:0/2726397577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a806a370 msgr2=0x7fe8a819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8a7fff640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a806a370 0x7fe8a819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8a7fff640 1 -- 172.21.15.59:0/2726397577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a8104e80 msgr2=0x7fe8a819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8a7fff640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a8104e80 0x7fe8a819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8a7fff640 1 -- 172.21.15.59:0/2726397577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a819f570 con 0x7fe8a8069f00 2024-09-10T11:13:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe89ffff640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a806a370 0x7fe8a819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:13:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8a7fff640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8069f00 0x7fe8a819a5c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe89800d770 tx=0x7fe89800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8a5ffb640 1 -- 172.21.15.59:0/2726397577 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898017070 con 0x7fe8a8069f00 2024-09-10T11:13:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8a5ffb640 1 -- 172.21.15.59:0/2726397577 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe898005500 con 0x7fe8a8069f00 2024-09-10T11:13:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a819f860 con 0x7fe8a8069f00 2024-09-10T11:13:09.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8a5ffb640 1 -- 172.21.15.59:0/2726397577 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898004e00 con 0x7fe8a8069f00 2024-09-10T11:13:09.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.573+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a81a7140 con 0x7fe8a8069f00 2024-09-10T11:13:09.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.574+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a8105330 con 0x7fe8a8069f00 2024-09-10T11:13:09.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.575+0000 7fe8a5ffb640 1 -- 172.21.15.59:0/2726397577 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe898004fa0 con 0x7fe8a8069f00 2024-09-10T11:13:09.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.576+0000 7fe8a5ffb640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe8940a2d70 0x7fe8940a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:09.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.576+0000 7fe8a5ffb640 1 -- 172.21.15.59:0/2726397577 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8814+0+0 (secure 0 0 0) 0x7fe8980cee90 con 0x7fe8a8069f00 2024-09-10T11:13:09.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.576+0000 7fe89ffff640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe8940a2d70 0x7fe8940a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:09.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.577+0000 7fe89ffff640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe8940a2d70 0x7fe8940a5230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8102f30 tx=0x7fe89000a2d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:09.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.580+0000 7fe8a5ffb640 1 -- 172.21.15.59:0/2726397577 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe89809b340 con 0x7fe8a8069f00 2024-09-10T11:13:09.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:09.757+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8a80fdcd0 con 0x7fe8a8069f00 2024-09-10T11:13:10.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.100+0000 7fe8a5ffb640 1 -- 172.21.15.59:0/2726397577 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) ==== 181+0+0 (secure 0 0 0) 0x7fe89809f640 con 0x7fe8a8069f00 2024-09-10T11:13:10.101 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-09-10T11:13:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe8940a2d70 msgr2=0x7fe8940a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe8940a2d70 0x7fe8940a5230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8102f30 tx=0x7fe89000a2d0 comp rx=0 tx=0).stop 2024-09-10T11:13:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8069f00 msgr2=0x7fe8a819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8069f00 0x7fe8a819a5c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe89800d770 tx=0x7fe89800dc30 comp rx=0 tx=0).stop 2024-09-10T11:13:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 shutdown_connections 2024-09-10T11:13:10.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a8104e80 0x7fe8a819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7fe8940a2d70 0x7fe8940a5230 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a806a370 0x7fe8a819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 --2- 172.21.15.59:0/2726397577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8a8069f00 0x7fe8a819a5c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 >> 172.21.15.59:0/2726397577 conn(0x7fe8a8077210 msgr2=0x7fe8a810d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 shutdown_connections 2024-09-10T11:13:10.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:10.102+0000 7fe8ae914640 1 -- 172.21.15.59:0/2726397577 wait complete. 2024-09-10T11:13:10.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:10 smithi059 ceph-mon[30978]: pgmap v368: 97 pgs: 97 active+clean; 2.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-10T11:13:10.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:10 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2726397577' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:13:10.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:10 smithi181 ceph-mon[35409]: pgmap v368: 97 pgs: 97 active+clean; 2.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-10T11:13:10.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:10 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2726397577' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:13:10.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:10 smithi115 ceph-mon[34719]: pgmap v368: 97 pgs: 97 active+clean; 2.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-10T11:13:10.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:10 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2726397577' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:13:10.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T11:13:11.098 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:13:11.374 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:11 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/2726397577' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:13:11.374 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:11 smithi059 ceph-mon[30978]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T11:13:11.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:11 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/2726397577' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:13:11.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:11 smithi181 ceph-mon[35409]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T11:13:11.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:11 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/2726397577' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:13:11.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:11 smithi115 ceph-mon[34719]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T11:13:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.616+0000 7f189b0af640 1 -- 172.21.15.59:0/2137835900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894106f10 msgr2=0x7f189410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.616+0000 7f189b0af640 1 --2- 172.21.15.59:0/2137835900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894106f10 0x7f189410ea90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f188c009ca0 tx=0x7f188c02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:13:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.616+0000 7f189b0af640 1 -- 172.21.15.59:0/2137835900 shutdown_connections 2024-09-10T11:13:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.616+0000 7f189b0af640 1 --2- 172.21.15.59:0/2137835900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894106f10 0x7f189410ea90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.616+0000 7f189b0af640 1 --2- 172.21.15.59:0/2137835900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1894102790 0x7f18941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.616+0000 7f189b0af640 1 --2- 172.21.15.59:0/2137835900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1894101de0 0x7f18941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.616+0000 7f189b0af640 1 -- 172.21.15.59:0/2137835900 >> 172.21.15.59:0/2137835900 conn(0x7f18940fd8c0 msgr2=0x7f18940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.616+0000 7f189b0af640 1 -- 172.21.15.59:0/2137835900 shutdown_connections 2024-09-10T11:13:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.616+0000 7f189b0af640 1 -- 172.21.15.59:0/2137835900 wait complete. 2024-09-10T11:13:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189b0af640 1 Processor -- start 2024-09-10T11:13:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189b0af640 1 -- start start 2024-09-10T11:13:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189b0af640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894101de0 0x7f18940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189b0af640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1894102790 0x7f1894074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189b0af640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1894106f10 0x7f1894074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189b0af640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1894111f70 con 0x7f1894101de0 2024-09-10T11:13:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189b0af640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1894111df0 con 0x7f1894102790 2024-09-10T11:13:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189b0af640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f18941120f0 con 0x7f1894106f10 2024-09-10T11:13:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1898e4b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894101de0 0x7f18940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1898e4b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894101de0 0x7f18940744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60208/0 (socket says 172.21.15.59:60208) 2024-09-10T11:13:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1898e4b640 1 -- 172.21.15.59:0/3239260450 learned_addr learned my addr 172.21.15.59:0/3239260450 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T11:13:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1893fff640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1894102790 0x7f1894074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189964c640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1894106f10 0x7f1894074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1898e4b640 1 -- 172.21.15.59:0/3239260450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1894106f10 msgr2=0x7f1894074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1898e4b640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1894106f10 0x7f1894074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1898e4b640 1 -- 172.21.15.59:0/3239260450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1894102790 msgr2=0x7f1894074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1898e4b640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1894102790 0x7f1894074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1898e4b640 1 -- 172.21.15.59:0/3239260450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18941a6850 con 0x7f1894101de0 2024-09-10T11:13:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f189964c640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1894106f10 0x7f1894074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:13:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.617+0000 7f1898e4b640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894101de0 0x7f18940744f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f188800c920 tx=0x7f188800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.618+0000 7f1891ffb640 1 -- 172.21.15.59:0/3239260450 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888007c70 con 0x7f1894101de0 2024-09-10T11:13:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.618+0000 7f1891ffb640 1 -- 172.21.15.59:0/3239260450 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1888007e10 con 0x7f1894101de0 2024-09-10T11:13:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.618+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18941a6b40 con 0x7f1894101de0 2024-09-10T11:13:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.618+0000 7f1891ffb640 1 -- 172.21.15.59:0/3239260450 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888018890 con 0x7f1894101de0 2024-09-10T11:13:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.618+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18941a7080 con 0x7f1894101de0 2024-09-10T11:13:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.619+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18941021c0 con 0x7f1894101de0 2024-09-10T11:13:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.620+0000 7f1891ffb640 1 -- 172.21.15.59:0/3239260450 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1888018a70 con 0x7f1894101de0 2024-09-10T11:13:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.620+0000 7f1891ffb640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f18840a2cf0 0x7f18840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:13:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.621+0000 7f1893fff640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f18840a2cf0 0x7f18840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:13:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.621+0000 7f1891ffb640 1 -- 172.21.15.59:0/3239260450 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8260+0+0 (secure 0 0 0) 0x7f18880cf500 con 0x7f1894101de0 2024-09-10T11:13:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.621+0000 7f1893fff640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f18840a2cf0 0x7f18840a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1894075f80 tx=0x7f188000b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:13:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.625+0000 7f1891ffb640 1 -- 172.21.15.59:0/3239260450 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1888014030 con 0x7f1894101de0 2024-09-10T11:13:11.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:11.802+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f189402d7c0 con 0x7f1894101de0 2024-09-10T11:13:12.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.111+0000 7f1891ffb640 1 -- 172.21.15.59:0/3239260450 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) ==== 169+0+0 (secure 0 0 0) 0x7f188809c1c0 con 0x7f1894101de0 2024-09-10T11:13:12.112 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-09-10T11:13:12.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f18840a2cf0 msgr2=0x7f18840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:12.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f18840a2cf0 0x7f18840a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1894075f80 tx=0x7f188000b410 comp rx=0 tx=0).stop 2024-09-10T11:13:12.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894101de0 msgr2=0x7f18940744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:13:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894101de0 0x7f18940744f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f188800c920 tx=0x7f188800cde0 comp rx=0 tx=0).stop 2024-09-10T11:13:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 shutdown_connections 2024-09-10T11:13:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:6800/3897711076,v1:172.21.15.59:6801/3897711076] conn(0x7f18840a2cf0 0x7f18840a51b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1894106f10 0x7f1894074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1894102790 0x7f1894074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:13:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 --2- 172.21.15.59:0/3239260450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1894101de0 0x7f18940744f0 secure :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f188800c920 tx=0x7f188800cde0 comp rx=0 tx=0).stop 2024-09-10T11:13:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.115+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 >> 172.21.15.59:0/3239260450 conn(0x7f18940fd8c0 msgr2=0x7f18940feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:13:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.116+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 shutdown_connections 2024-09-10T11:13:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T11:13:12.116+0000 7f189b0af640 1 -- 172.21.15.59:0/3239260450 wait complete. 2024-09-10T11:13:12.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:12 smithi059 ceph-mon[30978]: pgmap v370: 65 pgs: 65 active+clean; 577 KiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:13:12.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:12 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3239260450' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:13:12.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:12 smithi181 ceph-mon[35409]: pgmap v370: 65 pgs: 65 active+clean; 577 KiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:13:12.436 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:12 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3239260450' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:13:12.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:12 smithi115 ceph-mon[34719]: pgmap v370: 65 pgs: 65 active+clean; 577 KiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:13:12.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:12 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3239260450' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:13:12.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:13:12.872 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:13:12.907 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:13:12.941 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T11:13:12.942 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T11:13:12.960 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T11:13:12.978 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T11:13:13.000 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T11:13:13.000 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T11:13:13.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.a 2024-09-10T11:13:13.118 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:13 smithi059 systemd[1]: Stopping Ceph mon.a for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:13.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:13 smithi181 ceph-mon[35409]: from='client.? 172.21.15.59:0/3239260450' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:13:13.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:13 smithi181 ceph-mon[35409]: osdmap e100: 12 total, 12 up, 12 in 2024-09-10T11:13:13.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:13 smithi115 ceph-mon[34719]: from='client.? 172.21.15.59:0/3239260450' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:13:13.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:13 smithi115 ceph-mon[34719]: osdmap e100: 12 total, 12 up, 12 in 2024-09-10T11:13:13.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:13 smithi059 ceph-mon[30978]: from='client.? 172.21.15.59:0/3239260450' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:13:13.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:13 smithi059 ceph-mon[30978]: osdmap e100: 12 total, 12 up, 12 in 2024-09-10T11:13:13.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a[30974]: 2024-09-10T11:13:13.319+0000 7f82d4dff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:13:13.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a[30974]: 2024-09-10T11:13:13.319+0000 7f82d4dff640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T11:13:13.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:13 smithi059 podman[88136]: 2024-09-10 11:13:13.350696252 +0000 UTC m=+0.151488171 container died f6b2538fa8e404c76071951b812d2de576d9ea022877aedb62c8ac2d35ce9e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T11:13:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:13 smithi059 podman[88136]: 2024-09-10 11:13:13.719516762 +0000 UTC m=+0.520308687 container cleanup f6b2538fa8e404c76071951b812d2de576d9ea022877aedb62c8ac2d35ce9e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T11:13:13.888 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 11:13:13 smithi059 bash[88136]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-a 2024-09-10T11:13:14.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T11:13:14.198 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:14.198 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T11:13:14.198 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T11:13:14.198 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.b 2024-09-10T11:13:14.510 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:14 smithi115 systemd[1]: Stopping Ceph mon.b for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:14.835 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-b[34715]: 2024-09-10T11:13:14.508+0000 7f056ee71640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:13:14.835 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-b[34715]: 2024-09-10T11:13:14.509+0000 7f056ee71640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T11:13:14.835 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:14 smithi115 podman[70561]: 2024-09-10 11:13:14.540040075 +0000 UTC m=+0.149356018 container died 32a1631198bff76f6f54c65ab9ad9451a6f074a166a60fc63f0ebe7022293f18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:13:15.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:14 smithi115 podman[70561]: 2024-09-10 11:13:14.934302405 +0000 UTC m=+0.543618357 container cleanup 32a1631198bff76f6f54c65ab9ad9451a6f074a166a60fc63f0ebe7022293f18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T11:13:15.208 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 10 11:13:14 smithi115 bash[70561]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-b 2024-09-10T11:13:15.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T11:13:15.452 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:15.452 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T11:13:15.453 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T11:13:15.453 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.c 2024-09-10T11:13:15.785 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:15 smithi181 systemd[1]: Stopping Ceph mon.c for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:15 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-c[35405]: 2024-09-10T11:13:15.783+0000 7f29b1c5d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:13:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:15 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-c[35405]: 2024-09-10T11:13:15.784+0000 7f29b1c5d640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T11:13:16.186 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:15 smithi181 podman[72286]: 2024-09-10 11:13:15.988825346 +0000 UTC m=+0.335024701 container died 7582c7f71e5f43d9a3a82ce0c7d7a194c171200d2d152de4f9a0aeafaa189df3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T11:13:16.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:16 smithi181 podman[72286]: 2024-09-10 11:13:16.368107839 +0000 UTC m=+0.714307194 container cleanup 7582c7f71e5f43d9a3a82ce0c7d7a194c171200d2d152de4f9a0aeafaa189df3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:13:16.620 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 10 11:13:16 smithi181 bash[72286]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mon-c 2024-09-10T11:13:16.739 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T11:13:16.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:16.801 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T11:13:16.801 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T11:13:16.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.x 2024-09-10T11:13:17.092 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:13:16 smithi059 systemd[1]: Stopping Ceph mgr.x for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:17.387 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:13:17 smithi059 podman[88260]: 2024-09-10 11:13:17.166506532 +0000 UTC m=+0.164781642 container died 25d8ecb57e9b020270388d75e642682d16e74be7f7768c92f8afe5dbda4dbc58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T11:13:17.811 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:13:17 smithi059 podman[88260]: 2024-09-10 11:13:17.575603421 +0000 UTC m=+0.573878523 container cleanup 25d8ecb57e9b020270388d75e642682d16e74be7f7768c92f8afe5dbda4dbc58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T11:13:17.811 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 11:13:17 smithi059 bash[88260]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-x 2024-09-10T11:13:17.971 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T11:13:18.008 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:18.008 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T11:13:18.008 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T11:13:18.008 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.y 2024-09-10T11:13:18.352 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:13:18 smithi115 systemd[1]: Stopping Ceph mgr.y for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:18.623 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:13:18 smithi115 podman[70684]: 2024-09-10 11:13:18.351603396 +0000 UTC m=+0.143858766 container died f81e8474541826aeccffb6c9a8d2060eaeb06c71abf268de78a0f7d0e0480767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T11:13:18.958 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:13:18 smithi115 podman[70684]: 2024-09-10 11:13:18.706243185 +0000 UTC m=+0.498498543 container cleanup f81e8474541826aeccffb6c9a8d2060eaeb06c71abf268de78a0f7d0e0480767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:13:18.958 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 10 11:13:18 smithi115 bash[70684]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-y 2024-09-10T11:13:19.129 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T11:13:19.164 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:19.164 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T11:13:19.164 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T11:13:19.165 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.z 2024-09-10T11:13:19.513 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:13:19 smithi181 systemd[1]: Stopping Ceph mgr.z for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:19.792 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:13:19 smithi181 podman[72409]: 2024-09-10 11:13:19.512732334 +0000 UTC m=+0.154084793 container died 5186d3b5526b8807c58a7e984c3c41a49ffe27f42c57b8cdb448a535348498cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:13:20.125 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:13:19 smithi181 podman[72409]: 2024-09-10 11:13:19.89043144 +0000 UTC m=+0.531783883 container cleanup 5186d3b5526b8807c58a7e984c3c41a49ffe27f42c57b8cdb448a535348498cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T11:13:20.126 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 10 11:13:19 smithi181 bash[72409]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mgr-z 2024-09-10T11:13:20.277 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T11:13:20.311 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:20.311 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T11:13:20.312 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T11:13:20.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.0 2024-09-10T11:13:20.632 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:20 smithi059 systemd[1]: Stopping Ceph osd.0 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:20.887 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0[42445]: 2024-09-10T11:13:20.630+0000 7f4088c26640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:13:20.888 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0[42445]: 2024-09-10T11:13:20.630+0000 7f4088c26640 -1 osd.0 100 *** Got signal Terminated *** 2024-09-10T11:13:20.888 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0[42445]: 2024-09-10T11:13:20.630+0000 7f4088c26640 -1 osd.0 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:13:26.341 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:25 smithi059 podman[88382]: 2024-09-10 11:13:25.94747762 +0000 UTC m=+5.433674355 container died acee1f1d7653ffd92a4a0fd684d5ce159eece4b008f206037fb4957d97f0b69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T11:13:26.637 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:26 smithi059 podman[88382]: 2024-09-10 11:13:26.439652133 +0000 UTC m=+5.925848867 container cleanup acee1f1d7653ffd92a4a0fd684d5ce159eece4b008f206037fb4957d97f0b69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:13:26.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:26 smithi059 bash[88382]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0 2024-09-10T11:13:27.067 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:26 smithi059 podman[88397]: 2024-09-10 11:13:26.716403938 +0000 UTC m=+0.769581076 container remove acee1f1d7653ffd92a4a0fd684d5ce159eece4b008f206037fb4957d97f0b69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T11:13:27.346 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:27 smithi059 podman[88487]: 2024-09-10 11:13:27.067221919 +0000 UTC m=+0.113511716 container create 5cd03b398c2a9131a28dcbb2f33c9f7b815a1b262bfc469a92b201e16a524473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:13:27.346 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:27 smithi059 podman[88487]: 2024-09-10 11:13:26.970292533 +0000 UTC m=+0.016582295 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:13:27.346 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:27 smithi059 podman[88487]: 2024-09-10 11:13:27.345155273 +0000 UTC m=+0.391445036 container init 5cd03b398c2a9131a28dcbb2f33c9f7b815a1b262bfc469a92b201e16a524473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:13:27.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:27 smithi059 podman[88487]: 2024-09-10 11:13:27.348988012 +0000 UTC m=+0.395277764 container start 5cd03b398c2a9131a28dcbb2f33c9f7b815a1b262bfc469a92b201e16a524473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T11:13:27.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:27 smithi059 podman[88487]: 2024-09-10 11:13:27.437048706 +0000 UTC m=+0.483338472 container attach 5cd03b398c2a9131a28dcbb2f33c9f7b815a1b262bfc469a92b201e16a524473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T11:13:27.638 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 11:13:27 smithi059 podman[88487]: 2024-09-10 11:13:27.538996922 +0000 UTC m=+0.585286673 container died 5cd03b398c2a9131a28dcbb2f33c9f7b815a1b262bfc469a92b201e16a524473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:13:28.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T11:13:28.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:28.144 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T11:13:28.144 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T11:13:28.144 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.1 2024-09-10T11:13:28.458 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:28 smithi115 systemd[1]: Stopping Ceph osd.1 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:28.813 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:28 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1[39181]: 2024-09-10T11:13:28.467+0000 7f47e5197640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:13:28.813 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:28 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1[39181]: 2024-09-10T11:13:28.467+0000 7f47e5197640 -1 osd.1 100 *** Got signal Terminated *** 2024-09-10T11:13:28.813 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:28 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1[39181]: 2024-09-10T11:13:28.467+0000 7f47e5197640 -1 osd.1 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:13:34.178 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:33 smithi115 podman[70820]: 2024-09-10 11:13:33.886174909 +0000 UTC m=+5.542288158 container died c6e7d27bc6f78dba170c5731e2622ef94ca093ab6965fcd17e67c7ba2286f245 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T11:13:34.458 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:34 smithi115 podman[70820]: 2024-09-10 11:13:34.268048128 +0000 UTC m=+5.924161376 container cleanup c6e7d27bc6f78dba170c5731e2622ef94ca093ab6965fcd17e67c7ba2286f245 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T11:13:34.458 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:34 smithi115 bash[70820]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1 2024-09-10T11:13:34.816 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:34 smithi115 podman[70836]: 2024-09-10 11:13:34.494400802 +0000 UTC m=+0.602460339 container remove c6e7d27bc6f78dba170c5731e2622ef94ca093ab6965fcd17e67c7ba2286f245 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T11:13:35.090 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:34 smithi115 podman[70927]: 2024-09-10 11:13:34.718324545 +0000 UTC m=+0.016412088 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:13:35.090 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:34 smithi115 podman[70927]: 2024-09-10 11:13:34.820337192 +0000 UTC m=+0.118424734 container create 94193677f5d4616984852d96671ec8a5c22c50702ace742c69c54436378d2f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T11:13:35.090 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:35 smithi115 podman[70927]: 2024-09-10 11:13:35.08947578 +0000 UTC m=+0.387563318 container init 94193677f5d4616984852d96671ec8a5c22c50702ace742c69c54436378d2f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T11:13:35.458 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:35 smithi115 podman[70927]: 2024-09-10 11:13:35.092757675 +0000 UTC m=+0.390845214 container start 94193677f5d4616984852d96671ec8a5c22c50702ace742c69c54436378d2f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:13:35.458 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:35 smithi115 podman[70927]: 2024-09-10 11:13:35.181244032 +0000 UTC m=+0.479331570 container attach 94193677f5d4616984852d96671ec8a5c22c50702ace742c69c54436378d2f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-10T11:13:35.458 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 10 11:13:35 smithi115 podman[70950]: 2024-09-10 11:13:35.310095927 +0000 UTC m=+0.017483423 container died 94193677f5d4616984852d96671ec8a5c22c50702ace742c69c54436378d2f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:13:35.955 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T11:13:35.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:35.996 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T11:13:35.996 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T11:13:35.996 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.2 2024-09-10T11:13:36.287 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:36 smithi181 systemd[1]: Stopping Ceph osd.2 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:36.686 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-10T11:13:36.285+0000 7f640da9e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:13:36.687 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-10T11:13:36.285+0000 7f640da9e640 -1 osd.2 100 *** Got signal Terminated *** 2024-09-10T11:13:36.687 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-10T11:13:36.285+0000 7f640da9e640 -1 osd.2 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:13:41.922 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:41 smithi181 podman[72546]: 2024-09-10 11:13:41.620754099 +0000 UTC m=+5.428209650 container died cca97aa5e1b38e6dad2361a936c373ae2199ef584888af6da3821f0571f11b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:13:42.186 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:42 smithi181 podman[72546]: 2024-09-10 11:13:42.012108062 +0000 UTC m=+5.819563613 container cleanup cca97aa5e1b38e6dad2361a936c373ae2199ef584888af6da3821f0571f11b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T11:13:42.186 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:42 smithi181 bash[72546]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2 2024-09-10T11:13:42.625 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:42 smithi181 podman[72565]: 2024-09-10 11:13:42.313766327 +0000 UTC m=+0.680763185 container remove cca97aa5e1b38e6dad2361a936c373ae2199ef584888af6da3821f0571f11b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:13:42.901 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:42 smithi181 podman[72652]: 2024-09-10 11:13:42.52808836 +0000 UTC m=+0.015942438 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:13:42.901 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:42 smithi181 podman[72652]: 2024-09-10 11:13:42.648083321 +0000 UTC m=+0.135937444 container create 4c9a5a3edce0933a9ff7e782b5292995b4451bdc0356bb717ef7027da027d9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:13:43.187 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:42 smithi181 podman[72652]: 2024-09-10 11:13:42.900682198 +0000 UTC m=+0.388536288 container init 4c9a5a3edce0933a9ff7e782b5292995b4451bdc0356bb717ef7027da027d9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T11:13:43.187 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:42 smithi181 podman[72652]: 2024-09-10 11:13:42.904226229 +0000 UTC m=+0.392080306 container start 4c9a5a3edce0933a9ff7e782b5292995b4451bdc0356bb717ef7027da027d9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T11:13:43.187 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:43 smithi181 podman[72652]: 2024-09-10 11:13:43.017595463 +0000 UTC m=+0.505449541 container attach 4c9a5a3edce0933a9ff7e782b5292995b4451bdc0356bb717ef7027da027d9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:13:43.187 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 10 11:13:43 smithi181 podman[72652]: 2024-09-10 11:13:43.086680559 +0000 UTC m=+0.574534648 container died 4c9a5a3edce0933a9ff7e782b5292995b4451bdc0356bb717ef7027da027d9a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:13:43.713 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T11:13:43.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:43.753 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T11:13:43.753 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T11:13:43.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.3 2024-09-10T11:13:44.086 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:43 smithi059 systemd[1]: Stopping Ceph osd.3 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:44.387 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:44 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3[49330]: 2024-09-10T11:13:44.084+0000 7f343bb0c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:13:44.388 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:44 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3[49330]: 2024-09-10T11:13:44.084+0000 7f343bb0c640 -1 osd.3 100 *** Got signal Terminated *** 2024-09-10T11:13:44.388 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:44 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3[49330]: 2024-09-10T11:13:44.084+0000 7f343bb0c640 -1 osd.3 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:13:47.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:47 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:47.307+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:48.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:47 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:47.710+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:48.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:48 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:48.269+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:48.686 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:48.433+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:48.687 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:48.459+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:48.933 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:48 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:48.661+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:49.621 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:49 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:49.244+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:49.887 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:49 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:49.690+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:49.888 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:49 smithi059 podman[88592]: 2024-09-10 11:13:49.621039022 +0000 UTC m=+5.658953485 container died cbc5896ce4ea5bf8fdfad72511ab18780b69715b71be6ba75a75eddd9b8bea32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T11:13:49.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:49.474+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:49.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:49.475+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:50.261 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:50 smithi059 podman[88592]: 2024-09-10 11:13:50.010627192 +0000 UTC m=+6.048541652 container cleanup cbc5896ce4ea5bf8fdfad72511ab18780b69715b71be6ba75a75eddd9b8bea32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T11:13:50.261 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:50 smithi059 bash[88592]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3 2024-09-10T11:13:50.629 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:50 smithi059 podman[88618]: 2024-09-10 11:13:50.289258362 +0000 UTC m=+0.662588901 container remove cbc5896ce4ea5bf8fdfad72511ab18780b69715b71be6ba75a75eddd9b8bea32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0) 2024-09-10T11:13:50.629 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:50 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:50.259+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:50.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:50 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:50.685+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:50.888 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:50 smithi059 podman[88709]: 2024-09-10 11:13:50.532187232 +0000 UTC m=+0.016548465 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:13:50.888 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:50 smithi059 podman[88709]: 2024-09-10 11:13:50.680066397 +0000 UTC m=+0.164427616 container create 76573da2ce59ac96c79bf84c6d14131718271b01aa0ff2595b39801b9516583a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T11:13:50.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:50.453+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:50.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:50.502+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:51.163 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:50 smithi059 podman[88709]: 2024-09-10 11:13:50.965627816 +0000 UTC m=+0.449989037 container init 76573da2ce59ac96c79bf84c6d14131718271b01aa0ff2595b39801b9516583a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:13:51.163 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:50 smithi059 podman[88709]: 2024-09-10 11:13:50.969275191 +0000 UTC m=+0.453636411 container start 76573da2ce59ac96c79bf84c6d14131718271b01aa0ff2595b39801b9516583a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T11:13:51.163 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:51 smithi059 podman[88709]: 2024-09-10 11:13:51.057331552 +0000 UTC m=+0.541692773 container attach 76573da2ce59ac96c79bf84c6d14131718271b01aa0ff2595b39801b9516583a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T11:13:51.513 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:51 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:51.220+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:51.514 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 11:13:51 smithi059 podman[88709]: 2024-09-10 11:13:51.162861817 +0000 UTC m=+0.647223043 container died 76573da2ce59ac96c79bf84c6d14131718271b01aa0ff2595b39801b9516583a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T11:13:51.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:51 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:51.282+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:13:51.814 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:51 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:51.642+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:51.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T11:13:51.880 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:51.880 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T11:13:51.880 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T11:13:51.881 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.4 2024-09-10T11:13:51.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:51.489+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:51.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:51.531+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:52.195 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:51 smithi115 systemd[1]: Stopping Ceph osd.4 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:13:52.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:52 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:52.279+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:13:52.458 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:52 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4[46078]: 2024-09-10T11:13:52.194+0000 7f88c7cfd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:13:52.458 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:52 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4[46078]: 2024-09-10T11:13:52.194+0000 7f88c7cfd640 -1 osd.4 100 *** Got signal Terminated *** 2024-09-10T11:13:52.459 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:52 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4[46078]: 2024-09-10T11:13:52.194+0000 7f88c7cfd640 -1 osd.4 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:13:52.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:52 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:52.189+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:52.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:52 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:52.481+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:52.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:52 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:52.495+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:53.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:52 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:52.665+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:53.627 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:53 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:53.185+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:53.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:53 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:53.278+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:13:53.838 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:53 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:53.510+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:53.838 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:53 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:53.508+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:53.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:53 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:53.626+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:54.603 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:54 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:54.162+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:54.686 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:54 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:54.558+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:54.686 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:54 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:54.505+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:54.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:54 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:54.280+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:13:54.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:54 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:54.601+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:54.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:54 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:54.601+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:13:55.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:55 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:55.244+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:13:55.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:13:55 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:13:55.181+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:13:55.564 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:55 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:55.157+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:55.887 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:55 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:55.563+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:55.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:55 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:55.563+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:13:55.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:55 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:55.595+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:55.937 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:55 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:55.545+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:56.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:13:56 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:13:56.201+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:13:56.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:56 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:56.280+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:13:56.604 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:56 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:56.203+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:56.887 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:56 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:56.604+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:56.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:56 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:56.604+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:13:56.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:56 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:56.579+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:56.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:56 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:56.579+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:13:56.937 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:56 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:56.504+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:56.958 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:56 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4[46078]: 2024-09-10T11:13:56.534+0000 7f88c030b640 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.776950+0000 front 2024-09-10T11:13:32.776884+0000 (oldest deadline 2024-09-10T11:13:56.276978+0000) 2024-09-10T11:13:57.602 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:57 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:57.250+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:57.690 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:13:57 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:13:57.243+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:13:57.691 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:57 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:57.242+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:13:57.691 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:57 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:57.242+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:13:57.693 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:57 smithi115 podman[71029]: 2024-09-10 11:13:57.690090606 +0000 UTC m=+5.618454250 container died c2f2ffbf06cd76e26a5ae8ff5158b7b8e61fb1f101e23b1e99e9b78e66a28647 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:13:57.837 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:57 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:57.624+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:57.838 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:57 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:57.624+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:13:57.838 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:57 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:57.467+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:57.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:57 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:57.601+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:57.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:57 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:57.601+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:13:58.113 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:13:58 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:13:58.081+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:13:58.338 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:13:58 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:13:58.229+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:13:58.338 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:58 smithi115 podman[71029]: 2024-09-10 11:13:58.077589231 +0000 UTC m=+6.005952877 container cleanup c2f2ffbf06cd76e26a5ae8ff5158b7b8e61fb1f101e23b1e99e9b78e66a28647 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:13:58.339 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:58 smithi115 bash[71029]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4 2024-09-10T11:13:58.339 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:58 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:58.234+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:13:58.339 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:58 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:58.234+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:13:58.641 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:58 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:58.278+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:58.641 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:58 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:58.278+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:13:58.695 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:58 smithi115 podman[71047]: 2024-09-10 11:13:58.337792183 +0000 UTC m=+0.649466804 container remove c2f2ffbf06cd76e26a5ae8ff5158b7b8e61fb1f101e23b1e99e9b78e66a28647 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:13:58.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:58 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:58.615+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:58.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:58 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:58.615+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:13:58.937 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:58 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:58.477+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:58.937 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:58 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:58.477+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:31.873779+0000 front 2024-09-10T11:13:31.873838+0000 (oldest deadline 2024-09-10T11:13:57.773840+0000) 2024-09-10T11:13:58.958 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:58 smithi115 podman[71143]: 2024-09-10 11:13:58.598017912 +0000 UTC m=+0.016133736 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:13:58.958 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:58 smithi115 podman[71143]: 2024-09-10 11:13:58.713543421 +0000 UTC m=+0.131659232 container create 2944ee9a15bf98b44233b3beb6417da55e06524395c9b84c230799acd31c9bdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T11:13:58.958 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:58 smithi115 podman[71143]: 2024-09-10 11:13:58.95763834 +0000 UTC m=+0.375754168 container init 2944ee9a15bf98b44233b3beb6417da55e06524395c9b84c230799acd31c9bdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:13:59.137 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:58 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:58.637+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:59.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:58 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:58.637+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:13:59.208 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:58 smithi115 podman[71143]: 2024-09-10 11:13:58.960963658 +0000 UTC m=+0.379079473 container start 2944ee9a15bf98b44233b3beb6417da55e06524395c9b84c230799acd31c9bdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T11:13:59.208 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:59 smithi115 podman[71143]: 2024-09-10 11:13:59.032640147 +0000 UTC m=+0.450755961 container attach 2944ee9a15bf98b44233b3beb6417da55e06524395c9b84c230799acd31c9bdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:13:59.209 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 10 11:13:59 smithi115 podman[71143]: 2024-09-10 11:13:59.153716076 +0000 UTC m=+0.571831890 container died 2944ee9a15bf98b44233b3beb6417da55e06524395c9b84c230799acd31c9bdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:13:59.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:13:59 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:13:59.113+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:13:59.611 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:59 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:59.267+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:13:59.611 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:13:59 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:13:59.267+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:13:59.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:13:59 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:13:59.236+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:13:59.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:59 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:59.277+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:13:59.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:13:59 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:13:59.277+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:13:59.780 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T11:13:59.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:13:59.821 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T11:13:59.821 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T11:13:59.821 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.5 2024-09-10T11:13:59.848 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:59 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:59.435+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:13:59.848 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:59 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:13:59.435+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:31.873779+0000 front 2024-09-10T11:13:31.873838+0000 (oldest deadline 2024-09-10T11:13:57.773840+0000) 2024-09-10T11:13:59.848 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:59 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:59.580+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:13:59.848 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:13:59 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:13:59.580+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:13:59.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:59 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:59.610+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:13:59.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:13:59 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:13:59.610+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:00.125 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:13:59 smithi181 systemd[1]: Stopping Ceph osd.5 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:14:00.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:00 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:00.123+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:00.436 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:00 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:00.144+0000 7f4077813640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:14:00.437 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:00 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:00.144+0000 7f4077813640 -1 osd.5 100 *** Got signal Terminated *** 2024-09-10T11:14:00.437 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:00 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:00.144+0000 7f4077813640 -1 osd.5 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:14:00.607 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:00.312+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:00.607 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:00.312+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:00.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:00 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:00.221+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:00.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:00 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:00.257+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:00.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:00 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:00.257+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:00.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:00.606+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:00.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:00 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:00.606+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:00.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:00 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:00.541+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:00.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:00 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:00.541+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:00.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:00 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:00.484+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:14:00.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:00 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:00.484+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:31.873779+0000 front 2024-09-10T11:13:31.873838+0000 (oldest deadline 2024-09-10T11:13:57.773840+0000) 2024-09-10T11:14:01.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:01 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:01.124+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:01.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:01 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:01.199+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:01.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:01 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:01.284+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:01.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:01 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:01.284+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:01.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:01.342+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:01.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:01.342+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:01.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:01 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:01.509+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:14:01.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:01 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:01.509+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:31.873779+0000 front 2024-09-10T11:13:31.873838+0000 (oldest deadline 2024-09-10T11:13:57.773840+0000) 2024-09-10T11:14:01.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:01 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:01.502+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:01.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:01 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:01.502+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:02.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:01.641+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:02.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:01 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:01.641+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:02.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:02 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:02.110+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:02.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:02 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:02.372+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:02.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:02 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:02.372+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:02.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:02 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:02.212+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:02.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:02 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:02.212+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:02.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:02 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:02.302+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:02.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:02 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:02.302+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:02.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:02 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:02.474+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:14:02.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:02 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:02.474+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:31.873779+0000 front 2024-09-10T11:13:31.873838+0000 (oldest deadline 2024-09-10T11:13:57.773840+0000) 2024-09-10T11:14:02.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:02 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:02.494+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:02.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:02 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:02.494+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:02.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:02 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:02.494+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:03.137 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:02 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:02.668+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:03.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:02 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:02.668+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:03.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:03 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:03.113+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:03.635 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:03.383+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:03.636 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:03.383+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:03.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:03 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:03.208+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:03.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:03 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:03.208+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:03.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:03 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:03.254+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:03.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:03 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:03.254+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:03.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:03.634+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:03.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:03.634+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:03.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:03 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:03.499+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:14:03.936 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:03 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:03.499+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:31.873779+0000 front 2024-09-10T11:13:31.873838+0000 (oldest deadline 2024-09-10T11:13:57.773840+0000) 2024-09-10T11:14:03.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:03 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:03.533+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:03.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:03 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:03.533+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:03.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:03 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:03.533+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:04.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:04 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:04.099+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:04.637 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:04.379+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:04.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:04.379+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:04.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:04 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:04.236+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:04.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:04 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:04.236+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:04.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:04 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:04.215+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:04.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:04 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:04.215+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:04.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:04 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:04.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:04.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:04 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:04.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:04.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:04 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:04.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:04.937 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:04 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:04.463+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:25.472832+0000 front 2024-09-10T11:13:25.473004+0000 (oldest deadline 2024-09-10T11:13:47.772711+0000) 2024-09-10T11:14:04.937 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:04 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:04.463+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:31.873779+0000 front 2024-09-10T11:13:31.873838+0000 (oldest deadline 2024-09-10T11:13:57.773840+0000) 2024-09-10T11:14:04.937 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:04 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5[47277]: 2024-09-10T11:14:04.463+0000 7f406fe21640 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.074717+0000 front 2024-09-10T11:13:40.074750+0000 (oldest deadline 2024-09-10T11:14:04.174739+0000) 2024-09-10T11:14:05.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:04.676+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:05.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:04.676+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:05.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:04 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:04.676+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.416782+0000 front 2024-09-10T11:13:40.416801+0000 (oldest deadline 2024-09-10T11:14:03.916824+0000) 2024-09-10T11:14:05.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:05.130+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:05.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:05.254+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:05.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:05.254+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:05.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:05.166+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:05.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:05 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:05.166+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:05.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:05 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:05.383+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:05.638 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:05 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:05.383+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:05.878 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:05.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:05.878 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:05.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:05.878 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:05 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:05.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:05.879 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:05 smithi181 podman[72781]: 2024-09-10 11:14:05.536001115 +0000 UTC m=+5.526766623 container died 5d15d7dcdc4db04e308ed488fd3b121d71138c004b29074ee5e4e13b9eef2ea3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True) 2024-09-10T11:14:06.134 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:05 smithi181 podman[72781]: 2024-09-10 11:14:05.967236558 +0000 UTC m=+5.958002101 container cleanup 5d15d7dcdc4db04e308ed488fd3b121d71138c004b29074ee5e4e13b9eef2ea3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T11:14:06.134 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:05 smithi181 bash[72781]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5 2024-09-10T11:14:06.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:05 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:05.716+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:06.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:05 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:05.716+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:06.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:05 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:05.716+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.416782+0000 front 2024-09-10T11:13:40.416801+0000 (oldest deadline 2024-09-10T11:14:03.916824+0000) 2024-09-10T11:14:06.436 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:06 smithi181 podman[72797]: 2024-09-10 11:14:06.168494212 +0000 UTC m=+0.622141157 container remove 5d15d7dcdc4db04e308ed488fd3b121d71138c004b29074ee5e4e13b9eef2ea3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T11:14:06.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:06 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:06.133+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:06.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:06 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:06.278+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:06.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:06 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:06.278+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:06.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:06 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:06.187+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:06.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:06 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:06.187+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:06.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:06 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:06.187+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:06.830 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:06 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:06.549+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:06.831 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:06 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:06.549+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:06.831 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:06 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:06.549+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:06.831 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:06 smithi181 podman[72885]: 2024-09-10 11:14:06.481828052 +0000 UTC m=+0.015836716 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:14:06.831 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:06 smithi181 podman[72885]: 2024-09-10 11:14:06.585998331 +0000 UTC m=+0.120006995 container create 059304cb879a68abef3490e50df702a0ec3fff5a9a0dee8eb7b430aba5e1075c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T11:14:06.887 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:06 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:06.430+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:06.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:06 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:06.430+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:06.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:06 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:06.430+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:06.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:06 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:06.672+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:06.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:06 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:06.672+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:06.888 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:06 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:06.672+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.416782+0000 front 2024-09-10T11:13:40.416801+0000 (oldest deadline 2024-09-10T11:14:03.916824+0000) 2024-09-10T11:14:07.114 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:06 smithi181 podman[72885]: 2024-09-10 11:14:06.830210416 +0000 UTC m=+0.364219080 container init 059304cb879a68abef3490e50df702a0ec3fff5a9a0dee8eb7b430aba5e1075c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T11:14:07.114 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:06 smithi181 podman[72885]: 2024-09-10 11:14:06.833612127 +0000 UTC m=+0.367620792 container start 059304cb879a68abef3490e50df702a0ec3fff5a9a0dee8eb7b430aba5e1075c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T11:14:07.114 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:06 smithi181 podman[72885]: 2024-09-10 11:14:06.938638711 +0000 UTC m=+0.472647384 container attach 059304cb879a68abef3490e50df702a0ec3fff5a9a0dee8eb7b430aba5e1075c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T11:14:07.115 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 10 11:14:07 smithi181 podman[72885]: 2024-09-10 11:14:07.024948941 +0000 UTC m=+0.558957611 container died 059304cb879a68abef3490e50df702a0ec3fff5a9a0dee8eb7b430aba5e1075c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T11:14:07.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:07 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:07.113+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:07.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:07 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:07.113+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:07.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:07 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:07.272+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:07.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:07 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:07.272+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:07.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:07 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:07.203+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:07.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:07 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:07.203+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:07.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:07 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:07.203+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:07.655 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T11:14:07.721 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:07 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:07.402+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:07.721 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:07 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:07.402+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:07.721 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:07 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:07.402+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:07.738 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:14:07.738 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T11:14:07.738 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T11:14:07.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.6 2024-09-10T11:14:07.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:07 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:07.586+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:07.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:07 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:07.586+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:07.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:07 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:07.586+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:08.068 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:07 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:07.720+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:08.068 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:07 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:07.720+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:08.068 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:07 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:07.720+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.416782+0000 front 2024-09-10T11:13:40.416801+0000 (oldest deadline 2024-09-10T11:14:03.916824+0000) 2024-09-10T11:14:08.068 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:07 smithi059 systemd[1]: Stopping Ceph osd.6 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:14:08.068 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:08.066+0000 7f1846fe3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:14:08.068 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:08.066+0000 7f1846fe3640 -1 osd.6 100 *** Got signal Terminated *** 2024-09-10T11:14:08.068 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:08.066+0000 7f1846fe3640 -1 osd.6 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:14:08.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:08 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:08.095+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:08.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:08 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:08.095+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:08.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:08 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:08.282+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:08.708 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:08 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:08.282+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:08.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:08 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:08.219+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:08.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:08 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:08.219+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:08.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:08 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:08.219+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:08.720 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:08.388+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:08.720 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:08.388+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:08.720 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:08.388+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:08.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:08 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:08.574+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:08.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:08 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:08.574+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:08.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:08 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:08.574+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:09.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:08.719+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:09.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:08.719+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:09.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:08.719+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.416782+0000 front 2024-09-10T11:13:40.416801+0000 (oldest deadline 2024-09-10T11:14:03.916824+0000) 2024-09-10T11:14:09.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:09 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:09.136+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:09.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:09 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:09.136+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:09.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:09 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:09.254+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:09.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:09 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:09.254+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:09.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:09 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:09.197+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:09.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:09 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:09.197+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:09.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:09 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:09.197+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:09.755 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:09 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:09.405+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:09.755 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:09 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:09.405+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:09.755 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:09 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:09.405+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:09.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:09 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:09.526+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:09.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:09 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:09.526+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:09.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:09 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:09.526+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:10.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:09 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:09.754+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:10.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:09 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:09.754+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:10.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:09 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:09.754+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.416782+0000 front 2024-09-10T11:13:40.416801+0000 (oldest deadline 2024-09-10T11:14:03.916824+0000) 2024-09-10T11:14:10.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:10 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:10.101+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:10.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:10 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:10.101+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:10.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:10 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:10.101+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:10.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:10 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:10.217+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:10.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:10 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:10.217+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:10.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:10 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:10.207+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:10.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:10 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:10.207+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:10.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:10 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:10.207+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:10.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:10 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:10.207+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:10.716 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:10.445+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:10.716 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:10.445+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:10.716 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:10.445+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:10.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:10 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:10.569+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:10.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:10 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:10.569+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:10.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:10 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:10.569+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:11.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:10.715+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:11.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:10.715+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:11.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:10.715+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.416782+0000 front 2024-09-10T11:13:40.416801+0000 (oldest deadline 2024-09-10T11:14:03.916824+0000) 2024-09-10T11:14:11.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:10 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:10.715+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:43.917216+0000 front 2024-09-10T11:13:43.917147+0000 (oldest deadline 2024-09-10T11:14:09.817220+0000) 2024-09-10T11:14:11.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:11 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:11.104+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:11.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:11 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:11.104+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:11.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:11 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:11.104+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:11.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:11 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:11.184+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:11.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:11 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:11.184+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:11.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:11 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:11.184+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:11.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:11 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:11.232+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:11.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:11 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:11.232+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:11.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:11 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:11.232+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:11.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:11 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:11.232+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:11.731 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:11.412+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:11.731 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:11.412+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:11.731 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:11.412+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:11.731 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:11.412+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:11.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:11 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:11.556+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:11.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:11 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:11.556+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:11.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:11 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:11.556+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:12.137 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:11.730+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:12.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:11.730+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:12.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:11.730+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.416782+0000 front 2024-09-10T11:13:40.416801+0000 (oldest deadline 2024-09-10T11:14:03.916824+0000) 2024-09-10T11:14:12.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:11 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:11.730+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:43.917216+0000 front 2024-09-10T11:13:43.917147+0000 (oldest deadline 2024-09-10T11:14:09.817220+0000) 2024-09-10T11:14:12.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:12 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:12.128+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:12.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:12 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:12.128+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:12.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:12 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:12.128+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:12.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:12 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:12.134+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:12.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:12 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:12.134+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:12.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:12 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:12.134+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:12.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:12 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:12.275+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:12.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:12 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:12.275+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:12.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:12 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:12.275+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:12.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:12 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:12.275+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:12.711 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:12.441+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:12.711 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:12.441+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:12.711 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:12.441+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:12.711 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:12.441+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:12.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:12 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:12.585+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:12.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:12 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:12.585+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:12.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:12 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:12.585+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:13.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:12.710+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.909268+0000 front 2024-09-10T11:13:21.909379+0000 (oldest deadline 2024-09-10T11:13:47.213014+0000) 2024-09-10T11:14:13.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:12.710+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.014673+0000 front 2024-09-10T11:13:30.014596+0000 (oldest deadline 2024-09-10T11:13:54.014990+0000) 2024-09-10T11:14:13.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:12.710+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.416782+0000 front 2024-09-10T11:13:40.416801+0000 (oldest deadline 2024-09-10T11:14:03.916824+0000) 2024-09-10T11:14:13.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:12 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6[56210]: 2024-09-10T11:14:12.710+0000 7f183f5f1640 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:43.917216+0000 front 2024-09-10T11:13:43.917147+0000 (oldest deadline 2024-09-10T11:14:09.817220+0000) 2024-09-10T11:14:13.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:13 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:13.148+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:13.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:13 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:13.148+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:13.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:13 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:13.148+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:13.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:13 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:13.091+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:13.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:13 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:13.091+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:13.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:13 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:13.091+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:13.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:13 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:13.307+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:13.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:13 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:13.307+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:13.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:13 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:13.307+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:13.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:13 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:13.307+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:13.710 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:13 smithi059 podman[88811]: 2024-09-10 11:14:13.421174562 +0000 UTC m=+5.480381800 container died 4daae53351f23c705965779725bcade3575942ad1b671019737cd9281b57471a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T11:14:13.710 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:13.460+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:13.710 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:13.460+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:13.711 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:13.460+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:13.711 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:13 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:13.460+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:13.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:13 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:13.635+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:13.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:13 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:13.635+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:13.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:13 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:13.635+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:14.043 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:13 smithi059 podman[88811]: 2024-09-10 11:14:13.808355098 +0000 UTC m=+5.867562321 container cleanup 4daae53351f23c705965779725bcade3575942ad1b671019737cd9281b57471a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T11:14:14.043 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:13 smithi059 bash[88811]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6 2024-09-10T11:14:14.387 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:14 smithi059 podman[88827]: 2024-09-10 11:14:14.042889377 +0000 UTC m=+0.615772554 container remove 4daae53351f23c705965779725bcade3575942ad1b671019737cd9281b57471a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:14:14.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:14 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:14.126+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:14.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:14 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:14.126+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:14.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:14 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:14.126+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:14.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:14.091+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:14.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:14.091+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:14.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:14.091+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:14.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:14.269+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:14.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:14.269+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:14.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:14.269+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:14.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:14.269+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:14.697 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:14 smithi059 podman[88912]: 2024-09-10 11:14:14.291816815 +0000 UTC m=+0.016626997 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:14:14.697 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:14 smithi059 podman[88912]: 2024-09-10 11:14:14.410601158 +0000 UTC m=+0.135411375 container create 8df9205b0db7eb159adda296bce45a5949f0c8f4b05f4df4212ddec15d392de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T11:14:14.697 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:14 smithi059 podman[88912]: 2024-09-10 11:14:14.696427738 +0000 UTC m=+0.421237910 container init 8df9205b0db7eb159adda296bce45a5949f0c8f4b05f4df4212ddec15d392de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T11:14:14.697 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:14.503+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:14.697 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:14.503+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:14.697 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:14.503+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:14.697 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:14 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:14.503+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:14.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:14 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:14.647+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:14.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:14 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:14.647+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:14.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:14 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:14.647+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:15.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:14 smithi059 podman[88912]: 2024-09-10 11:14:14.70002801 +0000 UTC m=+0.424838190 container start 8df9205b0db7eb159adda296bce45a5949f0c8f4b05f4df4212ddec15d392de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:14:15.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:14 smithi059 podman[88912]: 2024-09-10 11:14:14.796364093 +0000 UTC m=+0.521174288 container attach 8df9205b0db7eb159adda296bce45a5949f0c8f4b05f4df4212ddec15d392de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:14:15.138 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 11:14:14 smithi059 podman[88912]: 2024-09-10 11:14:14.894209756 +0000 UTC m=+0.619019930 container died 8df9205b0db7eb159adda296bce45a5949f0c8f4b05f4df4212ddec15d392de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T11:14:15.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:15 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:15.106+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:15.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:15 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:15.106+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:15.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:15 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:15.106+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:15.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:15.065+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:15.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:15.065+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:15.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:15.065+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:15.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:15.310+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:15.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:15.310+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:15.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:15.310+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:15.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:15.310+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:15.559 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:15 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:15.464+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:15.559 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:15 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:15.464+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:15.559 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:15 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:15.464+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:15.559 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:15 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:15.464+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:15.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T11:14:15.625 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:14:15.626 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T11:14:15.626 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T11:14:15.626 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.7 2024-09-10T11:14:15.913 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:15 smithi115 systemd[1]: Stopping Ceph osd.7 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:14:15.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:15 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:15.640+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:15.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:15 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:15.640+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:15.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:15 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:15.640+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:16.208 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:15.912+0000 7f30e3894640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:14:16.208 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:15.912+0000 7f30e3894640 -1 osd.7 100 *** Got signal Terminated *** 2024-09-10T11:14:16.208 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:15 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:15.912+0000 7f30e3894640 -1 osd.7 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:14:16.209 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:16 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:16.096+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:16.209 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:16 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:16.096+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:16.209 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:16 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:16.096+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:16.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:16 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:16.111+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:16.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:16 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:16.111+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:16.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:16 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:16.111+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:16.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:16 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:16.286+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:16.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:16 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:16.286+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:16.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:16 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:16.286+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:16.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:16 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:16.286+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:16.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:16 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:16.481+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:16.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:16 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:16.481+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:16.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:16 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:16.481+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:16.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:16 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:16.481+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:16.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:16 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:16.628+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:16.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:16 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:16.628+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:16.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:16 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:16.628+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:17.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:17.120+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:17.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:17.120+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:17.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:17.120+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:17.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:17.095+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:17.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:17.095+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:17.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:17.095+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:17.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:17.302+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:17.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:17.302+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:17.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:17.302+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:17.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:17 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:17.302+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:17.789 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:17.497+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:17.789 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:17.497+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:17.790 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:17.497+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:17.790 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:17 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:17.497+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:17.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:17.676+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:17.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:17.676+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:17.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:17 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:17.676+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:18.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:18 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:18.139+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:18.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:18 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:18.139+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:18.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:18 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:18.139+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:18.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:18.051+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:18.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:18.051+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:18.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:18.051+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:18.459 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:18.051+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.325670+0000 front 2024-09-10T11:13:56.325695+0000 (oldest deadline 2024-09-10T11:14:17.926313+0000) 2024-09-10T11:14:18.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:18.262+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:18.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:18.262+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:18.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:18.262+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:18.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:18.262+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:18.805 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:18.527+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:18.805 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:18.527+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:18.805 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:18.527+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:18.805 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:18 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:18.527+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:18.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:18 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:18.680+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:18.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:18 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:18.680+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:18.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:18 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:18.680+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:19.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:19 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:19.169+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:19.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:19 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:19.169+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:19.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:19 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:19.169+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:19.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:19.082+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:19.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:19.082+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:19.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:19.082+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:19.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:19.082+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.325670+0000 front 2024-09-10T11:13:56.325695+0000 (oldest deadline 2024-09-10T11:14:17.926313+0000) 2024-09-10T11:14:19.458 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:19.306+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:19.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:19.306+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:19.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:19.306+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:19.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:19.306+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:19.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:19 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:19.306+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:19.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:19 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:19.516+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:19.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:19 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:19.516+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:19.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:19 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:19.516+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:19.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:19 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:19.516+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:20.131 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:19 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:19.696+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:20.132 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:19 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:19.696+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:20.132 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:19 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:19.696+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:20.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:20.131+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:20.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:20.131+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:20.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:20.131+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:20.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:20.068+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.722510+0000 front 2024-09-10T11:13:28.722550+0000 (oldest deadline 2024-09-10T11:13:54.622577+0000) 2024-09-10T11:14:20.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:20.068+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:39.323865+0000 front 2024-09-10T11:13:39.323794+0000 (oldest deadline 2024-09-10T11:14:01.623643+0000) 2024-09-10T11:14:20.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:20.068+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.324854+0000 front 2024-09-10T11:13:46.324823+0000 (oldest deadline 2024-09-10T11:14:11.024795+0000) 2024-09-10T11:14:20.458 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7[53020]: 2024-09-10T11:14:20.068+0000 7f30dfeaa640 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.325670+0000 front 2024-09-10T11:13:56.325695+0000 (oldest deadline 2024-09-10T11:14:17.926313+0000) 2024-09-10T11:14:20.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:20.258+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:20.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:20.258+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:20.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:20.258+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:20.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:20.258+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:20.459 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:20 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:20.258+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:20.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:20.538+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:20.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:20.538+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:20.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:20.538+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:20.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:20 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:20.538+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:20.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:20.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:20.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:20.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:20.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:20.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:20.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:20 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:20.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:21.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:21.139+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:21.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:21.139+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:21.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:21.139+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:21.589 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:21 smithi115 podman[71247]: 2024-09-10 11:14:21.356754569 +0000 UTC m=+5.539255439 container died 2b45d5398e1af8b71d255622284fe5612bab932fd0d059ed281a8c7792783b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T11:14:21.589 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:21 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:21.209+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:21.589 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:21 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:21.209+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:21.589 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:21 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:21.209+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:21.589 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:21 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:21.209+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:21.589 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:21 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:21.209+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:21.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:21.526+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:21.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:21.526+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:21.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:21.526+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:21.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:21 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:21.526+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:21.897 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:21 smithi115 podman[71247]: 2024-09-10 11:14:21.645197102 +0000 UTC m=+5.827697960 container cleanup 2b45d5398e1af8b71d255622284fe5612bab932fd0d059ed281a8c7792783b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:14:21.897 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:21 smithi115 bash[71247]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7 2024-09-10T11:14:21.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:21.618+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:21.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:21.618+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:21.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:21.618+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:21.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:21 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:21.618+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:22.208 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:21 smithi115 podman[71263]: 2024-09-10 11:14:21.896232201 +0000 UTC m=+0.539250657 container remove 2b45d5398e1af8b71d255622284fe5612bab932fd0d059ed281a8c7792783b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T11:14:22.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:22.104+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:22.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:22.104+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:22.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:22.104+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:22.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:22.104+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.276216+0000 front 2024-09-10T11:13:56.276131+0000 (oldest deadline 2024-09-10T11:14:21.575955+0000) 2024-09-10T11:14:22.467 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:22 smithi115 podman[71353]: 2024-09-10 11:14:22.247102103 +0000 UTC m=+0.101175988 container create 5d1b40ca9c3888a423bdd51477ac85b4a98a2f0142f4128b4440d2d3ed52d57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T11:14:22.467 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:22 smithi115 podman[71353]: 2024-09-10 11:14:22.161900835 +0000 UTC m=+0.015974728 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:14:22.467 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:22 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:22.206+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:22.467 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:22 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:22.206+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:22.467 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:22 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:22.206+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:22.468 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:22 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:22.206+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:22.468 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:22 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:22.206+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:22.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:22.544+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:22.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:22.544+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:22.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:22.544+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:22.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:22.544+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:22.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:22 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:22.544+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:22.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:22.634+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:22.959 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:22.634+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:22.960 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:22.634+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:22.960 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:22 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:22.634+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:22.960 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:22 smithi115 podman[71353]: 2024-09-10 11:14:22.466452037 +0000 UTC m=+0.320525919 container init 5d1b40ca9c3888a423bdd51477ac85b4a98a2f0142f4128b4440d2d3ed52d57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T11:14:22.960 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:22 smithi115 podman[71353]: 2024-09-10 11:14:22.469822345 +0000 UTC m=+0.323896237 container start 5d1b40ca9c3888a423bdd51477ac85b4a98a2f0142f4128b4440d2d3ed52d57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T11:14:22.960 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:22 smithi115 podman[71353]: 2024-09-10 11:14:22.55793107 +0000 UTC m=+0.412004962 container attach 5d1b40ca9c3888a423bdd51477ac85b4a98a2f0142f4128b4440d2d3ed52d57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T11:14:22.961 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:22 smithi115 podman[71353]: 2024-09-10 11:14:22.666090971 +0000 UTC m=+0.520164854 container died 5d1b40ca9c3888a423bdd51477ac85b4a98a2f0142f4128b4440d2d3ed52d57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T11:14:23.300 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 10 11:14:23 smithi115 podman[71376]: 2024-09-10 11:14:23.277860541 +0000 UTC m=+0.605656986 container remove 5d1b40ca9c3888a423bdd51477ac85b4a98a2f0142f4128b4440d2d3ed52d57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T11:14:23.300 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:23 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:23.245+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:23.300 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:23 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:23.245+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:23.300 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:23 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:23.245+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:23.301 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:23 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:23.245+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:23.301 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:23 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:23.245+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:23.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T11:14:23.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:14:23.344 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T11:14:23.344 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T11:14:23.344 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.8 2024-09-10T11:14:23.370 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:23.117+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:23.371 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:23.117+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:23.371 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:23.117+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:23.371 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:23.117+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.276216+0000 front 2024-09-10T11:13:56.276131+0000 (oldest deadline 2024-09-10T11:14:21.575955+0000) 2024-09-10T11:14:23.640 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:23 smithi181 systemd[1]: Stopping Ceph osd.8 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:14:23.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:23.515+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:23.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:23.515+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:23.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:23.515+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:23.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:23.515+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:23.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:23 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:23.515+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:23.936 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:23.660+0000 7f395683e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:14:23.936 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:23.660+0000 7f395683e640 -1 osd.8 100 *** Got signal Terminated *** 2024-09-10T11:14:23.936 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:23.660+0000 7f395683e640 -1 osd.8 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:14:23.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:23.638+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:23.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:23.638+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:23.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:23.638+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:23.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:23 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:23.638+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:24.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:24 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:24.160+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:24.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:24 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:24.160+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:24.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:24 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:24.160+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:24.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:24 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:24.160+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.276216+0000 front 2024-09-10T11:13:56.276131+0000 (oldest deadline 2024-09-10T11:14:21.575955+0000) 2024-09-10T11:14:24.506 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:24 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:24.247+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:24.506 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:24 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:24.247+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:24.506 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:24 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:24.247+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:24.506 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:24 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:24.247+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:24.507 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:24 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:24.247+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:24.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:24.533+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:24.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:24.533+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:24.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:24.533+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:24.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:24.533+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:24.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:24 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:24.533+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:24.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:24 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:24.629+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:24.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:24 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:24.629+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:24.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:24 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:24.629+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:24.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:24 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:24.629+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:25.436 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:25.166+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:25.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:25.166+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:25.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:25.166+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:25.437 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:25.166+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.276216+0000 front 2024-09-10T11:13:56.276131+0000 (oldest deadline 2024-09-10T11:14:21.575955+0000) 2024-09-10T11:14:25.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:25 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:25.285+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:25.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:25 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:25.285+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:25.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:25 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:25.285+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:25.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:25 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:25.285+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:25.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:25 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:25.285+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:25.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:25 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:25.537+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:25.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:25 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:25.537+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:25.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:25 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:25.537+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:25.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:25 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:25.537+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:25.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:25 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:25.537+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:25.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:25.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:25.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:25.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:25.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:25.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:25.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:25.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:26.657 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:26 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:26.192+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:26.657 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:26 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:26.192+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:26.657 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:26 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:26.192+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:26.657 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:26 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:26.192+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.276216+0000 front 2024-09-10T11:13:56.276131+0000 (oldest deadline 2024-09-10T11:14:21.575955+0000) 2024-09-10T11:14:26.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:26 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:26.311+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:26.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:26 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:26.311+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:26.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:26 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:26.311+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:26.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:26 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:26.311+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:26.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:26 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:26.311+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:26.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:26 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:26.573+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:26.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:26 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:26.573+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:26.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:26 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:26.573+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:26.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:26 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:26.573+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:26.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:26 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:26.573+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:26.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:26 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:26.655+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:26.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:26 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:26.655+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:26.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:26 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:26.655+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:26.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:26 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:26.655+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:26.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:26 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:26.655+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:27.609 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:27 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:27.347+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:27.610 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:27 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:27.347+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:27.610 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:27 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:27.347+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:27.610 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:27 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:27.347+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:27.610 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:27 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:27.347+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:27.610 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:27 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:27.347+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:27.676 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:27.220+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:27.677 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:27.220+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:27.677 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:27.220+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:27.677 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:27.220+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.276216+0000 front 2024-09-10T11:13:56.276131+0000 (oldest deadline 2024-09-10T11:14:21.575955+0000) 2024-09-10T11:14:27.677 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:27.220+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.977478+0000 front 2024-09-10T11:14:04.977512+0000 (oldest deadline 2024-09-10T11:14:27.177981+0000) 2024-09-10T11:14:27.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:27 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:27.588+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:27.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:27 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:27.588+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:27.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:27 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:27.588+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:27.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:27 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:27.588+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:27.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:27 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:27.588+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:27.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:27 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:27.588+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:01.662968+0000 front 2024-09-10T11:14:01.663026+0000 (oldest deadline 2024-09-10T11:14:27.562746+0000) 2024-09-10T11:14:27.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:27.673+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:27.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:27.673+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:27.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:27.673+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:27.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:27.673+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:27.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:27 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:27.673+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:28.686 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:28.258+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:32.972336+0000 front 2024-09-10T11:13:32.972371+0000 (oldest deadline 2024-09-10T11:13:57.573030+0000) 2024-09-10T11:14:28.686 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:28.258+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.073920+0000 front 2024-09-10T11:13:41.073960+0000 (oldest deadline 2024-09-10T11:14:06.374077+0000) 2024-09-10T11:14:28.687 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:28.258+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.374800+0000 front 2024-09-10T11:13:46.374896+0000 (oldest deadline 2024-09-10T11:14:09.874568+0000) 2024-09-10T11:14:28.687 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:28.258+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.276216+0000 front 2024-09-10T11:13:56.276131+0000 (oldest deadline 2024-09-10T11:14:21.575955+0000) 2024-09-10T11:14:28.687 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8[54217]: 2024-09-10T11:14:28.258+0000 7f3952e54640 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.977478+0000 front 2024-09-10T11:14:04.977512+0000 (oldest deadline 2024-09-10T11:14:27.177981+0000) 2024-09-10T11:14:28.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:28 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:28.393+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:28.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:28 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:28.393+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:28.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:28 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:28.393+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:28.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:28 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:28.393+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:28.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:28 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:28.393+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:28.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:28 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:28.393+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:28.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:28 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:28.626+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:28.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:28 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:28.626+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:28.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:28 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:28.626+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:28.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:28 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:28.626+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:28.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:28 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:28.626+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:28.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:28 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:28.626+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:01.662968+0000 front 2024-09-10T11:14:01.663026+0000 (oldest deadline 2024-09-10T11:14:27.562746+0000) 2024-09-10T11:14:29.076 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:28.712+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:29.077 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:28.712+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:29.077 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:28.712+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:29.077 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:28.712+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:29.077 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:28 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:28.712+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:29.388 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:29 smithi181 podman[72987]: 2024-09-10 11:14:29.076201081 +0000 UTC m=+5.540515778 container died e67ec1751f6e454d3a56e6cafb726d625fb2ffdca4408ae90bb5e343eb7438d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T11:14:29.686 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:29 smithi181 podman[72987]: 2024-09-10 11:14:29.487045421 +0000 UTC m=+5.951360098 container cleanup e67ec1751f6e454d3a56e6cafb726d625fb2ffdca4408ae90bb5e343eb7438d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:14:29.686 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:29 smithi181 bash[72987]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8 2024-09-10T11:14:29.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:29 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:29.377+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:29.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:29 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:29.377+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:29.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:29 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:29.377+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:29.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:29 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:29.377+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:29.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:29 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:29.377+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:29.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:29 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:29.377+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:29.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:29 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:29.575+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:29.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:29 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:29.575+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:29.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:29 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:29.575+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:29.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:29 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:29.575+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:29.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:29 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:29.575+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:29.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:29 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:29.575+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:01.662968+0000 front 2024-09-10T11:14:01.663026+0000 (oldest deadline 2024-09-10T11:14:27.562746+0000) 2024-09-10T11:14:30.043 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:29 smithi181 podman[73016]: 2024-09-10 11:14:29.730405334 +0000 UTC m=+0.649820580 container remove e67ec1751f6e454d3a56e6cafb726d625fb2ffdca4408ae90bb5e343eb7438d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T11:14:30.043 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:29 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:29.689+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:30.044 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:29 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:29.689+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:30.044 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:29 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:29.689+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:30.044 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:29 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:29.689+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:30.044 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:29 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:29.689+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:30.351 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:30 smithi181 podman[73103]: 2024-09-10 11:14:29.94564566 +0000 UTC m=+0.015940545 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:14:30.351 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:30 smithi181 podman[73103]: 2024-09-10 11:14:30.047916169 +0000 UTC m=+0.118211054 container create b145a17f197834fa300c52b2c4e9c7db514f1f90f4fb106e01ebfa82e6662754 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:14:30.351 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:30 smithi181 podman[73103]: 2024-09-10 11:14:30.267375762 +0000 UTC m=+0.337670652 container init b145a17f197834fa300c52b2c4e9c7db514f1f90f4fb106e01ebfa82e6662754 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T11:14:30.351 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:30 smithi181 podman[73103]: 2024-09-10 11:14:30.270797459 +0000 UTC m=+0.341092347 container start b145a17f197834fa300c52b2c4e9c7db514f1f90f4fb106e01ebfa82e6662754 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T11:14:30.351 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:30 smithi181 podman[73103]: 2024-09-10 11:14:30.350430528 +0000 UTC m=+0.420725426 container attach b145a17f197834fa300c52b2c4e9c7db514f1f90f4fb106e01ebfa82e6662754 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T11:14:30.686 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 10 11:14:30 smithi181 podman[73103]: 2024-09-10 11:14:30.459972092 +0000 UTC m=+0.530266980 container died b145a17f197834fa300c52b2c4e9c7db514f1f90f4fb106e01ebfa82e6662754 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T11:14:30.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:30 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:30.374+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:30.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:30 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:30.374+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:30.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:30 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:30.374+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:30.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:30 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:30.374+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:30.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:30 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:30.374+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:30.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:30 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:30.374+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:30.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:30 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:30.616+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:30.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:30 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:30.616+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:30.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:30 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:30.616+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:30.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:30 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:30.616+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:30.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:30 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:30.616+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:30.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:30 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:30.616+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:01.662968+0000 front 2024-09-10T11:14:01.663026+0000 (oldest deadline 2024-09-10T11:14:27.562746+0000) 2024-09-10T11:14:31.155 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:30 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:30.695+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:31.155 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:30 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:30.695+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:31.155 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:30 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:30.695+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:31.155 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:30 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:30.695+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:31.155 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:30 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:30.695+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:31.178 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T11:14:31.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:14:31.258 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T11:14:31.258 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T11:14:31.258 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.9 2024-09-10T11:14:31.545 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 systemd[1]: Stopping Ceph osd.9 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:14:31.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:31 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:31.409+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:31.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:31 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:31.409+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:31.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:31 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:31.409+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:31.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:31 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:31.409+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:31.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:31 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:31.409+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:31.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:31 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:31.409+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:31.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:31.543+0000 7f689055f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:14:31.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:31.543+0000 7f689055f640 -1 osd.9 100 *** Got signal Terminated *** 2024-09-10T11:14:31.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:31.543+0000 7f689055f640 -1 osd.9 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:14:31.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:31.655+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:31.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:31.655+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:31.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:31.655+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:31.888 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:31.655+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:31.889 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:31.655+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:31.889 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:31 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:31.655+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:01.662968+0000 front 2024-09-10T11:14:01.663026+0000 (oldest deadline 2024-09-10T11:14:27.562746+0000) 2024-09-10T11:14:31.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:31 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:31.662+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:31.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:31 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:31.662+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:31.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:31 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:31.662+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:31.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:31 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:31.662+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:31.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:31 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:31.662+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:32.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:32 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:32.370+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:32.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:32 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:32.370+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:32.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:32 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:32.370+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:32.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:32 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:32.370+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:32.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:32 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:32.370+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:32.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:32 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:32.370+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:32.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:32 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:32.644+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:32.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:32 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:32.644+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:32.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:32 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:32.644+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:32.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:32 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:32.644+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:32.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:32 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:32.644+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:33.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:32 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:32.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:33.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:32 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:32.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:33.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:32 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:32.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:33.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:32 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:32.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:33.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:32 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:32.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:33.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:32 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:32.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:01.662968+0000 front 2024-09-10T11:14:01.663026+0000 (oldest deadline 2024-09-10T11:14:27.562746+0000) 2024-09-10T11:14:33.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:33 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:33.389+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:33.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:33 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:33.389+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:33.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:33 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:33.389+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:33.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:33 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:33.389+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:33.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:33 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:33.389+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:33.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:33 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:33.389+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:33.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:33 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:33.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:33.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:33 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:33.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:33.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:33 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:33.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:33.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:33 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:33.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:33.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:33 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:33.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:34.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:33.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:34.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:33.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:34.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:33.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:34.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:33.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:34.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:33.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:34.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:33 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:33.688+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:01.662968+0000 front 2024-09-10T11:14:01.663026+0000 (oldest deadline 2024-09-10T11:14:27.562746+0000) 2024-09-10T11:14:34.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:34 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:34.368+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:34.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:34 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:34.368+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:34.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:34 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:34.368+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:34.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:34 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:34.368+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:34.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:34 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:34.368+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:34.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:34 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:34.368+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:34.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:34.620+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:34.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:34.620+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:34.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:34.620+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:34.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:34.620+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:34.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:34.620+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:35.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:34.658+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:35.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:34.658+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:35.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:34.658+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:35.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:34.658+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:35.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:34.658+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:35.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:34 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:34.658+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:01.662968+0000 front 2024-09-10T11:14:01.663026+0000 (oldest deadline 2024-09-10T11:14:27.562746+0000) 2024-09-10T11:14:35.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:35 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:35.404+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:35.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:35 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:35.404+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:35.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:35 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:35.404+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:35.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:35 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:35.404+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:35.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:35 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:35.404+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:35.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:35 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:35.404+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:35.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:35 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:35.404+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:08.784445+0000 front 2024-09-10T11:14:08.784348+0000 (oldest deadline 2024-09-10T11:14:34.684271+0000) 2024-09-10T11:14:35.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:35 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:35.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:35.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:35 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:35.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:35.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:35 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:35.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:35.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:35 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:35.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:35.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:35 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:35.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:36.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:35 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:35.684+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:21.357677+0000 front 2024-09-10T11:13:21.357407+0000 (oldest deadline 2024-09-10T11:13:47.257498+0000) 2024-09-10T11:14:36.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:35 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:35.684+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:33.158558+0000 front 2024-09-10T11:13:33.158845+0000 (oldest deadline 2024-09-10T11:13:57.258512+0000) 2024-09-10T11:14:36.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:35 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:35.684+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:41.160606+0000 front 2024-09-10T11:13:41.160626+0000 (oldest deadline 2024-09-10T11:14:05.860417+0000) 2024-09-10T11:14:36.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:35 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:35.684+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:45.860979+0000 front 2024-09-10T11:13:45.860900+0000 (oldest deadline 2024-09-10T11:14:10.560962+0000) 2024-09-10T11:14:36.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:35 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:35.684+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:56.362296+0000 front 2024-09-10T11:13:56.362329+0000 (oldest deadline 2024-09-10T11:14:21.662307+0000) 2024-09-10T11:14:36.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:35 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:35.684+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:01.662968+0000 front 2024-09-10T11:14:01.663026+0000 (oldest deadline 2024-09-10T11:14:27.562746+0000) 2024-09-10T11:14:36.138 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:35 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9[62766]: 2024-09-10T11:14:35.684+0000 7f688cb75640 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:09.263756+0000 front 2024-09-10T11:14:09.263734+0000 (oldest deadline 2024-09-10T11:14:35.664293+0000) 2024-09-10T11:14:36.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:36.382+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:36.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:36.382+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:36.713 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:36.382+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:36.713 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:36.382+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:36.713 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:36.382+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:36.713 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:36.382+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:36.713 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:36 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:36.382+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:08.784445+0000 front 2024-09-10T11:14:08.784348+0000 (oldest deadline 2024-09-10T11:14:34.684271+0000) 2024-09-10T11:14:36.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:36.614+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:36.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:36.614+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:36.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:36.614+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:36.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:36.614+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:36.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:36.614+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:36.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:36 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:36.614+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:37.122 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:36 smithi059 podman[89028]: 2024-09-10 11:14:36.85789324 +0000 UTC m=+5.393555771 container died 3ae62eed86c53ade9f93ca6498d35b76c92ba603e3c637f6b2043f9f14e0bf20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T11:14:37.388 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:37 smithi059 podman[89028]: 2024-09-10 11:14:37.194253221 +0000 UTC m=+5.729915751 container cleanup 3ae62eed86c53ade9f93ca6498d35b76c92ba603e3c637f6b2043f9f14e0bf20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T11:14:37.388 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:37 smithi059 bash[89028]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9 2024-09-10T11:14:37.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:37.371+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:37.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:37.371+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:37.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:37.371+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:37.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:37.371+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:37.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:37.371+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:37.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:37.371+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:37.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:37 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:37.371+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:08.784445+0000 front 2024-09-10T11:14:08.784348+0000 (oldest deadline 2024-09-10T11:14:34.684271+0000) 2024-09-10T11:14:37.814 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:37 smithi059 podman[89045]: 2024-09-10 11:14:37.395351636 +0000 UTC m=+0.530748812 container remove 3ae62eed86c53ade9f93ca6498d35b76c92ba603e3c637f6b2043f9f14e0bf20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T11:14:37.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:37.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:37.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:37.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:37.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:37.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:37.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:37.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:37.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:37.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:37.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:37 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:37.612+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:38.066 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:37 smithi059 podman[89135]: 2024-09-10 11:14:37.716422926 +0000 UTC m=+0.016403864 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:14:38.066 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:37 smithi059 podman[89135]: 2024-09-10 11:14:37.946470612 +0000 UTC m=+0.246451596 container create efdf88cf93f2f004ff3689bc3be1920d291b76c8b56ab2b2d2552679789f9825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T11:14:38.387 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:38 smithi059 podman[89135]: 2024-09-10 11:14:38.182291986 +0000 UTC m=+0.482272927 container init efdf88cf93f2f004ff3689bc3be1920d291b76c8b56ab2b2d2552679789f9825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T11:14:38.387 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:38 smithi059 podman[89135]: 2024-09-10 11:14:38.18594381 +0000 UTC m=+0.485924755 container start efdf88cf93f2f004ff3689bc3be1920d291b76c8b56ab2b2d2552679789f9825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:14:38.387 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:38 smithi059 podman[89135]: 2024-09-10 11:14:38.257235183 +0000 UTC m=+0.557216128 container attach efdf88cf93f2f004ff3689bc3be1920d291b76c8b56ab2b2d2552679789f9825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T11:14:38.637 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 11:14:38 smithi059 podman[89135]: 2024-09-10 11:14:38.386737504 +0000 UTC m=+0.686718446 container died efdf88cf93f2f004ff3689bc3be1920d291b76c8b56ab2b2d2552679789f9825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T11:14:38.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:38 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:38.325+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:38.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:38 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:38.325+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:38.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:38 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:38.325+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:38.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:38 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:38.325+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:38.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:38 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:38.325+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:38.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:38 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:38.325+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:38.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:38 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:38.325+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:08.784445+0000 front 2024-09-10T11:14:08.784348+0000 (oldest deadline 2024-09-10T11:14:34.684271+0000) 2024-09-10T11:14:38.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:38.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:38.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:38.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:38.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:38.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:38.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:38.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:38.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:38.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:38.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:38.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:38.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T11:14:38.991 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:14:38.991 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T11:14:38.992 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T11:14:38.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.10 2024-09-10T11:14:39.313 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 systemd[1]: Stopping Ceph osd.10 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:14:39.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.311+0000 7fdd426fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:14:39.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.311+0000 7fdd426fc640 -1 osd.10 100 *** Got signal Terminated *** 2024-09-10T11:14:39.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.311+0000 7fdd426fc640 -1 osd.10 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:14:39.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.334+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:39.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.334+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:39.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.334+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:39.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.334+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:39.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.334+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:39.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.334+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:39.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:39 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:39.334+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:08.784445+0000 front 2024-09-10T11:14:08.784348+0000 (oldest deadline 2024-09-10T11:14:34.684271+0000) 2024-09-10T11:14:39.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:39 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:39.623+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:39.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:39 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:39.623+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:39.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:39 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:39.623+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:39.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:39 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:39.623+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:39.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:39 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:39.623+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:39.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:39 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:39.623+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:40.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:40.362+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:40.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:40.362+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:40.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:40.362+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:40.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:40.362+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:40.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:40.362+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:40.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:40.362+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:40.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:40 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:40.362+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:08.784445+0000 front 2024-09-10T11:14:08.784348+0000 (oldest deadline 2024-09-10T11:14:34.684271+0000) 2024-09-10T11:14:40.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:40 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:40.640+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:40.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:40 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:40.640+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:40.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:40 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:40.640+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:40.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:40 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:40.640+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:40.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:40 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:40.640+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:40.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:40 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:40.640+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:41.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:41.395+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:41.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:41.395+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:41.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:41.395+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:41.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:41.395+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:41.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:41.395+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:41.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:41.395+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:41.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:41 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:41.395+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:08.784445+0000 front 2024-09-10T11:14:08.784348+0000 (oldest deadline 2024-09-10T11:14:34.684271+0000) 2024-09-10T11:14:41.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:41 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:41.624+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:41.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:41 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:41.624+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:41.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:41 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:41.624+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:41.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:41 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:41.624+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:41.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:41 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:41.624+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:41.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:41 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:41.624+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:42.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:42 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:42.399+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:42.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:42 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:42.399+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:42.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:42 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:42.399+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:42.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:42 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:42.399+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:42.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:42 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:42.399+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:42.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:42 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:42.399+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:42.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:42 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:42.399+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:08.784445+0000 front 2024-09-10T11:14:08.784348+0000 (oldest deadline 2024-09-10T11:14:34.684271+0000) 2024-09-10T11:14:42.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:42 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:42.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:42.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:42 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:42.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:42.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:42 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:42.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:42.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:42 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:42.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:42.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:42 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:42.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:42.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:42 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:42.609+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:43.708 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:43 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:43.388+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:23.477952+0000 front 2024-09-10T11:13:23.477814+0000 (oldest deadline 2024-09-10T11:13:50.478450+0000) 2024-09-10T11:14:43.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:43 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:43.388+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:30.478852+0000 front 2024-09-10T11:13:30.478736+0000 (oldest deadline 2024-09-10T11:13:56.378884+0000) 2024-09-10T11:14:43.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:43 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:43.388+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:40.280696+0000 front 2024-09-10T11:13:40.280933+0000 (oldest deadline 2024-09-10T11:14:06.180625+0000) 2024-09-10T11:14:43.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:43 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:43.388+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T11:13:46.181396+0000 front 2024-09-10T11:13:46.181280+0000 (oldest deadline 2024-09-10T11:14:09.681190+0000) 2024-09-10T11:14:43.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:43 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:43.388+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.981845+0000 front 2024-09-10T11:13:54.981815+0000 (oldest deadline 2024-09-10T11:14:19.081885+0000) 2024-09-10T11:14:43.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:43 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:43.388+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:13:59.582853+0000 front 2024-09-10T11:13:59.582798+0000 (oldest deadline 2024-09-10T11:14:27.183013+0000) 2024-09-10T11:14:43.709 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:43 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10[60007]: 2024-09-10T11:14:43.388+0000 7fdd3ad0a640 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:08.784445+0000 front 2024-09-10T11:14:08.784348+0000 (oldest deadline 2024-09-10T11:14:34.684271+0000) 2024-09-10T11:14:43.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:43 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:43.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:43.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:43 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:43.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:43.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:43 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:43.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:43.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:43 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:43.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:43.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:43 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:43.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:43.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:43 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:43.603+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:44.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:44 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:44.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:44.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:44 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:44.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:44.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:44 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:44.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:44.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:44 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:44.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:44.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:44 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:44.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:44.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:44 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:44.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:44.938 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:44 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:44.578+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-10T11:14:19.601067+0000 front 2024-09-10T11:14:19.600990+0000 (oldest deadline 2024-09-10T11:14:43.700863+0000) 2024-09-10T11:14:45.003 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:44 smithi115 podman[71469]: 2024-09-10 11:14:44.733832077 +0000 UTC m=+5.537390347 container died 22d595cbd5ff057412472ba1e6bbe80492b8dc351ee18d4557e34352eba351c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T11:14:45.254 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:45 smithi115 podman[71469]: 2024-09-10 11:14:45.002781691 +0000 UTC m=+5.806339947 container cleanup 22d595cbd5ff057412472ba1e6bbe80492b8dc351ee18d4557e34352eba351c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T11:14:45.254 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:45 smithi115 bash[71469]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10 2024-09-10T11:14:45.554 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:45 smithi115 podman[71483]: 2024-09-10 11:14:45.253688599 +0000 UTC m=+0.512403760 container remove 22d595cbd5ff057412472ba1e6bbe80492b8dc351ee18d4557e34352eba351c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T11:14:45.848 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:45 smithi115 podman[71575]: 2024-09-10 11:14:45.55438439 +0000 UTC m=+0.098386098 container create 8948e9a3dffd4c7c0dd5f64d1995353eaac352f37b8d98dfe66da1d3fbd3dff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T11:14:45.849 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:45 smithi115 podman[71575]: 2024-09-10 11:14:45.471881259 +0000 UTC m=+0.015882976 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:14:45.849 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:45 smithi115 podman[71575]: 2024-09-10 11:14:45.773462486 +0000 UTC m=+0.317464217 container init 8948e9a3dffd4c7c0dd5f64d1995353eaac352f37b8d98dfe66da1d3fbd3dff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:14:45.849 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:45 smithi115 podman[71575]: 2024-09-10 11:14:45.776663986 +0000 UTC m=+0.320665695 container start 8948e9a3dffd4c7c0dd5f64d1995353eaac352f37b8d98dfe66da1d3fbd3dff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T11:14:45.849 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:45 smithi115 podman[71575]: 2024-09-10 11:14:45.848141172 +0000 UTC m=+0.392142886 container attach 8948e9a3dffd4c7c0dd5f64d1995353eaac352f37b8d98dfe66da1d3fbd3dff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T11:14:45.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:45 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:45.617+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:45.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:45 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:45.617+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:45.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:45 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:45.617+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:45.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:45 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:45.617+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:45.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:45 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:45.617+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:45.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:45 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:45.617+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:45.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:45 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:45.617+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-10T11:14:19.601067+0000 front 2024-09-10T11:14:19.600990+0000 (oldest deadline 2024-09-10T11:14:43.700863+0000) 2024-09-10T11:14:46.208 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:45 smithi115 podman[71575]: 2024-09-10 11:14:45.961040518 +0000 UTC m=+0.505042246 container died 8948e9a3dffd4c7c0dd5f64d1995353eaac352f37b8d98dfe66da1d3fbd3dff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T11:14:46.494 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 10 11:14:46 smithi115 podman[71598]: 2024-09-10 11:14:46.475979676 +0000 UTC m=+0.505163245 container remove 8948e9a3dffd4c7c0dd5f64d1995353eaac352f37b8d98dfe66da1d3fbd3dff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:14:46.499 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T11:14:46.536 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:14:46.536 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T11:14:46.536 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T11:14:46.537 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.11 2024-09-10T11:14:46.849 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 systemd[1]: Stopping Ceph osd.11 for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:14:46.849 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.607+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:46.849 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.607+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:46.849 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.607+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:46.849 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.607+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:46.849 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.607+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:46.850 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.607+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:46.850 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.607+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-10T11:14:19.601067+0000 front 2024-09-10T11:14:19.600990+0000 (oldest deadline 2024-09-10T11:14:43.700863+0000) 2024-09-10T11:14:46.850 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.848+0000 7f73a29ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:14:47.186 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.848+0000 7f73a29ac640 -1 osd.11 100 *** Got signal Terminated *** 2024-09-10T11:14:47.186 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:46 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:46.848+0000 7f73a29ac640 -1 osd.11 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:14:47.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:47 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:47.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:47.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:47 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:47.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:47.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:47 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:47.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:47.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:47 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:47.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:47.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:47 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:47.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:47.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:47 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:47.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:47.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:47 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:47.610+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-10T11:14:19.601067+0000 front 2024-09-10T11:14:19.600990+0000 (oldest deadline 2024-09-10T11:14:43.700863+0000) 2024-09-10T11:14:48.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:48.608+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:48.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:48.608+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:48.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:48.608+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:48.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:48.608+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:48.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:48.608+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:48.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:48.608+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:48.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:48 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:48.608+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-10T11:14:19.601067+0000 front 2024-09-10T11:14:19.600990+0000 (oldest deadline 2024-09-10T11:14:43.700863+0000) 2024-09-10T11:14:49.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:49.606+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:49.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:49.606+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:49.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:49.606+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:49.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:49.606+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:49.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:49.606+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:49.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:49.606+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:49.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:49 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:49.606+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-10T11:14:19.601067+0000 front 2024-09-10T11:14:19.600990+0000 (oldest deadline 2024-09-10T11:14:43.700863+0000) 2024-09-10T11:14:50.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:50.645+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:50.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:50.645+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:50.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:50.645+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:50.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:50.645+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:50.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:50.645+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:50.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:50.645+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:50.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:50.645+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-10T11:14:19.601067+0000 front 2024-09-10T11:14:19.600990+0000 (oldest deadline 2024-09-10T11:14:43.700863+0000) 2024-09-10T11:14:50.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:50 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:50.645+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6820 osd.8 since back 2024-09-10T11:14:28.401735+0000 front 2024-09-10T11:14:28.401762+0000 (oldest deadline 2024-09-10T11:14:50.101745+0000) 2024-09-10T11:14:51.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:51.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T11:13:24.793613+0000 front 2024-09-10T11:13:24.793417+0000 (oldest deadline 2024-09-10T11:13:48.293343+0000) 2024-09-10T11:14:51.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:51.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-10T11:13:28.293756+0000 front 2024-09-10T11:13:28.293843+0000 (oldest deadline 2024-09-10T11:13:55.894389+0000) 2024-09-10T11:14:51.936 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:51.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-10T11:13:35.894890+0000 front 2024-09-10T11:13:35.895014+0000 (oldest deadline 2024-09-10T11:14:01.795107+0000) 2024-09-10T11:14:51.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:51.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-10T11:13:54.597460+0000 front 2024-09-10T11:13:54.597397+0000 (oldest deadline 2024-09-10T11:14:20.497444+0000) 2024-09-10T11:14:51.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:51.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-10T11:14:04.598259+0000 front 2024-09-10T11:14:04.598220+0000 (oldest deadline 2024-09-10T11:14:25.698304+0000) 2024-09-10T11:14:51.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:51.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T11:14:11.499636+0000 front 2024-09-10T11:14:11.499770+0000 (oldest deadline 2024-09-10T11:14:36.199653+0000) 2024-09-10T11:14:51.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:51.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-10T11:14:19.601067+0000 front 2024-09-10T11:14:19.600990+0000 (oldest deadline 2024-09-10T11:14:43.700863+0000) 2024-09-10T11:14:51.937 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:51 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11[60754]: 2024-09-10T11:14:51.649+0000 7f739afba640 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.181:6820 osd.8 since back 2024-09-10T11:14:28.401735+0000 front 2024-09-10T11:14:28.401762+0000 (oldest deadline 2024-09-10T11:14:50.101745+0000) 2024-09-10T11:14:52.466 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:52 smithi181 podman[73205]: 2024-09-10 11:14:52.195477333 +0000 UTC m=+5.464537405 container died 0999e238ddea7ea4ef5ae890f1876d082ac36efcf35edc5187124bb9b29bfa07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-10T11:14:52.883 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:52 smithi181 podman[73205]: 2024-09-10 11:14:52.572840756 +0000 UTC m=+5.841900817 container cleanup 0999e238ddea7ea4ef5ae890f1876d082ac36efcf35edc5187124bb9b29bfa07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:14:52.883 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:52 smithi181 bash[73205]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11 2024-09-10T11:14:53.186 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:52 smithi181 podman[73221]: 2024-09-10 11:14:52.882415564 +0000 UTC m=+0.686993840 container remove 0999e238ddea7ea4ef5ae890f1876d082ac36efcf35edc5187124bb9b29bfa07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T11:14:53.503 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:53 smithi181 podman[73306]: 2024-09-10 11:14:53.216601766 +0000 UTC m=+0.093612629 container create 541eed30feca4f93676e8578c7ab297de8548dd8a2deb5b3f229c2dc1520d66d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T11:14:53.503 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:53 smithi181 podman[73306]: 2024-09-10 11:14:53.138794638 +0000 UTC m=+0.015805516 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:14:53.503 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:53 smithi181 podman[73306]: 2024-09-10 11:14:53.419063458 +0000 UTC m=+0.296074332 container init 541eed30feca4f93676e8578c7ab297de8548dd8a2deb5b3f229c2dc1520d66d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T11:14:53.503 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:53 smithi181 podman[73306]: 2024-09-10 11:14:53.422446127 +0000 UTC m=+0.299456991 container start 541eed30feca4f93676e8578c7ab297de8548dd8a2deb5b3f229c2dc1520d66d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2) 2024-09-10T11:14:53.503 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:53 smithi181 podman[73306]: 2024-09-10 11:14:53.502358053 +0000 UTC m=+0.379368930 container attach 541eed30feca4f93676e8578c7ab297de8548dd8a2deb5b3f229c2dc1520d66d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T11:14:53.856 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 10 11:14:53 smithi181 podman[73306]: 2024-09-10 11:14:53.607472722 +0000 UTC m=+0.484483588 container died 541eed30feca4f93676e8578c7ab297de8548dd8a2deb5b3f229c2dc1520d66d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T11:14:54.133 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T11:14:54.170 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:14:54.170 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T11:14:54.171 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T11:14:54.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.a 2024-09-10T11:14:54.464 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:54 smithi059 systemd[1]: Stopping Ceph mds.a for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:14:54.887 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:54 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a[69532]: 2024-09-10T11:14:54.462+0000 7f6be7c55640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:14:54.888 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:54 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a[69532]: 2024-09-10T11:14:54.462+0000 7f6be7c55640 -1 mds.a *** got signal Terminated *** 2024-09-10T11:14:58.589 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:58 smithi059 podman[89249]: 2024-09-10 11:14:58.323848052 +0000 UTC m=+3.956042632 container died c7177cafb17be9b25e53fc4425237901383683c2512f8a9335287b57ff9e7e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:14:58.847 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:58 smithi059 podman[89249]: 2024-09-10 11:14:58.662340368 +0000 UTC m=+4.294534971 container cleanup c7177cafb17be9b25e53fc4425237901383683c2512f8a9335287b57ff9e7e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T11:14:58.847 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:58 smithi059 bash[89249]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a 2024-09-10T11:14:59.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T11:14:59.107 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:58 smithi059 podman[89261]: 2024-09-10 11:14:58.846823658 +0000 UTC m=+0.524504172 container remove c7177cafb17be9b25e53fc4425237901383683c2512f8a9335287b57ff9e7e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True) 2024-09-10T11:14:59.107 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:59 smithi059 systemd[1]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-10T11:14:59.107 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:59 smithi059 systemd[1]: Stopped Ceph mds.a for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T11:14:59.107 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 11:14:59 smithi059 systemd[1]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.a.service: Consumed 1.133s CPU time. 2024-09-10T11:14:59.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:14:59.120 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T11:14:59.120 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T11:14:59.120 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.d 2024-09-10T11:14:59.388 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 11:14:59 smithi059 systemd[1]: Stopping Ceph mds.d for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:14:59.887 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 11:14:59 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-d[68323]: 2024-09-10T11:14:59.440+0000 7f028cd76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:14:59.888 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 11:14:59 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-d[68323]: 2024-09-10T11:14:59.440+0000 7f028cd76640 -1 mds.d *** got signal Terminated *** 2024-09-10T11:15:03.042 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 11:15:02 smithi059 podman[89366]: 2024-09-10 11:15:02.757896619 +0000 UTC m=+3.415409280 container died 384041201ca916daf7b27610cefdb9b9c73660e9fbb6728aa63de8f72b2ca77d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T11:15:03.388 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 11:15:03 smithi059 podman[89366]: 2024-09-10 11:15:03.140943935 +0000 UTC m=+3.798456595 container cleanup 384041201ca916daf7b27610cefdb9b9c73660e9fbb6728aa63de8f72b2ca77d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T11:15:03.388 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 11:15:03 smithi059 bash[89366]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-d 2024-09-10T11:15:03.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T11:15:03.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:03.622 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T11:15:03.622 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T11:15:03.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.g 2024-09-10T11:15:03.954 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 11:15:03 smithi059 systemd[1]: Stopping Ceph mds.g for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:04.388 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 11:15:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-g[69209]: 2024-09-10T11:15:03.952+0000 7f248307a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:04.388 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 11:15:03 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-g[69209]: 2024-09-10T11:15:03.952+0000 7f248307a640 -1 mds.g *** got signal Terminated *** 2024-09-10T11:15:07.595 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 11:15:07 smithi059 podman[89488]: 2024-09-10 11:15:07.331722549 +0000 UTC m=+3.487622486 container died 8a47b092f746c618d9fe4e658c2615fe9ab0308eec387eb67d53f6a07366f82d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T11:15:07.887 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 11:15:07 smithi059 podman[89488]: 2024-09-10 11:15:07.686586674 +0000 UTC m=+3.842486610 container cleanup 8a47b092f746c618d9fe4e658c2615fe9ab0308eec387eb67d53f6a07366f82d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:15:07.888 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 11:15:07 smithi059 bash[89488]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-g 2024-09-10T11:15:08.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T11:15:08.208 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:08.209 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T11:15:08.209 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T11:15:08.209 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.j 2024-09-10T11:15:08.637 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 11:15:08 smithi059 systemd[1]: Stopping Ceph mds.j for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:08.638 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 11:15:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-j[67924]: 2024-09-10T11:15:08.530+0000 7f964acfb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:08.638 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 11:15:08 smithi059 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-j[67924]: 2024-09-10T11:15:08.530+0000 7f964acfb640 -1 mds.j *** got signal Terminated *** 2024-09-10T11:15:11.388 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 11:15:11 smithi059 podman[89610]: 2024-09-10 11:15:11.136777061 +0000 UTC m=+2.697401783 container died 719175ea0b31a52f1985ab808b60c36e0f14c451bb337711db0f5c5eb9d42349 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-j, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:15:11.866 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 11:15:11 smithi059 podman[89610]: 2024-09-10 11:15:11.614846803 +0000 UTC m=+3.175471525 container cleanup 719175ea0b31a52f1985ab808b60c36e0f14c451bb337711db0f5c5eb9d42349 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T11:15:11.866 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 11:15:11 smithi059 bash[89610]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-j 2024-09-10T11:15:12.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T11:15:12.038 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:12.039 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T11:15:12.039 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T11:15:12.039 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.b 2024-09-10T11:15:12.326 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:15:12 smithi115 systemd[1]: Stopping Ceph mds.b for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:12.651 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:15:12 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b[65348]: 2024-09-10T11:15:12.324+0000 7f4c9b912640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:12.651 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:15:12 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b[65348]: 2024-09-10T11:15:12.324+0000 7f4c9b912640 -1 mds.b *** got signal Terminated *** 2024-09-10T11:15:14.000 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:15:13 smithi115 podman[71677]: 2024-09-10 11:15:13.720283138 +0000 UTC m=+1.493172953 container died 7c22dccd851494a028bce8fa280122a7ee2fde57ac6b9e84b5b8d111d760d105 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T11:15:14.309 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:15:14 smithi115 podman[71677]: 2024-09-10 11:15:14.09941692 +0000 UTC m=+1.872306781 container cleanup 7c22dccd851494a028bce8fa280122a7ee2fde57ac6b9e84b5b8d111d760d105 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T11:15:14.309 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 10 11:15:14 smithi115 bash[71677]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-b 2024-09-10T11:15:14.454 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T11:15:14.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:14.490 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T11:15:14.490 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T11:15:14.490 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.e 2024-09-10T11:15:14.958 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:15:14 smithi115 systemd[1]: Stopping Ceph mds.e for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:14.958 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:15:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e[64734]: 2024-09-10T11:15:14.801+0000 7f83be90d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:14.958 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:15:14 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e[64734]: 2024-09-10T11:15:14.801+0000 7f83be90d640 -1 mds.e *** got signal Terminated *** 2024-09-10T11:15:17.986 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:15:17 smithi115 podman[71809]: 2024-09-10 11:15:17.732415327 +0000 UTC m=+3.023788028 container died 7dc7dcbb6de7b21c15e56892e771c61774d79bc85983d048012753b3c7ab26e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T11:15:18.237 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:15:18 smithi115 podman[71809]: 2024-09-10 11:15:18.077393357 +0000 UTC m=+3.368766058 container cleanup 7dc7dcbb6de7b21c15e56892e771c61774d79bc85983d048012753b3c7ab26e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:15:18.238 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 10 11:15:18 smithi115 bash[71809]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-e 2024-09-10T11:15:18.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T11:15:18.484 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:18.484 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T11:15:18.484 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T11:15:18.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.h 2024-09-10T11:15:18.807 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:18 smithi115 systemd[1]: Stopping Ceph mds.h for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:19.208 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h[65035]: 2024-09-10T11:15:18.805+0000 7f15c7cbb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:19.208 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:18 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h[65035]: 2024-09-10T11:15:18.805+0000 7f15c7cbb640 -1 mds.h *** got signal Terminated *** 2024-09-10T11:15:21.990 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:21 smithi115 podman[71931]: 2024-09-10 11:15:21.730959505 +0000 UTC m=+3.021205020 container died ded43844aba23b0f893472e34fdaf9064e564afab34c73c0e9f825882334c8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:15:22.257 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:22 smithi115 podman[71931]: 2024-09-10 11:15:22.06402819 +0000 UTC m=+3.354273702 container cleanup ded43844aba23b0f893472e34fdaf9064e564afab34c73c0e9f825882334c8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T11:15:22.257 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:22 smithi115 bash[71931]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h 2024-09-10T11:15:22.499 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T11:15:22.521 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:22 smithi115 podman[71943]: 2024-09-10 11:15:22.256580474 +0000 UTC m=+0.525736153 container remove ded43844aba23b0f893472e34fdaf9064e564afab34c73c0e9f825882334c8b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:15:22.521 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:22 smithi115 systemd[1]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-10T11:15:22.521 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:22 smithi115 systemd[1]: Stopped Ceph mds.h for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T11:15:22.521 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 10 11:15:22 smithi115 systemd[1]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.h.service: Consumed 1.997s CPU time. 2024-09-10T11:15:22.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:22.531 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T11:15:22.532 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T11:15:22.532 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.k 2024-09-10T11:15:22.834 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 11:15:22 smithi115 systemd[1]: Stopping Ceph mds.k for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:23.208 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 11:15:22 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-k[64432]: 2024-09-10T11:15:22.833+0000 7f5e0762a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:23.209 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 11:15:22 smithi115 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-k[64432]: 2024-09-10T11:15:22.833+0000 7f5e0762a640 -1 mds.k *** got signal Terminated *** 2024-09-10T11:15:24.318 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 11:15:24 smithi115 podman[72051]: 2024-09-10 11:15:24.029449032 +0000 UTC m=+1.287382088 container died d9a80b5aec544bff14d74ae01becb399b6aa77c6b1a63bba931de6b2f1719a82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T11:15:24.626 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 11:15:24 smithi115 podman[72051]: 2024-09-10 11:15:24.417168553 +0000 UTC m=+1.675101621 container cleanup d9a80b5aec544bff14d74ae01becb399b6aa77c6b1a63bba931de6b2f1719a82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:15:24.626 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 10 11:15:24 smithi115 bash[72051]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-k 2024-09-10T11:15:24.762 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T11:15:24.793 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:24.794 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T11:15:24.794 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T11:15:24.794 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.c 2024-09-10T11:15:25.083 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:15:24 smithi181 systemd[1]: Stopping Ceph mds.c for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:25.436 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:15:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c[66006]: 2024-09-10T11:15:25.102+0000 7f1daf1e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:25.436 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:15:25 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c[66006]: 2024-09-10T11:15:25.102+0000 7f1daf1e6640 -1 mds.c *** got signal Terminated *** 2024-09-10T11:15:29.436 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:15:29 smithi181 podman[73409]: 2024-09-10 11:15:29.110190659 +0000 UTC m=+4.119936566 container died 4c5c205ff79184a8dfae3031b19eba7de6db7b30b84162e6e0fb2b413fd1f833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T11:15:29.936 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:15:29 smithi181 podman[73409]: 2024-09-10 11:15:29.554779698 +0000 UTC m=+4.564525592 container cleanup 4c5c205ff79184a8dfae3031b19eba7de6db7b30b84162e6e0fb2b413fd1f833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-10T11:15:29.937 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:15:29 smithi181 bash[73409]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c 2024-09-10T11:15:29.937 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 10 11:15:29 smithi181 podman[73434]: 2024-09-10 11:15:29.72278663 +0000 UTC m=+0.607448955 container remove 4c5c205ff79184a8dfae3031b19eba7de6db7b30b84162e6e0fb2b413fd1f833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T11:15:29.990 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T11:15:30.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:30.027 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T11:15:30.027 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T11:15:30.028 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.f 2024-09-10T11:15:30.368 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:15:30 smithi181 systemd[1]: Stopping Ceph mds.f for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:30.686 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:15:30 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f[65704]: 2024-09-10T11:15:30.366+0000 7f641e4a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:30.686 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:15:30 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f[65704]: 2024-09-10T11:15:30.366+0000 7f641e4a2640 -1 mds.f *** got signal Terminated *** 2024-09-10T11:15:33.984 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:15:33 smithi181 podman[73543]: 2024-09-10 11:15:33.726128204 +0000 UTC m=+3.472195531 container died 8c4d874877d802afc41098e127015f1419586ff398fe1366ca9e1873985f5bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T11:15:34.360 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:15:34 smithi181 podman[73543]: 2024-09-10 11:15:34.091768844 +0000 UTC m=+3.837836172 container cleanup 8c4d874877d802afc41098e127015f1419586ff398fe1366ca9e1873985f5bfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:15:34.360 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 10 11:15:34 smithi181 bash[73543]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-f 2024-09-10T11:15:34.515 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T11:15:34.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:34.589 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T11:15:34.589 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T11:15:34.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.i 2024-09-10T11:15:34.913 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:15:34 smithi181 systemd[1]: Stopping Ceph mds.i for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:35.186 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:15:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i[66304]: 2024-09-10T11:15:34.911+0000 7ff3534a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:35.186 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:15:34 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i[66304]: 2024-09-10T11:15:34.911+0000 7ff3534a5640 -1 mds.i *** got signal Terminated *** 2024-09-10T11:15:37.997 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:15:37 smithi181 podman[73663]: 2024-09-10 11:15:37.726013432 +0000 UTC m=+2.916548595 container died aa81da2952fd7d059582cd67bc508b8e368df8ad6d339b14b73f1cb968520171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T11:15:38.330 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:15:38 smithi181 podman[73663]: 2024-09-10 11:15:38.08724234 +0000 UTC m=+3.277777512 container cleanup aa81da2952fd7d059582cd67bc508b8e368df8ad6d339b14b73f1cb968520171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T11:15:38.330 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 10 11:15:38 smithi181 bash[73663]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-i 2024-09-10T11:15:38.468 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T11:15:38.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:38.502 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T11:15:38.502 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T11:15:38.502 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.l 2024-09-10T11:15:38.936 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:38 smithi181 systemd[1]: Stopping Ceph mds.l for 86a09b02-6f62-11ef-bcea-c7b262605968... 2024-09-10T11:15:38.937 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l[65404]: 2024-09-10T11:15:38.815+0000 7f7245f32640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:15:38.937 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:38 smithi181 ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l[65404]: 2024-09-10T11:15:38.815+0000 7f7245f32640 -1 mds.l *** got signal Terminated *** 2024-09-10T11:15:41.742 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:41 smithi181 podman[73782]: 2024-09-10 11:15:41.466887076 +0000 UTC m=+2.749311236 container died e1dd3464e4eb38538a86afdc6335c10a16345787e332f6ebc6aa5a57138aaf64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T11:15:41.993 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:41 smithi181 podman[73782]: 2024-09-10 11:15:41.817148898 +0000 UTC m=+3.099573060 container cleanup e1dd3464e4eb38538a86afdc6335c10a16345787e332f6ebc6aa5a57138aaf64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-10T11:15:41.993 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:41 smithi181 bash[73782]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l 2024-09-10T11:15:42.227 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T11:15:42.248 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:41 smithi181 podman[73795]: 2024-09-10 11:15:41.992576275 +0000 UTC m=+0.519345494 container remove e1dd3464e4eb38538a86afdc6335c10a16345787e332f6ebc6aa5a57138aaf64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-86a09b02-6f62-11ef-bcea-c7b262605968-mds-l, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T11:15:42.248 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:42 smithi181 systemd[1]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-10T11:15:42.248 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:42 smithi181 systemd[1]: Stopped Ceph mds.l for 86a09b02-6f62-11ef-bcea-c7b262605968. 2024-09-10T11:15:42.249 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 10 11:15:42 smithi181 systemd[1]: ceph-86a09b02-6f62-11ef-bcea-c7b262605968@mds.l.service: Consumed 1.084s CPU time. 2024-09-10T11:15:42.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:15:42.259 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T11:15:42.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T11:15:42.472 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T11:15:45.039 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T11:15:45.240 INFO:teuthology.orchestra.run.smithi115.stdout:Deleting cluster with fsid: 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T11:15:47.773 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T11:15:47.975 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T11:15:50.333 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:15:50.368 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:15:50.401 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:15:50.428 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T11:15:50.430 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055/remote/smithi059/crash 2024-09-10T11:15:50.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/crash -- . 2024-09-10T11:15:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T11:15:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2024-09-10T11:15:50.476 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055/remote/smithi115/crash 2024-09-10T11:15:50.477 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/crash -- . 2024-09-10T11:15:50.516 INFO:teuthology.orchestra.run.smithi115.stderr:tar: /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T11:15:50.516 INFO:teuthology.orchestra.run.smithi115.stderr:tar: Error is not recoverable: exiting now 2024-09-10T11:15:50.519 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055/remote/smithi181/crash 2024-09-10T11:15:50.521 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/crash -- . 2024-09-10T11:15:50.560 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /var/lib/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T11:15:50.560 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now 2024-09-10T11:15:50.562 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T11:15:50.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T11:15:50.605 INFO:tasks.cephadm:Compressing logs... 2024-09-10T11:15:50.606 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:15:50.648 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:15:50.651 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:15:50.680 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T11:15:50.680 INFO:teuthology.orchestra.run.smithi181.stderr:: No such file or directory 2024-09-10T11:15:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T11:15:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:gzip/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T11:15:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T11:15:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T11:15:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T11:15:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T11:15:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.11.log: 82.0% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T11:15:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T11:15:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log 2024-09-10T11:15:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T11:15:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.2.log: /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.5.log: /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log: 90.6% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T11:15:50.684 INFO:teuthology.orchestra.run.smithi181.stderr: 87.3% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T11:15:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T11:15:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T11:15:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.8.log: 94.6% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T11:15:50.691 INFO:teuthology.orchestra.run.smithi181.stderr: 90.9% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T11:15:50.693 INFO:teuthology.orchestra.run.smithi115.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2024-09-10T11:15:50.693 INFO:teuthology.orchestra.run.smithi115.stderr: --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T11:15:50.693 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T11:15:50.693 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T11:15:50.694 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T11:15:50.694 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T11:15:50.694 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T11:15:50.694 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T11:15:50.694 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T11:15:50.694 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T11:15:50.694 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T11:15:50.695 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T11:15:50.695 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.cephadm.log: 94.6% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T11:15:50.695 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log 2024-09-10T11:15:50.695 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mgr.y.log: 82.0% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T11:15:50.695 INFO:teuthology.orchestra.run.smithi115.stderr: 91.0% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T11:15:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T11:15:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T11:15:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T11:15:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T11:15:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T11:15:50.697 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mon.a.log: 84.5% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.cephadm.log.gzgzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.g.log: -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log: 94.7% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.7% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T11:15:50.698 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T11:15:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T11:15:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T11:15:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T11:15:50.699 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.3.log: 91.0% 94.6% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T11:15:50.699 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T11:15:50.700 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T11:15:50.700 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T11:15:50.701 INFO:teuthology.orchestra.run.smithi115.stderr: 91.9% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T11:15:50.701 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T11:15:50.702 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T11:15:50.702 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T11:15:50.702 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mon.b.log: 87.3% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T11:15:50.702 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/cephadm.log: 93.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T11:15:50.704 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.c.log: 92.0% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T11:15:50.707 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T11:15:50.711 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T11:15:50.725 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T11:15:50.729 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T11:15:50.762 INFO:teuthology.orchestra.run.smithi181.stderr: 93.0% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T11:15:50.774 INFO:teuthology.orchestra.run.smithi181.stderr: 94.4% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T11:15:50.777 INFO:teuthology.orchestra.run.smithi115.stderr: 93.0% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T11:15:50.777 INFO:teuthology.orchestra.run.smithi115.stderr: 94.6% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T11:15:51.014 INFO:teuthology.orchestra.run.smithi181.stderr: 93.9% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T11:15:51.066 INFO:teuthology.orchestra.run.smithi059.stderr: 90.2% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T11:15:51.116 INFO:teuthology.orchestra.run.smithi181.stderr: 91.9% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T11:15:51.134 INFO:teuthology.orchestra.run.smithi115.stderr: 92.0% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T11:15:51.488 INFO:teuthology.orchestra.run.smithi059.stderr: 90.4% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T11:15:51.693 INFO:teuthology.orchestra.run.smithi181.stderr: 92.1% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T11:15:51.765 INFO:teuthology.orchestra.run.smithi059.stderr: 93.1% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T11:15:51.845 INFO:teuthology.orchestra.run.smithi115.stderr: 91.6% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T11:15:51.857 INFO:teuthology.orchestra.run.smithi181.stderr: 92.8% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T11:15:51.868 INFO:teuthology.orchestra.run.smithi059.stderr: 92.3% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T11:15:52.000 INFO:teuthology.orchestra.run.smithi059.stderr: 91.7% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T11:15:52.029 INFO:teuthology.orchestra.run.smithi059.stderr: 92.7% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T11:15:52.031 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-10T11:15:52.031 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m1.368s 2024-09-10T11:15:52.031 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m5.997s 2024-09-10T11:15:52.031 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.211s 2024-09-10T11:15:52.051 INFO:teuthology.orchestra.run.smithi115.stderr: 92.0% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T11:15:52.271 INFO:teuthology.orchestra.run.smithi115.stderr: 92.3% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T11:15:52.291 INFO:teuthology.orchestra.run.smithi181.stderr: 92.4% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T11:15:52.442 INFO:teuthology.orchestra.run.smithi115.stderr: 92.8% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T11:15:52.550 INFO:teuthology.orchestra.run.smithi181.stderr: 92.1% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T11:15:52.552 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-10T11:15:52.552 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m1.887s 2024-09-10T11:15:52.552 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m6.388s 2024-09-10T11:15:52.552 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.252s 2024-09-10T11:15:52.610 INFO:teuthology.orchestra.run.smithi115.stderr: 92.1% -- replaced with /var/log/ceph/86a09b02-6f62-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T11:15:52.613 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-10T11:15:52.613 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m1.947s 2024-09-10T11:15:52.613 INFO:teuthology.orchestra.run.smithi115.stderr:user 0m8.167s 2024-09-10T11:15:52.613 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m0.293s 2024-09-10T11:15:52.614 INFO:tasks.cephadm:Archiving logs... 2024-09-10T11:15:52.614 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055/remote/smithi059/log 2024-09-10T11:15:52.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:15:53.548 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055/remote/smithi115/log 2024-09-10T11:15:53.549 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:15:54.767 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055/remote/smithi181/log 2024-09-10T11:15:54.768 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:15:55.781 INFO:tasks.cephadm:Removing cluster... 2024-09-10T11:15:55.868 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 --force 2024-09-10T11:15:56.085 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T11:15:56.352 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 --force 2024-09-10T11:15:56.555 INFO:teuthology.orchestra.run.smithi115.stdout:Deleting cluster with fsid: 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T11:15:56.827 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86a09b02-6f62-11ef-bcea-c7b262605968 --force 2024-09-10T11:15:57.021 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 86a09b02-6f62-11ef-bcea-c7b262605968 2024-09-10T11:15:57.388 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T11:15:57.388 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T11:15:57.408 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T11:15:57.425 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T11:15:57.440 INFO:tasks.cephadm:Teardown complete 2024-09-10T11:15:57.441 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T11:15:57.453 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T11:15:57.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:15:57.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:15:57.468 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:15:57.580 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T11:15:57.591 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T11:15:57.591 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:15:57.594 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:15:57.597 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:15:57.610 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:15:57.610 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:15:57.611 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:15:57.614 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:15:57.614 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-10T11:15:57.614 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 -266us[ -266us] +/- 44ms 2024-09-10T11:15:57.614 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 +32us[ +32us] +/- 54ms 2024-09-10T11:15:57.614 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +515us[ +515us] +/- 88ms 2024-09-10T11:15:57.614 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:15:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:15:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-09-10T11:15:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 -268us[ -274us] +/- 44ms 2024-09-10T11:15:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 +13us[ +13us] +/- 54ms 2024-09-10T11:15:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +522us[ +515us] +/- 87ms 2024-09-10T11:15:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:15:57.617 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:15:57.617 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-10T11:15:57.617 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -252us[ -252us] +/- 43ms 2024-09-10T11:15:57.617 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 +14us[ +14us] +/- 54ms 2024-09-10T11:15:57.617 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +524us[ +524us] +/- 87ms 2024-09-10T11:15:57.617 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:15:57.618 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T11:15:57.627 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T11:15:57.628 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T11:15:57.637 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T11:15:57.740 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T11:15:57.809 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T11:15:57.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T11:15:57.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:15:57.909 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T11:15:57.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:15:57.937 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T11:15:57.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:15:57.965 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T11:15:57.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T11:15:58.075 INFO:teuthology.task.internal:Duration was 1856.318556 seconds 2024-09-10T11:15:58.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T11:15:58.085 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T11:15:58.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:15:58.088 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:15:58.091 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:15:58.128 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:15:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:15:58.130 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:15:58.498 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T11:15:58.498 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T11:15:58.499 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:15:58.521 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-09-10T11:15:58.522 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:15:58.561 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-09-10T11:15:58.561 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:15:58.587 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T11:15:58.587 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:15:58.589 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:15:58.604 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:15:58.655 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T11:15:58.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:15:58.659 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:15:58.670 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:15:59.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T11:15:59.152 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T11:15:59.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:15:59.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:15:59.203 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:15:59.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T11:15:59.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:15:59.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:15:59.246 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:15:59.264 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-09-10T11:15:59.267 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-09-10T11:15:59.293 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-09-10T11:15:59.326 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:15:59.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:15:59.341 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:15:59.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:15:59.372 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:15:59.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:15:59.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T11:15:59.398 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T11:15:59.399 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055/remote/smithi059 2024-09-10T11:15:59.399 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:15:59.444 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055/remote/smithi115 2024-09-10T11:15:59.444 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:15:59.479 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899055/remote/smithi181 2024-09-10T11:15:59.480 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:15:59.515 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T11:15:59.515 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:15:59.518 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:15:59.521 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:15:59.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T11:15:59.579 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T11:15:59.579 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T11:15:59.589 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T11:15:59.589 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:15:59.592 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:15:59.594 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:15:59.605 INFO:teuthology.orchestra.run.smithi059.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:15 /home/ubuntu/cephtest 2024-09-10T11:15:59.606 INFO:teuthology.orchestra.run.smithi115.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:15 /home/ubuntu/cephtest 2024-09-10T11:15:59.621 INFO:teuthology.orchestra.run.smithi181.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:15 /home/ubuntu/cephtest 2024-09-10T11:15:59.622 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T11:15:59.633 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T11:15:59.659 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 1856.3185555934906 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T11:15:59.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T11:15:59.740 INFO:teuthology.run:pass